sellpy.dk
robots.txt

Robots Exclusion Standard data for sellpy.dk

Resource Scan

Scan Details

Site Domain sellpy.dk
Base Domain sellpy.dk
Scan Status Ok
Last Scan2024-09-23T11:15:31+00:00
Next Scan 2024-10-07T11:15:31+00:00

Last Scan

Scanned2024-09-23T11:15:31+00:00
URL https://sellpy.dk/robots.txt
Redirect https://www.sellpy.dk/robots.txt
Redirect Domain www.sellpy.dk
Redirect Base sellpy.dk
Domain IPs 147.75.40.150
Redirect IPs 13.215.246.123, 175.41.180.202, 2406:da18:b3d:e201::1f4, 2406:da18:b3d:e202::1f4
Response IP 13.215.246.123
Found Yes
Hash a81ec265cb3012b405bae4abfc9798236974cd7381e4a705b120076991d28a0c
SimHash 610cd853f135

Groups

pinterestbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://prod.sitemap.sellpy.net/sitemap-index.xml?region=DK

Comments

  • https://help.pinterest.com/en/business/article/pinterest-crawler