sellpy.nl
robots.txt

Robots Exclusion Standard data for sellpy.nl

Resource Scan

Scan Details

Site Domain sellpy.nl
Base Domain sellpy.nl
Scan Status Ok
Last Scan2024-09-21T12:46:59+00:00
Next Scan 2024-10-05T12:46:59+00:00

Last Scan

Scanned2024-09-21T12:46:59+00:00
URL https://sellpy.nl/robots.txt
Redirect https://www.sellpy.nl/robots.txt
Redirect Domain www.sellpy.nl
Redirect Base sellpy.nl
Domain IPs 147.75.40.150
Redirect IPs 13.215.31.72, 175.41.180.202, 2406:da18:b3d:e200::1f4, 2406:da18:b3d:e202::1f4
Response IP 13.215.31.72
Found Yes
Hash 28a02d77b6d46f82aa74986a073bc83ef09c602959da0dcdfeae476018f6025e
SimHash 610cd453d135

Groups

pinterestbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://prod.sitemap.sellpy.net/sitemap-index.xml?region=NL

Comments

  • https://help.pinterest.com/en/business/article/pinterest-crawler