sellpy.de
robots.txt

Robots Exclusion Standard data for sellpy.de

Resource Scan

Scan Details

Site Domain sellpy.de
Base Domain sellpy.de
Scan Status Ok
Last Scan2024-06-29T22:56:37+00:00
Next Scan 2024-07-13T22:56:37+00:00

Last Scan

Scanned2024-06-29T22:56:37+00:00
URL https://sellpy.de/robots.txt
Redirect https://www.sellpy.de/robots.txt
Redirect Domain www.sellpy.de
Redirect Base sellpy.de
Domain IPs 147.75.40.150
Redirect IPs 13.215.31.72, 175.41.180.202, 2406:da18:b3d:e200::1f4, 2406:da18:b3d:e202::1f4
Response IP 175.41.180.202
Found Yes
Hash 33d3a0eb2d2375ff38a8f0641cf58fdd4193e5fcb9686f05ea5aed4f7c9d5cf0
SimHash 610cd853e535

Groups

pinterestbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://prod.sitemap.sellpy.net/sitemap-index.xml?region=DE

Comments

  • https://help.pinterest.com/en/business/article/pinterest-crawler