sellpy.pl
robots.txt

Robots Exclusion Standard data for sellpy.pl

Resource Scan

Scan Details

Site Domain sellpy.pl
Base Domain sellpy.pl
Scan Status Ok
Last Scan2024-09-21T12:43:29+00:00
Next Scan 2024-10-05T12:43:29+00:00

Last Scan

Scanned2024-09-21T12:43:29+00:00
URL https://sellpy.pl/robots.txt
Redirect https://www.sellpy.pl/robots.txt
Redirect Domain www.sellpy.pl
Redirect Base sellpy.pl
Domain IPs 147.75.40.150
Redirect IPs 13.215.31.72, 175.41.180.202, 2406:da12:53f:c101::1f4, 2406:da12:53f:c102::1f4
Response IP 13.215.31.72
Found Yes
Hash e914dbff56b352a48bde87bba07fa3f37ab7f1821e8ef8160f2061a69f482e60
SimHash 630cd873d135

Groups

pinterestbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://prod.sitemap.sellpy.net/sitemap-index.xml?region=PL

Comments

  • https://help.pinterest.com/en/business/article/pinterest-crawler