sellpy.fi
robots.txt

Robots Exclusion Standard data for sellpy.fi

Resource Scan

Scan Details

Site Domain sellpy.fi
Base Domain sellpy.fi
Scan Status Ok
Last Scan2024-09-22T07:06:25+00:00
Next Scan 2024-10-06T07:06:25+00:00

Last Scan

Scanned2024-09-22T07:06:25+00:00
URL https://sellpy.fi/robots.txt
Redirect https://www.sellpy.fi/robots.txt
Redirect Domain www.sellpy.fi
Redirect Base sellpy.fi
Domain IPs 147.75.40.150
Redirect IPs 13.215.246.123, 175.41.180.202, 2406:da14:ef6:8500::1f4, 2406:da14:ef6:8501::1f4
Response IP 13.215.246.123
Found Yes
Hash 6ea23c19c2e9e93a9e028963b5d677d80e9d019034486da30d64c35f6b9d336e
SimHash 6104d073f735

Groups

pinterestbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://prod.sitemap.sellpy.net/sitemap-index.xml?region=FI

Comments

  • https://help.pinterest.com/en/business/article/pinterest-crawler