fridaycakenight.com
robots.txt

Robots Exclusion Standard data for fridaycakenight.com

Resource Scan

Scan Details

Site Domain fridaycakenight.com
Base Domain fridaycakenight.com
Scan Status Ok
Last Scan2024-10-04T09:49:14+00:00
Next Scan 2024-10-11T09:49:14+00:00

Last Scan

Scanned2024-10-04T09:49:14+00:00
URL https://fridaycakenight.com/robots.txt
Domain IPs 67.222.38.91
Response IP 67.222.38.91
Found Yes
Hash 97b77329211e8afc641cdcbd30f5a8f3473dbfe2ebe722ccbbc74efb70d54c63
SimHash 61005815c713

Groups

scrapy

Rule Path
Allow /

*

Rule Path
Disallow

Other Records

Field Value
sitemap http://fridaycakenight.com/sitemap.xml