recipespastry.com
robots.txt

Robots Exclusion Standard data for recipespastry.com

Resource Scan

Scan Details

Site Domain recipespastry.com
Base Domain recipespastry.com
Scan Status Ok
Last Scan2025-04-05T10:54:30+00:00
Next Scan 2025-04-12T10:54:30+00:00

Last Scan

Scanned2025-04-05T10:54:30+00:00
URL https://recipespastry.com/robots.txt
Redirect https://www.recipespastry.com/robots.txt
Redirect Domain www.recipespastry.com
Redirect Base recipespastry.com
Domain IPs 104.21.46.73, 172.67.136.101, 2606:4700:3034::6815:2e49, 2606:4700:3035::ac43:8865
Redirect IPs 104.21.46.73, 172.67.136.101, 2606:4700:3034::6815:2e49, 2606:4700:3035::ac43:8865
Response IP 172.67.136.101
Found Yes
Hash a981406f1f527a01c0de7023ecf12c19176aa2a54d762bf0a2247ef6acb72386
SimHash 6d4493504613

Groups

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /search
Allow /
Allow /ads.txt

Other Records

Field Value
sitemap https://www.recipespastry.com/sitemap.xml