calpeculiarities.com
robots.txt

Robots Exclusion Standard data for calpeculiarities.com

Resource Scan

Scan Details

Site Domain calpeculiarities.com
Base Domain calpeculiarities.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-10-11T13:38:56+00:00
Next Scan 2026-01-09T13:38:56+00:00

Last Successful Scan

Scanned2024-05-27T13:35:42+00:00
URL https://calpeculiarities.com/robots.txt
Redirect https://www.calpeculiarities.com/robots.txt
Redirect Domain www.calpeculiarities.com
Redirect Base calpeculiarities.com
Domain IPs 104.21.52.218, 172.67.204.91, 2606:4700:3031::ac43:cc5b, 2606:4700:3033::6815:34da
Redirect IPs 104.21.52.218, 172.67.204.91, 2606:4700:3031::ac43:cc5b, 2606:4700:3033::6815:34da
Response IP 104.21.52.218
Found Yes
Hash 8bc30571df161c74c16ea1a9d5227d75905d5af07ada6ad428e91ac9fcc7b2e7
SimHash 6a48c8c0e89b

Groups

*

Rule Path
Disallow

Other Records

Field Value
crawl-delay 30

Other Records

Field Value
sitemap https://www.calpeculiarities.com/sitemap_index.xml

Comments

  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK