understandingtheada.com
robots.txt

Robots Exclusion Standard data for understandingtheada.com

Resource Scan

Scan Details

Site Domain understandingtheada.com
Base Domain understandingtheada.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-10-16T19:16:26+00:00
Next Scan 2026-01-14T19:16:26+00:00

Last Successful Scan

Scanned2024-06-01T06:01:51+00:00
URL https://understandingtheada.com/robots.txt
Redirect https://www.understandingtheada.com/robots.txt
Redirect Domain www.understandingtheada.com
Redirect Base understandingtheada.com
Domain IPs 104.21.44.68, 172.67.196.179, 2606:4700:3032::ac43:c4b3, 2606:4700:3036::6815:2c44
Redirect IPs 104.21.44.68, 172.67.196.179, 2606:4700:3032::ac43:c4b3, 2606:4700:3036::6815:2c44
Response IP 104.21.44.68
Found Yes
Hash b336b0b4a64a0a85664100e6796d7b6a36cf3c4b427971bb37bf1d94dde492c2
SimHash 6f2888c0e1bb

Groups

*

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://www.understandingtheada.com/sitemap_index.xml

Comments

  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK