howdididoit.com
robots.txt

Robots Exclusion Standard data for howdididoit.com

Resource Scan

Scan Details

Site Domain howdididoit.com
Base Domain howdididoit.com
Scan Status Ok
Last Scan2025-10-13T05:44:00+00:00
Next Scan 2025-10-20T05:44:00+00:00

Last Scan

Scanned2025-10-13T05:44:00+00:00
URL https://howdididoit.com/robots.txt
Domain IPs 104.21.69.232, 172.67.215.111, 2606:4700:3031::ac43:d76f, 2606:4700:3033::6815:45e8
Response IP 172.67.215.111
Found Yes
Hash d9992ea24a25a7ac7240fc73569ca5b968ccb7fb5b147f93aca7e88ea500689a
SimHash 8a0c8c026a92

Groups

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mediapartners-google

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://howdididoit.com/sitemaps.xml