theitroad.com
robots.txt

Robots Exclusion Standard data for theitroad.com

Resource Scan

Scan Details

Site Domain theitroad.com
Base Domain theitroad.com
Scan Status Ok
Last Scan2025-11-02T11:25:32+00:00
Next Scan 2025-11-09T11:25:32+00:00

Last Scan

Scanned2025-11-02T11:25:32+00:00
URL https://theitroad.com/robots.txt
Redirect https://www.theitroad.com/robots.txt
Redirect Domain www.theitroad.com
Redirect Base theitroad.com
Domain IPs 104.21.81.3, 172.67.155.167, 2606:4700:3033::6815:5103, 2606:4700:3035::ac43:9ba7
Redirect IPs 104.21.81.3, 172.67.155.167, 2606:4700:3033::6815:5103, 2606:4700:3035::ac43:9ba7
Response IP 172.67.155.167
Found Yes
Hash 0eb196212cb3425941c93b86c697fa45bfde09a2589426fa1d63a83777c325a8
SimHash 481c82e2e933

Groups

mj12bot

Rule Path
Disallow /

yodaobot
ahrefsbot
semrushbot

Rule Path
Disallow /

acunetix

Rule Path
Disallow /

*

Rule Path
Allow /

*

Rule Path
Disallow /igi_link.php