testfreaks.com
robots.txt

Robots Exclusion Standard data for testfreaks.com

Resource Scan

Scan Details

Site Domain testfreaks.com
Base Domain testfreaks.com
Scan Status Ok
Last Scan2024-10-19T19:25:27+00:00
Next Scan 2024-11-18T19:25:27+00:00

Last Scan

Scanned2024-10-19T19:25:27+00:00
URL https://www.testfreaks.com/robots.txt
Domain IPs 76.76.21.142, 76.76.21.93
Response IP 76.76.21.142
Found Yes
Hash 4c784af464075c7f388b3a738093088479ab738be4db5060d0b43e1f37bd9357
SimHash 181cd5626bb1

Groups

semrushbot-sa

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

the knowledge ai

Rule Path
Disallow /

*

Rule Path
Disallow /docs/portal
Disallow /*.pdf$