Log In Sign Up

asktheref.com
robots.txt

Robots Exclusion Standard data for asktheref.com

Resource Scan

Scan Details

Site Domain asktheref.com
Base Domain asktheref.com
Scan Status Ok
Last Scan2026-01-03T13:57:15+00:00
Next Scan 2026-01-10T13:57:15+00:00

Last Scan

Scanned2026-01-03T13:57:15+00:00
URL https://asktheref.com/robots.txt
Domain IPs 50.63.8.37
Response IP 50.63.8.37
Found Yes
Hash 302d2f38b9984e23432813323e49fe65d4ec43e8c54576fcce88ef801ec54aad
SimHash eb048b3507d1

Groups

googlebot

Rule Path
Disallow /App_Data/
Disallow /DB_SQL/
Disallow /superquiz/
Disallow /bin1/
Disallow /aspnet_client/
Allow /
Back to top

Comments

  • Block googlebot from example.com/directory1/... and example.com/directory2/...
  • but allow access to directory2/subdirectory1/...
  • All other directories on the site are allowed by default.
Back to top