pythonanywhere.com
robots.txt

Robots Exclusion Standard data for pythonanywhere.com

Resource Scan

Scan Details

Site Domain pythonanywhere.com
Base Domain pythonanywhere.com
Scan Status Ok
Last Scan2024-10-31T03:13:17+00:00
Next Scan 2024-11-30T03:13:17+00:00

Last Scan

Scanned2024-10-31T03:13:17+00:00
URL https://pythonanywhere.com/robots.txt
Redirect https://www.pythonanywhere.com/robots.txt
Redirect Domain www.pythonanywhere.com
Redirect Base pythonanywhere.com
Domain IPs 35.173.69.207
Redirect IPs 35.173.69.207
Response IP 35.173.69.207
Found Yes
Hash fe7239e4d041f66671d036d9fe817ac195793cfa9ecd806e709e16bc9d0450db
SimHash ec55d430e315

Groups

*

Rule Path
Disallow /admin/
Disallow /beta_signup/
Disallow /feedback/
Disallow /login/
Disallow /loggedin
Disallow /logout
Disallow /registration/
Disallow /user/
Disallow /static/anywhere/tests/