juanstutors.org
robots.txt
Robots Exclusion Standard data for juanstutors.org
Resource Scan
Scan Details
| Site Domain | juanstutors.org |
| Base Domain | juanstutors.org |
| Scan Status | Ok |
| Last Scan | 2025-06-20T12:28:25+00:00 |
| Next Scan | 2025-06-27T12:28:25+00:00 |
Last Scan
| Scanned | 2025-06-20T12:28:25+00:00 |
| URL | http://juanstutors.org/robots.txt |
| Domain IPs | 2607:f1c0:100f:f000::29d, 74.208.236.56 |
| Response IP | 74.208.236.56 |
| Found | Yes |
| Hash | f3d91f8e8727b587ade8ba777fd30068738dad4dbead4944591eb6b6c234bbea |
| SimHash | fd385d68c38b |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin/ |
| Disallow | /includes/ |
| Disallow | /javascripts/ |
| Disallow | /logs/ |
| Disallow | /misc/ |
| Disallow | /standard_includes_ber/ |
| Disallow | /test/ |
| Disallow | /test2/ |
| Disallow | /test3/ |
| Disallow | /test4/ |
| Disallow | /test5/ |
| Disallow | /test6/ |
| Disallow | /test7/ |
| Disallow | /test8/ |
| Disallow | /test9/ |
| Disallow | /test10/ |
| Disallow | /ascii_tables_generator*.php |
| Disallow | /hex_ascii_tables_generator*.php |
| Disallow | /special_ascii_characters_generator*.php |
| Disallow | /spam_glossary_generator*.php |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 60 |