betanews.net
robots.txt
Robots Exclusion Standard data for betanews.net
Resource Scan
Scan Details
| Site Domain | betanews.net |
| Base Domain | betanews.net |
| Scan Status | Ok |
| Last Scan | 2024-09-30T07:18:10+00:00 |
| Next Scan | 2024-10-07T07:18:10+00:00 |
Last Scan
| Scanned | 2024-09-30T07:18:10+00:00 |
| URL | https://betanews.net/robots.txt |
| Domain IPs | 211.239.126.137 |
| Response IP | 211.239.126.137 |
| Found | Yes |
| Hash | 88e1dd8bf82024b00ed0df0dad252b0719f9842f36e1128a8d1487ea9a642372 |
| SimHash | 08001cd476d1 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /admin/ |
| Disallow | /cp/ |
| Disallow | /sess/ |
| Disallow | /session/ |
| Disallow | /tmp/ |
| Disallow | /ad/ |
| Disallow | /community/ |
| Disallow | /member/ |
| Disallow | /inc/ |
| Disallow | /print/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |