scambusters.org
robots.txt
Robots Exclusion Standard data for scambusters.org
Resource Scan
Scan Details
| Site Domain | scambusters.org |
| Base Domain | scambusters.org |
| Scan Status | Ok |
| Last Scan | 2024-11-09T21:29:24+00:00 |
| Next Scan | 2024-11-16T21:29:24+00:00 |
Last Scan
| Scanned | 2024-11-09T21:29:24+00:00 |
| URL | https://scambusters.org/robots.txt |
| Domain IPs | 2406:da18:9d0:143f:2124:4e9c:36a9:d9de, 52.221.42.138 |
| Response IP | 52.221.42.138 |
| Found | Yes |
| Hash | 7a39c2994aed3d8cb3d094819e866eb0b302b78ed2e3d72a934a855a54a188e8 |
| SimHash | cc30e100f992 |
Groups
*
| Rule | Path | Comment |
|---|---|---|
| Disallow | /cgi-bin/ | don't go there --- --- |
| Disallow | /a/ | don't go there |
| Disallow | /wp-admin/ | - |
| Disallow | /wp-content/ | - |
Comments