pdfscanner.xyz
robots.txt
Robots Exclusion Standard data for pdfscanner.xyz
Resource Scan
Scan Details
| Site Domain | pdfscanner.xyz |
| Base Domain | pdfscanner.xyz |
| Scan Status | Ok |
| Last Scan | 2024-10-10T07:03:12+00:00 |
| Next Scan | 2024-10-17T07:03:12+00:00 |
Last Scan
| Scanned | 2024-10-10T07:03:12+00:00 |
| URL | https://pdfscanner.xyz/robots.txt |
| Domain IPs | 3.165.82.12, 3.165.82.128, 3.165.82.42, 3.165.82.60 |
| Response IP | 3.165.82.60 |
| Found | Yes |
| Hash | 77825c0d959842b58a9605d73cd3687a61164341c0ac5d2527f280faa384df00 |
| SimHash | 6d049c54a4b0 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /privacy |
*
| Rule | Path |
|---|---|
| Disallow | /termsofuse |
*
| Rule | Path |
|---|---|
| Disallow | /icon.png |
Other Records
| Field | Value |
|---|---|
| sitemap | https://pdfscanner.xyz/sitemap.xml |
Warnings
- `host` is not a known field.
Comments