allvideo.su
robots.txt
Robots Exclusion Standard data for allvideo.su
Resource Scan
Scan Details
| Site Domain | allvideo.su |
| Base Domain | allvideo.su |
| Scan Status | Ok |
| Last Scan | 2024-10-25T05:24:26+00:00 |
| Next Scan | 2024-11-01T05:24:26+00:00 |
Last Scan
| Scanned | 2024-10-25T05:24:26+00:00 |
| URL | https://allvideo.su/robots.txt |
| Domain IPs | 2a00:15f8:a000:5:1:11:0:1efe, 2a00:15f8:a000:5:1:12:0:1efe, 2a00:15f8:a000:5:1:13:0:1efe, 2a00:15f8:a000:5:1:14:0:1efe, 90.156.201.19, 90.156.201.60, 90.156.201.89, 90.156.201.99 |
| Response IP | 90.156.201.99 |
| Found | Yes |
| Hash | 26e6520b9b3ecd65c0f0e629476ce50104429f0e3c82e2e2b66b0ee24f45ce20 |
| SimHash | 48c90860c790 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin |
| Disallow | /cgi-bin/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://allvideo.su/sitemap.xml |
| sitemap | https://allvideo.su/sitemap.xml |
| sitemap | https://allvideo.su/sitemap.xml |
Warnings
- `host` is not a known field.