thevangtvhd.tv
robots.txt
Robots Exclusion Standard data for thevangtvhd.tv
Resource Scan
Scan Details
Site Domain | thevangtvhd.tv |
Base Domain | thevangtvhd.tv |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-07-10T21:24:06+00:00 |
Next Scan | 2024-10-08T21:24:06+00:00 |
Last Successful Scan
Scanned | 2023-08-22T22:00:34+00:00 |
URL | https://thevangtvhd.tv/robots.txt |
Domain IPs | 104.21.46.56, 172.67.223.228, 2606:4700:3030::ac43:dfe4, 2606:4700:3037::6815:2e38 |
Response IP | 172.67.223.228 |
Found | Yes |
Hash | c36cb09152b024c3a6aee7f7a4ee10517e3c33dec03b7c3e877907588fd6d1fb |
SimHash | a00c1ab0c313 |
Groups
*
Rule | Path |
---|---|
Allow | / |
*
Rule | Path |
---|---|
Disallow | /mirr/update.js |
Disallow | /sitemap_mir/appoint.js |
Disallow | /sitemap_mir/appoint.xml?action |
Disallow | /mirr/update?url=%2F |
Other Records
Field | Value |
---|---|
sitemap | http://thevangtvhd.tv/sitemap.xml |
sitemap | http://thevangtvhd.tv/sitemap/sitemap-matchs.xml |
sitemap | http://thevangtvhd.tv/sitemap/sitemap-highlights.xml |