wtxl.tv
robots.txt
Robots Exclusion Standard data for wtxl.tv
Resource Scan
Scan Details
Site Domain | wtxl.tv |
Base Domain | wtxl.tv |
Scan Status | Ok |
Last Scan | 2024-09-25T14:38:31+00:00 |
Next Scan | 2024-10-02T14:38:31+00:00 |
Last Scan
Scanned | 2024-09-25T14:38:31+00:00 |
URL | http://wtxl.tv/robots.txt |
Redirect | https://www.wtxl.com/robots.txt |
Redirect Domain | www.wtxl.com |
Redirect Base | wtxl.com |
Domain IPs | 54.224.11.102, 54.88.246.232 |
Redirect IPs | 3.165.102.109, 3.165.102.123, 3.165.102.19, 3.165.102.67 |
Response IP | 3.165.102.19 |
Found | Yes |
Hash | 97f69ead4e1cefea8f93ffefc1c7a4dc0572faa37bd983a1c02dcade634a1533 |
SimHash | 23048c40e393 |
Groups
*
Rule | Path |
---|---|
Disallow | /_debug/ |
Disallow | /_plugins/ |
Disallow | /ajax/ |
Disallow | /cms/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.wtxl.com/sitemap.xml |
sitemap | https://www.wtxl.com/news-sitemap-content.xml |