metv.com
robots.txt

Robots Exclusion Standard data for metv.com

Resource Scan

Scan Details

Site Domain metv.com
Base Domain metv.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-25T09:10:30+00:00
Next Scan 2025-01-23T09:10:30+00:00

Last Successful Scan

Scanned2024-03-30T08:51:03+00:00
URL https://metv.com/robots.txt
Domain IPs 104.26.14.131, 104.26.15.131, 172.67.68.192, 2606:4700:20::681a:e83, 2606:4700:20::681a:f83, 2606:4700:20::ac43:44c0
Response IP 104.26.14.131
Found Yes
Hash bd265bbb1a09d9a36a0f51be85defa3ecdd173f3a169bc2ec20a2c2ffe1f41b5
SimHash e9145c00a892

Groups

*

Rule Path
Disallow /assets/
Disallow /search/

Other Records

Field Value
sitemap https://www.metv.com/sitemap.xml