mtv.com
robots.txt

Robots Exclusion Standard data for mtv.com

Resource Scan

Scan Details

Site Domain mtv.com
Base Domain mtv.com
Scan Status Ok
Last Scan2024-04-26T07:10:00+00:00
Next Scan 2024-05-03T07:10:00+00:00

Last Scan

Scanned2024-04-26T07:10:00+00:00
URL https://mtv.com/robots.txt
Redirect https://www.mtv.com/robots.txt
Redirect Domain www.mtv.com
Redirect Base mtv.com
Domain IPs 34.213.106.51, 54.68.182.72
Redirect IPs 23.52.114.111, 2600:1413:b000:38e::2215, 2600:1413:b000:391::2215
Response IP 23.54.58.160
Found Yes
Hash b77ff2d330876b9c4f1c144c02864840d84c34556dac49d7e0ae009a7242206c
SimHash ea19542483b3

Groups

*

Rule Path
Disallow /api/

petalbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.mtv.com/xmlsitemap/episode
sitemap https://www.mtv.com/xmlsitemap/photogallery
sitemap https://www.mtv.com/xmlsitemap/season
sitemap https://www.mtv.com/xmlsitemap/show
sitemap https://www.mtv.com/xmlsitemap/video
sitemap https://www.mtv.com/xmlsitemap/news/all-category-sitemap.xml