m.mtv.de
robots.txt

Robots Exclusion Standard data for m.mtv.de

Resource Scan

Scan Details

Site Domain m.mtv.de
Base Domain mtv.de
Scan Status Ok
Last Scan2024-05-15T09:32:23+00:00
Next Scan 2024-06-14T09:32:23+00:00

Last Scan

Scanned2024-05-15T09:32:23+00:00
URL https://m.mtv.de/robots.txt
Redirect https://www.mtv.de/robots.txt
Redirect Domain www.mtv.de
Redirect Base mtv.de
Domain IPs 34.213.106.51, 54.68.182.72
Redirect IPs 23.41.19.194, 2600:1413:b000:383::16e, 2600:1413:b000:390::16e
Response IP 184.28.52.126
Found Yes
Hash db5823673d13aaf2f1f044c90cb2dca0e1f60fac7dda79fcdbd7ab891993207d
SimHash ed024a64de90

Groups

*

Rule Path
Disallow /api/

petalbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.mtv.de/xmlsitemap/video
sitemap https://www.mtv.de/xmlsitemap/episode
sitemap https://www.mtv.de/xmlsitemap/season
sitemap https://www.mtv.de/xmlsitemap/photogallery