cmt.com
robots.txt

Robots Exclusion Standard data for cmt.com

Resource Scan

Scan Details

Site Domain cmt.com
Base Domain cmt.com
Scan Status Ok
Last Scan2024-05-06T19:42:27+00:00
Next Scan 2024-05-13T19:42:27+00:00

Last Scan

Scanned2024-05-06T19:42:27+00:00
URL https://cmt.com/robots.txt
Redirect https://www.cmt.com/robots.txt
Redirect Domain www.cmt.com
Redirect Base cmt.com
Domain IPs 34.213.106.51, 54.68.182.72
Redirect IPs 23.52.114.111, 2600:1413:b000:38a::2215, 2600:1413:b000:38e::2215
Response IP 23.54.58.160
Found Yes
Hash dcbdfcef1a6a0644c004ce24d8b6eba2dd25fc520bc4588b5acce54fd88df806
SimHash 68184c208d12

Groups

*

Rule Path
Disallow /api/

petalbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.cmt.com/xmlsitemap/us/en-us/episode
sitemap https://www.cmt.com/xmlsitemap/us/en-us/photogallery
sitemap https://www.cmt.com/xmlsitemap/us/en-us/video
sitemap https://www.cmt.com/xmlsitemap/us/en-us/season
sitemap https://www.cmt.com/xmlsitemap/us/en-us/show
sitemap https://www.cmt.com/xmlsitemap/us/en-us/news/all-category-sitemap.xml