channelthon.com
robots.txt

Robots Exclusion Standard data for channelthon.com

Resource Scan

Scan Details

Site Domain channelthon.com
Base Domain channelthon.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-08-03T09:52:51+00:00
Next Scan 2024-11-01T09:52:51+00:00

Last Successful Scan

Scanned2024-01-07T02:04:54+00:00
URL https://channelthon.com/robots.txt
Domain IPs 104.21.54.119, 172.67.138.131, 2606:4700:3030::ac43:8a83, 2606:4700:3033::6815:3677
Response IP 172.67.138.131
Found Yes
Hash a0ab27f647e8b933d614f8be7a97e8b036a59d93eecd6c717591948eb60a5b36
SimHash 4a54d850d7b0

Groups

mediapartners-google
googlebot
google-mobile
adsbot-google
bingbot
twitterbot
alexabot
slurp
msnbot
facebookexternalhit/1.1

Rule Path
Allow /

google-image

Rule Path
Disallow /wp-content/uploads

Other Records

Field Value
crawl-delay 300

*

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.channelthon.com/sitemap.xml
sitemap https://www.channelthon.com/sitemap.html
sitemap https://www.channelthon.com/post-sitemap.xml
sitemap https://www.channelthon.com/post_tag-sitemap.xml

Comments

  • Allow
  • Crawl-delay: 300
  • disallow all
  • sitemaps

Warnings

  • 1 invalid line.