chanrobles.com
robots.txt

Robots Exclusion Standard data for chanrobles.com

Resource Scan

Scan Details

Site Domain chanrobles.com
Base Domain chanrobles.com
Scan Status Ok
Last Scan2024-09-19T13:48:41+00:00
Next Scan 2024-09-26T13:48:41+00:00

Last Scan

Scanned2024-09-19T13:48:41+00:00
URL https://chanrobles.com/robots.txt
Domain IPs 104.21.82.61, 172.67.197.26, 2606:4700:3030::ac43:c51a, 2606:4700:3033::6815:523d
Response IP 104.21.82.61
Found Yes
Hash 0cb88237ae381e6bbe597717d3c298eb630d8f8a5f550f3357db5981fbb1b8c3
SimHash 05d8ed71edc0

Groups

googlebot
googlebot-mobile
mediapartners-google
adsbot-google
googleother
google-inspectiontool
googlebot-news
apis-google
adsbot-google-mobile
feedfetcher-google
googleproducer
mozilla/5.0 (compatible; google-site-verification/1.0)
googleproducer; (+http://goo.gl/7y4sx)
*

Rule Path
Disallow /_notes
Disallow /cache
Disallow /cgi-bin
Disallow /chromejs
Disallow /chrometheme
Disallow /coockies
Disallow /flash
Disallow /images
Disallow /images1
Disallow /img
Disallow /index1_files
Disallow /jgc
Disallow /logs
Disallow /message_files
Disallow /scripts
Disallow /tbsm
Disallow /tmp
Disallow /topmenu
Disallow /usagestats

Warnings

  • `https` is not a known field.