epaperdivyamarathi.bhaskar.com
robots.txt

Robots Exclusion Standard data for epaperdivyamarathi.bhaskar.com

Resource Scan

Scan Details

Site Domain epaperdivyamarathi.bhaskar.com
Base Domain bhaskar.com
Scan Status Ok
Last Scan2024-05-16T15:04:04+00:00
Next Scan 2024-05-30T15:04:04+00:00

Last Scan

Scanned2024-05-16T15:04:04+00:00
URL https://epaperdivyamarathi.bhaskar.com/robots.txt
Redirect https://divyamarathi.bhaskar.com:443/epaper/robots.txt
Redirect Domain divyamarathi.bhaskar.com
Redirect Base bhaskar.com
Domain IPs 13.225.4.40, 13.225.4.48, 13.225.4.77, 13.225.4.9
Redirect IPs 108.156.133.112, 108.156.133.27, 108.156.133.60, 108.156.133.96
Response IP 108.156.133.112
Found Yes
Hash 5ebd632b2630fce9ee6986c3bfd00430ec66497b6db9e603a249a123d8a48406
SimHash 4000c9488135

Groups

*

Rule Path
Allow /

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /