ywc.thehindu.com
robots.txt

Robots Exclusion Standard data for ywc.thehindu.com

Resource Scan

Scan Details

Site Domain ywc.thehindu.com
Base Domain thehindu.com
Scan Status Ok
Last Scan2024-05-10T15:57:26+00:00
Next Scan 2024-06-09T15:57:26+00:00

Last Scan

Scanned2024-05-10T15:57:26+00:00
URL https://ywc.thehindu.com/robots.txt
Domain IPs 104.18.39.235, 172.64.148.21, 2606:4700:4400::6812:27eb, 2606:4700:4400::ac40:9415
Response IP 104.18.39.235
Found Yes
Hash 5610a54fc3b57e927cfc160341df8d5b8ad41637a805d57b047f108d4cd95d2b
SimHash 61245a604bb3

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

gptbot

Rule Path
Disallow /

Comments

  • Disallow ChatGPT from extracting or interpreting our content