laregioninternacional.com
robots.txt

Robots Exclusion Standard data for laregioninternacional.com

Resource Scan

Scan Details

Site Domain laregioninternacional.com
Base Domain laregioninternacional.com
Scan Status Ok
Last Scan2024-09-24T23:48:48+00:00
Next Scan 2024-10-01T23:48:48+00:00

Last Scan

Scanned2024-09-24T23:48:48+00:00
URL https://laregioninternacional.com/robots.txt
Redirect https://www.laregioninternacional.com/robots.txt
Redirect Domain www.laregioninternacional.com
Redirect Base laregioninternacional.com
Domain IPs 104.21.34.185, 172.67.163.186, 2606:4700:3034::6815:22b9, 2606:4700:3034::ac43:a3ba
Redirect IPs 104.21.34.185, 172.67.163.186, 2606:4700:3034::6815:22b9, 2606:4700:3034::ac43:a3ba
Response IP 104.21.34.185
Found Yes
Hash bc96e08827dea24fb5a441f9e35033f1e75389e0dadbb2c56798ddabcf6d6d4e
SimHash b100d9d088d6

Groups

*

Rule Path
Disallow /harming/humans
Disallow /ignoring/human/orders
Disallow /harm/to/self
Disallow /api
Disallow /admin
Disallow /tag
Disallow /archive

applebot-extended

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.laregioninternacional.com/sitemap.news.xml.gz
sitemap https://www.laregioninternacional.com/sitemap.xml

Comments

  • disallowed AI agents 2024-07