aaroananda.com
robots.txt

Robots Exclusion Standard data for aaroananda.com

Resource Scan

Scan Details

Site Domain aaroananda.com
Base Domain aaroananda.com
Scan Status Ok
Last Scan2024-09-25T16:24:52+00:00
Next Scan 2024-10-02T16:24:52+00:00

Last Scan

Scanned2024-09-25T16:24:52+00:00
URL https://aaroananda.com/robots.txt
Domain IPs 104.26.6.120, 104.26.7.120, 172.67.73.191, 2606:4700:20::681a:678, 2606:4700:20::681a:778, 2606:4700:20::ac43:49bf
Response IP 104.26.7.120
Found Yes
Hash f23e5cfc4543d682e1d35978b2e9d4a5040e8b6bfe4e06076a33b1944c772a27
SimHash 59188810e434

Groups

*

Rule Path
Allow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

bytedance

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://seo.aaroananda.com/sitemaps/sitemapIndex.xml

Warnings

  • 7 invalid lines.