/.well-known/

Log In Sign Up

m.ai6yr.org
robots.txt

Robots Exclusion Standard data for m.ai6yr.org

Archived Snapshots

Resource Scan

Scan Details

Site Domain	m.ai6yr.org
Base Domain	ai6yr.org
Scan Status	Ok
Last Scan	2024-10-01T22:06:17+00:00
Next Scan	2024-10-02T22:06:17+00:00

Last Scan

Scanned	2024-10-01T22:06:17+00:00
URL	https://m.ai6yr.org/robots.txt
Domain IPs	104.21.75.245, 172.67.184.12, 2606:4700:3036::6815:4bf5, 2606:4700:3037::ac43:b80c
Response IP	172.67.184.12
Found	Yes
Hash	0ed5478927e0b22a2553f386ce7aa8fbebf41b149f9cf1a40455ca0d125e20a7
SimHash	bad41b057563

Groups

gptbot

Rule

Path

Disallow

/

*

Rule

Path

Disallow

/media_proxy/

Disallow

/interact/

claudebot

Rule

Path

Disallow

/

chatgpt-user

Rule

Path

Disallow

/

google-extended

Rule

Path

Disallow

/

ccbot

Rule

Path

Disallow

/

Back to top

Comments

See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file

Back to top