/.well-known/

Log In Sign Up

catr.jp
robots.txt

Robots Exclusion Standard data for catr.jp

Archived Snapshots

Resource Scan

Scan Details

Site Domain	catr.jp
Base Domain	catr.jp
Scan Status	Ok
Last Scan	2024-10-30T17:25:45+00:00
Next Scan	2024-11-06T17:25:45+00:00

Last Scan

Scanned	2024-10-30T17:25:45+00:00
URL	https://catr.jp/robots.txt
Domain IPs	13.33.88.18, 13.33.88.23, 13.33.88.27, 13.33.88.80
Response IP	13.33.88.18
Found	Yes
Hash	f01274bb712567af5e03e0bdb5ae39fef6df8e2c51bb648b57451fb3a935cd1e
SimHash	827e99afff72

Groups

mj12bot

Rule

Path

Disallow

/

ahrefsbot

Rule

Path

Disallow

/

blexbot

Rule

Path

Disallow

/

dotbot

Rule

Path

Disallow

/

gptbot

Rule

Path

Disallow

/

Back to top

Comments

See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file

Back to top