cgct.jp
robots.txt

Robots Exclusion Standard data for cgct.jp

Resource Scan

Scan Details

Site Domain cgct.jp
Base Domain cgct.jp
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-03-16T03:27:26+00:00
Next Scan 2025-06-14T03:27:26+00:00

Last Successful Scan

Scanned2022-11-04T01:13:49+00:00
URL https://cgct.jp/robots.txt
Response IP 172.67.214.159, 104.21.53.155
Found Yes
Hash c77551eba787b663e3d9c6935a8af076b23b3a59a7974fb983e2c88bbfd5827f
SimHash 081ecd60ea9b

Groups

baiduspider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

*

Rule Path
Disallow