onayamifree.com
robots.txt

Robots Exclusion Standard data for onayamifree.com

Resource Scan

Scan Details

Site Domain onayamifree.com
Base Domain onayamifree.com
Scan Status Ok
Last Scan2024-10-02T16:31:42+00:00
Next Scan 2024-10-09T16:31:42+00:00

Last Scan

Scanned2024-10-02T16:31:42+00:00
URL https://onayamifree.com/robots.txt
Domain IPs 13.114.8.131, 52.69.197.244
Response IP 13.114.8.131
Found Yes
Hash 06225ce6db1ea2b3cec7870ad3c27461372f2395ed417f1612c21431c490e4c4
SimHash eb1341096700

Groups

*

Rule Path
Disallow /profile/*
Disallow /mypage/*
Disallow /mythread/*
Disallow /thread/post/*
Disallow /thread/postres/*
Disallow /threadres/post/*
Disallow /threadres/postres/*
Disallow /penalty/*
Disallow /premium/*
Disallow /auth/*
Disallow /dispmythread.cgi
Disallow /dropresreqpre.cgi
Disallow /dropthreqpre.cgi
Disallow /checkmem_ez.cgi
Disallow /respre.cgi

applebot
ise crawler
amazonbot
bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 3