oita-press.co.jp
robots.txt

Robots Exclusion Standard data for oita-press.co.jp

Resource Scan

Scan Details

Site Domain oita-press.co.jp
Base Domain oita-press.co.jp
Scan Status Ok
Last Scan2024-09-19T00:38:17+00:00
Next Scan 2024-09-26T00:38:17+00:00

Last Scan

Scanned2024-09-19T00:38:17+00:00
URL https://www.oita-press.co.jp/robots.txt
Domain IPs 13.224.163.115, 13.224.163.127, 13.224.163.77, 13.224.163.87
Response IP 52.84.229.10
Found Yes
Hash 6a3ce1b8c74ebeb7b88090d3f9fcb9d3e6b7b93c801930d2860c97980a71c777
SimHash 301451706367

Groups

gptbot
chatgpt-user
google-extended
curl
admantx
ceeknewsbot
cincraw
dataforseobot
openindexspider
shiroyagicrawler
newspaper

Rule Path
Disallow /

*

Rule Path
Allow /