bayobaka.yokohama
robots.txt

Robots Exclusion Standard data for bayobaka.yokohama

Resource Scan

Scan Details

Site Domain bayobaka.yokohama
Base Domain bayobaka.yokohama
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-09-19T20:53:32+00:00
Next Scan 2025-12-18T20:53:32+00:00

Last Successful Scan

Scanned2025-05-23T06:09:08+00:00
URL http://bayobaka.yokohama/robots.txt
Domain IPs 132.226.15.29
Response IP 132.226.15.29
Found Yes
Hash 93ac0039843263aacc6311eea146a466378a70f7dba554d776bdf5b5db1602a0
SimHash 235d5040f178

Groups

*

Rule Path
Disallow /tag/
Disallow /upload/
Disallow /search

bingbot

Rule Path
Disallow /archives/
Disallow /upload/
Disallow /tag/
Disallow /comment
Disallow /list_comments/
Disallow /post_comment/

Other Records

Field Value
crawl-delay 60

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

gptbot

Rule Path
Disallow /

applebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

criteobot/0.1

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

y!j-asr/0.1 crawler

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

seokicks-robot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

hypefactors

Rule Path
Disallow /

linespider

Rule Path
Disallow /archives/
Disallow /upload/
Disallow /comment

googlebot

Rule Path
Disallow /archives/
Disallow /upload/
Disallow /tag/
Disallow /comment
Disallow /list_comments/
Disallow /post_comment/