twipla.jp
robots.txt

Robots Exclusion Standard data for twipla.jp

Resource Scan

Scan Details

Site Domain twipla.jp
Base Domain twipla.jp
Scan Status Ok
Last Scan2024-11-14T19:21:35+00:00
Next Scan 2024-11-21T19:21:35+00:00

Last Scan

Scanned2024-11-14T19:21:35+00:00
URL https://twipla.jp/robots.txt
Domain IPs 160.16.51.160
Response IP 160.16.51.160
Found Yes
Hash 501dc837950b406d9cef36435399167dece07863969a2be6cc8c2db392048a83
SimHash 4140db74c231

Groups

mediapartners-google

Rule Path
Disallow
Disallow /accounts/twitter_callback

adsbot-google

Rule Path
Disallow
Disallow /accounts/twitter_callback

*

Rule Path
Disallow /events/printlist/
Disallow /accounts/
Disallow /accounts/twitter_callback
Disallow /events/all/users
Disallow /events/*?comment

twitterbot

Rule Path
Disallow
Disallow /accounts/twitter_callback
Allow /users/

ezooms

Rule Path
Disallow /

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20