famu.jp
robots.txt

Robots Exclusion Standard data for famu.jp

Resource Scan

Scan Details

Site Domain famu.jp
Base Domain famu.jp
Scan Status Ok
Last Scan2024-10-06T03:12:53+00:00
Next Scan 2024-11-05T03:12:53+00:00

Last Scan

Scanned2024-10-06T03:12:53+00:00
URL https://famu.jp/robots.txt
Domain IPs 2406:da14:a12:fc02:b8c:b59b:5b93:c73, 2406:da14:a12:fc03:2148:f0dd:1296:d06b, 35.76.214.83, 35.79.66.218
Response IP 35.79.66.218
Found Yes
Hash 586e36e45b40e278e74d9772963edfab4f1e726935d11fa0a355e8fabb9137f3
SimHash f81ce5720792

Groups

baiduspider

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

yeti

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

*

Rule Path
Disallow /ageconfirm/
Disallow /apk/
Disallow /avatar/
Disallow /b/
Disallow /bbs/
Disallow /bbsmovie/
Disallow /blog/
Disallow /credit/
Disallow /data/
Disallow /deco/
Disallow /des/
Disallow /docomoemoji/
Disallow /ec/
Disallow /emoji/
Disallow /emojiall/
Disallow /event/
Disallow /get/
Disallow /hensin/
Disallow /hhh/
Disallow /hint/
Disallow /history/
Disallow /i/
Disallow /images/
Disallow /img/
Disallow /mail_backup/
Disallow /mgalleryimg/
Disallow /mmovsend/
Disallow /mshasend/
Disallow /oshiete/
Disallow /pinfo/
Disallow /prof/
Disallow /reas_src/
Disallow /reastest/
Disallow /res/
Disallow /search/
Disallow /shamail/
Disallow /spimg/
Disallow /t/
Disallow /template/
Disallow /top/
Disallow /tpimg
Disallow /tvphone/
Disallow /w/
Disallow /wbbsmovie/
Disallow /wgalleryimg/
Disallow /wjgalleryimg/
Disallow /wmovsend/
Disallow /wprofmovie/
Disallow /wshaimg/
Disallow /wshasend/
Disallow /wo/
Disallow /job/mobile/age.phtml
Allow /
Allow /index.phtml
Allow /pc
Allow /pub
Allow /job
Allow /moba8