exfield.jp
robots.txt

Robots Exclusion Standard data for exfield.jp

Resource Scan

Scan Details

Site Domain exfield.jp
Base Domain exfield.jp
Scan Status Ok
Last Scan2025-05-29T02:35:13+00:00
Next Scan 2025-06-05T02:35:13+00:00

Last Scan

Scanned2025-05-29T02:35:13+00:00
URL https://exfield.jp/robots.txt
Domain IPs 133.242.144.163
Response IP 133.242.144.163
Found Yes
Hash 82aeb5f918207978c27b597643ebc9c51bd41de2f49c48b03da8660872860071
SimHash 0b348f756e93

Groups

googlebot

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

bingbot

Rule Path
Allow /

twitterbot

Rule Path
Allow /

advbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

nerdybot

Rule Path
Disallow /

sougou web spider

Rule Path
Disallow /

spider

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

smtbot

Rule Path
Disallow /

duckduckgo-favicons-bot

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

tweetmemebot

Rule Path
Disallow /

criteobot

Rule Path
Disallow /

nimbostratus-bot

Rule Path
Disallow /

surdotlybot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

df bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

*

Rule Path
Disallow /

Other Records

Field Value
sitemap https://exfield.jp/sitemap.xml
sitemap https://exfield.jp/wiki-sitemap.xml