kojodan.jp
robots.txt

Robots Exclusion Standard data for kojodan.jp

Resource Scan

Scan Details

Site Domain kojodan.jp
Base Domain kojodan.jp
Scan Status Ok
Last Scan2024-09-24T17:10:27+00:00
Next Scan 2024-10-01T17:10:27+00:00

Last Scan

Scanned2024-09-24T17:10:27+00:00
URL https://kojodan.jp/robots.txt
Domain IPs 153.127.203.113
Response IP 153.127.203.113
Found Yes
Hash 8327e19186ef6180ca5c66887bafae678f198fc5377f383ad08ac82c7a13c095
SimHash 8a65c8866b72

Groups

*

Rule Path
Disallow /*.tpl$
Disallow /photoUpload/*
Disallow /photoEdit/*
Disallow /login*
Disallow /logout*
Disallow /setting*
Disallow /pw_reset*
Disallow /my*
Disallow /app/reset_photo.cgi*
Disallow /timeline*

dotbot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

siteexplorer

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

teoma

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

*

Rule Path
Disallow /blog/api/
Disallow /blog/draft/
Disallow /blog/preview

mediapartners-google

Rule Path
Disallow /blog/draft/
Disallow /blog/preview

*

Rule Path
Disallow /news/api/
Disallow /news/draft/
Disallow /news/preview

mediapartners-google

Rule Path
Disallow /news/draft/
Disallow /news/preview

Other Records

Field Value
sitemap http://kojodan.jp/sitemap_index.xml
sitemap https://kojodan.jp/blog/sitemap_index.xml
sitemap https://kojodan.jp/news/sitemap_index.xml

Comments

  • Hatena