kojodan.jp
robots.txt

Robots Exclusion Standard data for kojodan.jp

Resource Scan

Scan Details

Site Domain kojodan.jp
Base Domain kojodan.jp
Scan Status Ok
Last Scan2024-10-29T18:35:16+00:00
Next Scan 2024-11-05T18:35:16+00:00

Last Scan

Scanned2024-10-29T18:35:16+00:00
URL https://kojodan.jp/robots.txt
Domain IPs 153.127.203.113
Response IP 153.127.203.113
Found Yes
Hash e1a029f54a366b6c0f4f36f1712c5273eac07feb43d4914ab6171abe87feebdb
SimHash 8a65c8866b32

Groups

*

Rule Path
Disallow /*.tpl$
Disallow /photoUpload/*
Disallow /photoEdit/*
Disallow /login*
Disallow /logout*
Disallow /setting*
Disallow /pw_reset*
Disallow /my*
Disallow /app/reset_photo.cgi*
Disallow /timeline*
Disallow /news?page=*
Disallow /blog?page=*

dotbot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

siteexplorer

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

teoma

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

*

Rule Path
Disallow /blog/api/
Disallow /blog/draft/
Disallow /blog/preview

mediapartners-google

Rule Path
Disallow /blog/draft/
Disallow /blog/preview

*

Rule Path
Disallow /news/api/
Disallow /news/draft/
Disallow /news/preview

mediapartners-google

Rule Path
Disallow /news/draft/
Disallow /news/preview

Other Records

Field Value
sitemap http://kojodan.jp/sitemap_index.xml
sitemap https://kojodan.jp/blog/sitemap_index.xml
sitemap https://kojodan.jp/news/sitemap_index.xml

Comments

  • Hatena