note.mu
robots.txt

Robots Exclusion Standard data for note.mu

Resource Scan

Scan Details

Site Domain note.mu
Base Domain note.mu
Scan Status Ok
Last Scan2024-10-28T15:45:42+00:00
Next Scan 2024-11-27T15:45:42+00:00

Last Scan

Scanned2024-10-28T15:45:42+00:00
URL https://note.mu/robots.txt
Redirect https://note.com/robots.txt
Redirect Domain note.com
Redirect Base note.com
Domain IPs 108.156.133.101, 108.156.133.114, 108.156.133.62, 108.156.133.8
Redirect IPs 3.165.102.119, 3.165.102.35, 3.165.102.50, 3.165.102.89
Response IP 3.165.102.119
Found Yes
Hash 69c3e4b43fe058c205574127d2c02119cc46df6f11bf0ba180bc6628b68b6d8d
SimHash 700fc072ce81

Groups

*

Rule Path
Disallow /embed/*
Disallow /intent/*
Disallow /preview/*
Disallow /api/*
Disallow /pdf/*
Disallow /wrap_up/*
Disallow /search
Disallow /login?*
Disallow /signup?*
Disallow /m/*/archive
Disallow /*/archives
Disallow /*/archives/*
Disallow /*/followers
Disallow /*/followings
Disallow /*/likes
Disallow /*/magazines
Disallow /*/menu/*
Disallow /*/message
Disallow /*/terms/specified

googlebot

Rule Path
Allow /api/v3/notes/pagers
Allow /api/v3/notes/hashtags/*/notes
Allow /api/v3/notes/*/extra_items
Allow /api/v3/notes/*/related_notes
Disallow /api/v2/boards/*/reserved_posts
Disallow /api/v2/attachments
Disallow /*/rss
Disallow /intent/*

twitterbot

Rule Path
Disallow /*/message
Disallow /*/terms/specified
Disallow /*/menu/*
Disallow /embed/*
Disallow /intent/*
Disallow /preview/*
Disallow /api/*
Disallow /pdf/*
Allow /wrap_up/*

bingbot

Rule Path
Disallow /*/message
Disallow /*/terms/specified
Disallow /*/menu/*
Disallow /embed/*
Disallow /intent/*
Disallow /preview/*
Disallow /api/*
Disallow /pdf/*
Disallow /wrap_up/*
Disallow /search

Other Records

Field Value
crawl-delay 30

livelapbot

Rule Path
Disallow /

yahoo pipes 1.0

Rule Path
Disallow /

megalodon

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

Other Records

Field Value
sitemap https://note.com/sitemaps/production/note.com/sitemap.xml.gz

Comments

  • /:urlname/~