ayakatakeuchi.com
robots.txt
Robots Exclusion Standard data for ayakatakeuchi.com
Resource Scan
Scan Details
Site Domain | ayakatakeuchi.com |
Base Domain | ayakatakeuchi.com |
Scan Status | Ok |
Last Scan | 2025-05-30T05:53:02+00:00 |
Next Scan | 2025-06-13T05:53:02+00:00 |
Last Scan
Scanned | 2025-05-30T05:53:02+00:00 |
URL | https://ayakatakeuchi.com/robots.txt |
Domain IPs | 52.199.77.78 |
Response IP | 52.199.77.78 |
Found | Yes |
Hash | 04bb787799a3688f7e436730c0408b76cf72cdbbfb43dbaec2b2ba2a8441e22d |
SimHash | 700fc072c695 |
Groups
*
Rule | Path |
---|---|
Disallow | /embed/* |
Disallow | /intent/* |
Disallow | /preview/* |
Disallow | /api/* |
Disallow | /pdf/* |
Disallow | /wrap_up/* |
Disallow | /search |
Disallow | /login?* |
Disallow | /signup?* |
Disallow | /m/*/archive |
Disallow | /*/archives |
Disallow | /*/archives/* |
Disallow | /*/followers |
Disallow | /*/followings |
Disallow | /*/likes |
Disallow | /*/magazines |
Disallow | /*/menu/* |
Disallow | /*/message |
Disallow | /*/terms/specified |
googlebot
Rule | Path |
---|---|
Allow | /api/v3/notes/pagers |
Allow | /api/v3/notes/hashtags/*/notes |
Allow | /api/v3/notes/*/extra_items |
Allow | /api/v3/notes/*/related_notes |
Disallow | /api/v2/boards/*/reserved_posts |
Disallow | /api/v2/attachments |
Disallow | /*/rss |
Disallow | /intent/* |
twitterbot
Rule | Path |
---|---|
Disallow | /*/message |
Disallow | /*/terms/specified |
Disallow | /*/menu/* |
Disallow | /embed/* |
Disallow | /intent/* |
Disallow | /preview/* |
Disallow | /api/* |
Disallow | /pdf/* |
Allow | /wrap_up/* |
Other Records
Field | Value |
---|---|
sitemap | https://ayakatakeuchi.com/sitemaps/production/ayakatakeuchi.com/sitemap.xml.gz |
Comments