towakomyu.com
robots.txt

Robots Exclusion Standard data for towakomyu.com

Resource Scan

Scan Details

Site Domain towakomyu.com
Base Domain towakomyu.com
Scan Status Ok
Last Scan2025-10-18T23:12:11+00:00
Next Scan 2025-10-25T23:12:11+00:00

Last Scan

Scanned2025-10-18T23:12:11+00:00
URL https://towakomyu.com/robots.txt
Domain IPs 104.26.0.47, 104.26.1.47, 172.67.69.197, 2606:4700:20::681a:12f, 2606:4700:20::681a:2f, 2606:4700:20::ac43:45c5
Response IP 104.26.0.47
Found Yes
Hash b5aa1592f93fa1ebce36535b060027f0e2fd368fee47c2458f7726d89079a459
SimHash 6160c556249b

Groups

*

Rule Path
Allow /category/
Allow /tag/
Allow /events/category/
Allow /events/tag/
Allow /tourist-spot/category/
Allow /tourist-spot/tag/
Allow /gourmet/category/
Allow /gourmet/tag/
Allow /feed/
Allow /tourist-spot/feed/
Allow /events/feed/
Allow /gourmet/feed/
Allow /wp-content/uploads/
Allow /wp-content/themes/
Allow /wp-content/plugins/
Allow /wp-admin/admin-ajax.php
Allow /wp-json/
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /cgi-bin/
Disallow /trackback/
Disallow /xmlrpc.php
Disallow /?s=
Disallow /?attachment_id=*
Disallow /comments/
Disallow /elementor/
Disallow /*.php$
Disallow /*?replytocom
Disallow /cdn-cgi/

googlebot-news

Rule Path
Disallow /category/
Disallow /tag/
Disallow /events/category/
Disallow /events/tag/
Disallow /tourist-spot/category/
Disallow /tourist-spot/tag/
Disallow /gourmet/category/
Disallow /gourmet/tag/
Allow /feed/
Allow /tourist-spot/feed/
Allow /events/feed/
Allow /gourmet/feed/

mediapartners-google

Rule Path
Disallow

Other Records

Field Value
sitemap https://towakomyu.com/sitemap_index.xml
sitemap https://towakomyu.com/news-sitemap.xml

Comments

  • クローラー全般のルール
  • 検索エンジンにカテゴリ・タグページを許可(SEO・Google News対応)
  • 投稿・カスタム投稿のフィードを許可(Google Discover対応)
  • レンダリング用リソースを許可(Elementor・最適化プラグイン対応)
  • セキュリティ・重複コンテンツ対策
  • Googleニュース専用クローラーの制御(カテゴリ・タグをブロック)
  • AdSenseクローラー(広告最適化のためフルアクセス許可)
  • サイトマップの場所を明示