sakamoto.blog
robots.txt

Robots Exclusion Standard data for sakamoto.blog

Resource Scan

Scan Details

Site Domain sakamoto.blog
Base Domain sakamoto.blog
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-07-29T11:47:22+00:00
Next Scan 2024-10-27T11:47:22+00:00

Last Successful Scan

Scanned2024-04-01T11:20:04+00:00
URL https://sakamoto.blog/robots.txt
Redirect https://www.sakamoto.blog/robots.txt
Redirect Domain www.sakamoto.blog
Redirect Base sakamoto.blog
Domain IPs 104.21.10.213, 172.67.164.136
Redirect IPs 104.21.10.213, 172.67.164.136
Response IP 172.67.164.136
Found Yes
Hash 8efc2a02ef0709eb225033e0ab4bd3a8fa95b0a203b54aca3e4c955220c1392c
SimHash 4630da1ef7a5

Groups

googlebot

Rule Path
Allow /?s=*
Allow /search/

petalbot
baiduspider
mj12bot
archive.org_bot

Rule Path
Disallow /
Disallow /?s=*
Disallow /*/?s=*%5C
Disallow /search_gcse/
Disallow /search/

*

Rule Path
Disallow /wp-admin/
Disallow /client-portal/
Disallow /wp-content/
Disallow /wp-includes/
Disallow /?s=*
Disallow /*/?s=*%5C
Disallow /search_gcse/
Disallow /search/
Disallow /xmlrpc.php*
Disallow /wp-includes/
Disallow /cgi-bin*
Disallow */feed*
Disallow /public_html*
Disallow /trackback/
Disallow /*?replytocom=*
Disallow /*/comment-page*
Allow /wp-admin/admin-ajax.php
Allow /wp-content/uploads/
Allow /*?utm_medium=*
Allow *.js*
Allow *.css*
Allow *.ajax*
Allow *.ttf*
Allow *.woff*
Allow *.woff2*
Allow /wp-content/*.js*
Allow /wp-content/*.css*
Allow /wp-content/*.ajax*
Allow /wp-content/*.ttf*
Allow /wp-content/*.woff*
Allow /wp-content/*.woff2*
Allow /wp-includes/*.js*
Allow /wp-includes/*.css*
Allow /wp-includes/*.ajax*
Allow /wp-includes/*.ttf*
Allow /wp-includes/*.woff*
Allow /wp-includes/*.woff2*
Allow /wp-content/plugins/*.css*
Allow /wp-content/plugins/*.js*
Allow /wp-content/plugins/*.ajax*
Allow /wp-content/plugins/*.ttf*
Allow /wp-content/plugins/*.woff*
Allow /wp-content/plugins/*.woff2*
Allow /wp-content/themes/*.css*
Allow /wp-content/themes/*.js*
Allow /wp-content/themes/*.ajax*
Allow /wp-content/themes/*.ttf*
Allow /wp-content/themes/*.woff*
Allow /wp-content/themes/*.woff2*

Other Records

Field Value
sitemap https://www.sakamoto.blog/sitemap.xml
sitemap https://www.sakamoto.blog/sitemap-post-type-post.xml
sitemap https://www.sakamoto.blog/sitemap-post-type-page.xml
sitemap https://www.sakamoto.blog/sitemap-taxonomy-category.xml
sitemap https://www.sakamoto.blog/sitemap-taxonomy-post_tag.xml

Comments

  • This virtual robots.txt file was created by the Virtual Robots.txt WordPress plugin: https://www.wordpress.org/plugins/pc-robotstxt/
  • User-agent: Googlebot
  • User-agent: Googlebot-Image
  • User-agent: Googlebot-Mobile
  • User-agent: Googlebot-News
  • User-agent: Googlebot-Video
  • User-agent: Bingbot
  • User-agent: slurp
  • User-agent: Adsbot-Google
  • User-agent: AdIdxBot
  • User-agent: Facebot

Warnings

  • 1 invalid line.