hobbit.blog
robots.txt

Robots Exclusion Standard data for hobbit.blog

Resource Scan

Scan Details

Site Domain hobbit.blog
Base Domain hobbit.blog
Scan Status Ok
Last Scan2025-11-18T04:52:51+00:00
Next Scan 2025-11-25T04:52:51+00:00

Last Scan

Scanned2025-11-18T04:52:51+00:00
URL https://hobbit.blog/robots.txt
Domain IPs 104.21.43.78, 172.67.222.236, 2606:4700:3030::ac43:deec, 2606:4700:3034::6815:2b4e
Response IP 104.21.43.78
Found Yes
Hash f9cd8179e6180f1d379db7f4bac741e724ff81be90c1b52a877abd749e22e2a7
SimHash 6b714fc2c413

Groups

mediapartners-google

Rule Path
Allow /

mediapartners-google*

Rule Path
Allow /

googlebot-image

Rule Path
Allow /wp-content/uploads/

adsbot-google

Rule Path
Allow /

facebookexternalhit

Rule Path
Allow /

*

Rule Path
Disallow /preview%3Dtrue
Disallow /cgi-bin/
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wp-content/languages/
Disallow /wp-content/plugins/
Disallow /wp-content/themes/
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow /feed/
Disallow /?ref=
Disallow /?s=
Disallow /search/
Disallow /*?
Disallow /*%E2%9C%94*
Disallow /*%25E2%259C%2594*

Other Records

Field Value
sitemap /sitemap.xml