dobiho.com
robots.txt

Robots Exclusion Standard data for dobiho.com

Resource Scan

Scan Details

Site Domain dobiho.com
Base Domain dobiho.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-09-20T00:34:12+00:00
Next Scan 2025-10-20T00:34:12+00:00

Last Successful Scan

Scanned2025-08-21T20:13:30+00:00
URL https://dobiho.com/robots.txt
Domain IPs 3.38.80.101
Response IP 3.38.80.101
Found Yes
Hash 0cafdba75656c3b7a55b29ecbd6cd55800c2156f7ac5c4308c77120873862ebc
SimHash 6111d686c281

Groups

*

Rule Path
Disallow /

yeti

Rule Path
Allow /
Disallow /?s=

Other Records

Field Value
crawl-delay 15

googlebot

Rule Path
Allow /
Disallow /?s=

Other Records

Field Value
crawl-delay 15

googlebot-image

Rule Path
Allow /
Disallow /?s=

Other Records

Field Value
crawl-delay 15

googlebot-mobile

Rule Path
Allow /
Disallow /?s=

Other Records

Field Value
crawl-delay 15

adsbot-google

Rule Path
Allow /
Disallow /?s=

Other Records

Field Value
crawl-delay 15

adsbot-google-mobile

Rule Path
Allow /
Disallow /?s=

Other Records

Field Value
crawl-delay 15

mediapartners-google

Rule Path
Allow /
Disallow /?s=

Other Records

Field Value
crawl-delay 15

google-display-ads-bot

Rule Path
Allow /
Disallow /?s=

Other Records

Field Value
crawl-delay 15

daum

Rule Path
Allow /
Disallow /?s=

Other Records

Field Value
crawl-delay 15

slurp

Rule Path
Allow /
Disallow /?s=

Other Records

Field Value
crawl-delay 15

bingbot

Rule Path
Allow /
Disallow /?s=

Other Records

Field Value
crawl-delay 15

facebookexternalhit

Rule Path
Allow /
Disallow /?s=

Other Records

Field Value
crawl-delay 15

applebot

Rule Path
Allow /
Disallow /?s=

Other Records

Field Value
crawl-delay 15

oai-searchbot

Rule Path
Allow /
Disallow /?s=

Other Records

Field Value
crawl-delay 15

perplexitybot

Rule Path
Allow /
Disallow /?s=

Other Records

Field Value
crawl-delay 15

claude-searchbot

Rule Path
Allow /
Disallow /?s=

Other Records

Field Value
crawl-delay 15

Other Records

Field Value
sitemap https://dobiho.com/sitemap_index.xml

Comments

  • DaumWebMasterTool:d52929a4a8a226a089e547cad9ee7a69990b1bd3d041f49c6ccb5711763befd2:wzB2i9tmJ9MPr//bmHaXIw==