tibiacanob.com
robots.txt

Robots Exclusion Standard data for tibiacanob.com

Resource Scan

Scan Details

Site Domain tibiacanob.com
Base Domain tibiacanob.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-09T06:46:26+00:00
Next Scan 2024-12-08T06:46:26+00:00

Last Successful Scan

Scanned2023-01-23T04:31:47+00:00
URL https://tibiacanob.com/robots.txt
Domain IPs 149.56.25.53
Response IP 149.56.25.53
Found Yes
Hash 9499cea34d50842f7a87652335a5b3e114c2f37a3901ccf490a32cecf19b11bd
SimHash 10089d426621

Groups

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

yandex

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

*

Rule Path
Disallow /ajax/
Disallow /phpmailer/
Disallow /config/
Disallow /paypal/
Disallow /images/
Disallow /signatures/
Disallow /pot/
Disallow /cache/
Disallow /frameworks/
Allow /

Other Records

Field Value
crawl-delay 10

Comments

  • SEO-related bots