baetiy.com
robots.txt

Robots Exclusion Standard data for baetiy.com

Resource Scan

Scan Details

Site Domain baetiy.com
Base Domain baetiy.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-11-22T19:27:04+00:00
Next Scan 2026-02-20T19:27:04+00:00

Last Successful Scan

Scanned2023-05-08T16:32:47+00:00
URL https://baetiy.com/robots.txt
Domain IPs 104.26.12.171, 104.26.13.171, 172.67.70.78, 2606:4700:20::681a:cab, 2606:4700:20::681a:dab, 2606:4700:20::ac43:464e
Response IP 172.67.70.78
Found Yes
Hash ee3ba3804496ccac71b63a91c00d9777aff57026954914e9e5591af8c92383c5
SimHash 651caa01e7ff

Groups

*

Rule Path
Disallow /login
Disallow /login?
Disallow /forgot
Disallow /register
Disallow /register?
Disallow /unanswered
Disallow /unanswered?by=upvotes&start=*
Disallow /chat
Disallow /plus
Disallow /nassri
Disallow /redirect
Disallow /admin
Disallow /categories
Disallow /users
Disallow /user
Disallow /messages
Disallow /account
Disallow /search?q=

googlebot-image

Rule Path
Allow /*

criteobot/0.1
bingbot
msnbot
msnbot-media

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://www.baetiy.com/sitemap.xml

Comments

  • allow google image bot to search all images