fatahal.com
robots.txt

Robots Exclusion Standard data for fatahal.com

Resource Scan

Scan Details

Site Domain fatahal.com
Base Domain fatahal.com
Scan Status Ok
Last Scan2025-05-02T13:21:50+00:00
Next Scan 2025-05-09T13:21:50+00:00

Last Scan

Scanned2025-05-02T13:21:50+00:00
URL https://fatahal.com/robots.txt
Domain IPs 104.21.40.129, 172.67.151.240, 2606:4700:3031::6815:2881, 2606:4700:3031::ac43:97f0
Response IP 104.21.40.129
Found Yes
Hash c01c6c00a32ad21fc7adc5c8d6724f4c3a070f8f3cb475f7693e300d1485c1e6
SimHash 6734ba01e7ff

Groups

*

Rule Path
Disallow /login
Disallow /login?
Disallow /forgot
Disallow /register
Disallow /register?
Disallow /unanswered
Disallow /unanswered?by=upvotes&start=*
Disallow /chat
Disallow /plus
Disallow /redirect
Disallow /admin
Disallow /users
Disallow /user
Disallow /messages
Disallow /account
Disallow /search?q=

googlebot-image

Rule Path
Allow /*

criteobot/0.1
bingbot
msnbot
msnbot-media

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://fatahal.com/sitemap.xml

Comments

  • allow google image bot to search all images