bl90.com
robots.txt

Robots Exclusion Standard data for bl90.com

Resource Scan

Scan Details

Site Domain bl90.com
Base Domain bl90.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-08-19T18:01:58+00:00
Next Scan 2025-11-17T18:01:58+00:00

Last Successful Scan

Scanned2024-04-04T10:46:37+00:00
URL https://www.bl90.com/robots.txt
Domain IPs 113.219.142.41
Response IP 113.219.142.41
Found Yes
Hash 3e6aa8be8602d094e7f7ab60032041c4cab2cddf0e1daaadddb8c4365219223d
SimHash 821e99e0ae39

Groups

*

Rule Path
Disallow /index.php?*
Disallow /index/
Disallow /public
Disallow /goto
Disallow /img
Disallow /note

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /