habanews.net
robots.txt

Robots Exclusion Standard data for habanews.net

Resource Scan

Scan Details

Site Domain habanews.net
Base Domain habanews.net
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-02-25T00:20:24+00:00
Next Scan 2025-05-26T00:20:24+00:00

Last Successful Scan

Scanned2024-07-08T00:12:02+00:00
URL https://habanews.net/robots.txt
Redirect https://cyclingbase.com/robots.txt
Redirect Domain cyclingbase.com
Redirect Base cyclingbase.com
Domain IPs 104.21.73.11, 172.67.136.235, 2606:4700:3032::ac43:88eb, 2606:4700:3033::6815:490b
Redirect IPs 104.21.28.79, 172.67.144.228, 2606:4700:3031::ac43:90e4, 2606:4700:3035::6815:1c4f
Response IP 104.21.28.79
Found Yes
Hash 620170fa99a4c24852ef114c36589a6647c0514f2064d6c78c8142d534462439
SimHash 6541d040cfd3

Groups

*

Rule Path
Disallow
Disallow /cgi-bin/

Other Records

Field Value
sitemap https://sukseshaba.wiki/sitemap.xml

Warnings

  • 1 invalid line.