gia.org.az
robots.txt

Robots Exclusion Standard data for gia.org.az

Resource Scan

Scan Details

Site Domain gia.org.az
Base Domain gia.org.az
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-11-08T21:32:57+00:00
Next Scan 2026-02-06T21:32:57+00:00

Last Successful Scan

Scanned2024-06-24T08:32:26+00:00
URL https://gia.org.az/robots.txt
Domain IPs 104.21.28.82, 172.67.170.107, 2606:4700:3036::6815:1c52, 2606:4700:3036::ac43:aa6b
Response IP 104.21.28.82
Found Yes
Hash 2adf2ff84c58f0ce5a4cb3ed9d4f754465360e76a46315b2c38cc04198d9131f
SimHash fd09b0788131

Groups

*

Rule Path
Disallow /engine/go.php
Disallow /user/
Disallow /newposts/
Disallow /statistics.html
Disallow /*subaction%3Duserinfo
Disallow /*subaction%3Dnewposts
Disallow /*do%3Dlastcomments
Disallow /*do%3Dfeedback
Disallow /*do%3Dregister
Disallow /*do%3Dlostpassword
Disallow /*do%3Daddnews
Disallow /*do%3Dstats
Disallow /*do%3Dpm
Disallow /*do%3Dsearch
Disallow /*do%3Ddownload
Disallow /*do%3Dgo