btk.az
robots.txt

Robots Exclusion Standard data for btk.az

Resource Scan

Scan Details

Site Domain btk.az
Base Domain btk.az
Scan Status Ok
Last Scan2025-11-23T09:56:53+00:00
Next Scan 2025-12-23T09:56:53+00:00

Last Scan

Scanned2025-11-23T09:56:53+00:00
URL https://btk.az/robots.txt
Domain IPs 104.21.85.171, 172.67.208.134, 2606:4700:3032::ac43:d086, 2606:4700:3037::6815:55ab
Response IP 172.67.208.134
Found Yes
Hash ca6a91f4d368bc7ff854c686bcad4810e2a73dbd85ae64f6bf8e5cbdcdede344
SimHash fd09b0788131

Groups

*

Rule Path
Disallow /engine/go.php
Disallow /user/
Disallow /newposts/
Disallow /statistics.html
Disallow /*subaction%3Duserinfo
Disallow /*subaction%3Dnewposts
Disallow /*do%3Dlastcomments
Disallow /*do%3Dfeedback
Disallow /*do%3Dregister
Disallow /*do%3Dlostpassword
Disallow /*do%3Daddnews
Disallow /*do%3Dstats
Disallow /*do%3Dpm
Disallow /*do%3Dsearch
Disallow /*do%3Ddownload
Disallow /*do%3Dgo