azad.az
robots.txt
Robots Exclusion Standard data for azad.az
Resource Scan
Scan Details
Site Domain | azad.az |
Base Domain | azad.az |
Scan Status | Ok |
Last Scan | 2024-05-28T04:05:40+00:00 |
Next Scan | 2024-06-27T04:05:40+00:00 |
Last Scan
Scanned | 2024-05-28T04:05:40+00:00 |
URL | https://azad.az/robots.txt |
Domain IPs | 104.21.13.133, 172.67.132.215, 2606:4700:3031::6815:d85, 2606:4700:3035::ac43:84d7 |
Response IP | 104.21.13.133 |
Found | Yes |
Hash | 24184993037f5a07fb4c3ed2de4096430d7a8eea9ebbf1f5dc6a1a6412d790fe |
SimHash | fd0db1780133 |
Groups
*
Rule | Path |
---|---|
Disallow | /engine/go.php |
Disallow | /user/ |
Disallow | /newposts/ |
Disallow | /statistics.html |
Disallow | /*subaction%3Duserinfo |
Disallow | /*subaction%3Dnewposts |
Disallow | /*do%3Dlastcomments |
Disallow | /*do%3Dfeedback |
Disallow | /*do%3Dregister |
Disallow | /*do%3Dlostpassword |
Disallow | /*do%3Daddnews |
Disallow | /*do%3Dstats |
Disallow | /*do%3Dpm |