women.az
robots.txt
Robots Exclusion Standard data for women.az
Resource Scan
Scan Details
Site Domain | women.az |
Base Domain | women.az |
Scan Status | Ok |
Last Scan | 2024-06-19T22:05:20+00:00 |
Next Scan | 2024-06-26T22:05:20+00:00 |
Last Scan
Scanned | 2024-06-19T22:05:20+00:00 |
URL | https://women.az/robots.txt |
Domain IPs | 104.21.38.177, 172.67.137.28, 2606:4700:3030::6815:26b1, 2606:4700:3032::ac43:891c |
Response IP | 172.67.137.28 |
Found | Yes |
Hash | c1d832a22a2174774415d784d6b7cef19358cd5070be82640f3cf6cf0e42dd37 |
SimHash | 90444df04d91 |
Groups
*
Rule | Path |
---|---|
Disallow | /include/ |
Disallow | /module/ |
Disallow | /static/ |
Disallow | /theme/ |
Disallow | /file/ |