azertag.az
robots.txt
Robots Exclusion Standard data for azertag.az
Resource Scan
Scan Details
Site Domain | azertag.az |
Base Domain | azertag.az |
Scan Status | Ok |
Last Scan | 2024-09-11T11:01:46+00:00 |
Next Scan | 2024-10-11T11:01:46+00:00 |
Last Scan
Scanned | 2024-09-11T11:01:46+00:00 |
URL | https://azertag.az/robots.txt |
Domain IPs | 104.26.0.198, 104.26.1.198, 172.67.74.32, 2606:4700:20::681a:1c6, 2606:4700:20::681a:c6, 2606:4700:20::ac43:4a20 |
Response IP | 172.67.74.32 |
Found | Yes |
Hash | 0d05a2e6bc98a5e4496004a4a9e138eb3434bef436e955888ecb6806f90d04d6 |
SimHash | 890a98108813 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /*/print/ |
Disallow | /print/ |
Disallow | /*/arxiv/ |
Disallow | /arxiv/ |
Disallow | /*/infografika/ |
Disallow | /infografika/ |
Other Records
Field | Value |
---|---|
sitemap | https://azertag.az/sitemap.xml |