hang.hu
robots.txt
Robots Exclusion Standard data for hang.hu
Resource Scan
Scan Details
Site Domain | hang.hu |
Base Domain | hang.hu |
Scan Status | Ok |
Last Scan | 2024-05-29T04:55:35+00:00 |
Next Scan | 2024-06-05T04:55:35+00:00 |
Last Scan
Scanned | 2024-05-29T04:55:35+00:00 |
URL | https://hang.hu/robots.txt |
Domain IPs | 104.18.20.71, 104.18.21.71, 2606:4700::6812:1447, 2606:4700::6812:1547 |
Response IP | 104.18.20.71 |
Found | Yes |
Hash | 13dbe80622763cc97c7bcd457b8c9ae61d6cfb9b6003dae227b4586014f70118 |
SimHash | 6905dc56ef90 |
Groups
*
Rule | Path |
---|---|
Disallow | /admin/ |
Disallow | /kereses |
Other Records
Field | Value |
---|---|
crawl-delay | 1 |
Other Records
Field | Value |
---|---|
sitemap | https://hang.hu/sitemap.xml |