magyarnarancs.hu
robots.txt
Robots Exclusion Standard data for magyarnarancs.hu
Resource Scan
Scan Details
Site Domain | magyarnarancs.hu |
Base Domain | magyarnarancs.hu |
Scan Status | Ok |
Last Scan | 2024-11-14T19:54:42+00:00 |
Next Scan | 2024-11-21T19:54:42+00:00 |
Last Scan
Scanned | 2024-11-14T19:54:42+00:00 |
URL | https://magyarnarancs.hu/robots.txt |
Domain IPs | 34.149.240.218 |
Response IP | 34.149.240.218 |
Found | Yes |
Hash | f7b5cbe9ddc201cf3f1ebec4f39d2c8561ec234f43e5440ecc28a37a89cc5d2e |
SimHash | 6905dc52eb91 |
Groups
*
Rule | Path |
---|---|
Disallow | /admin/ |
Disallow | /kereses |
Other Records
Field | Value |
---|---|
crawl-delay | 1 |
Other Records
Field | Value |
---|---|
sitemap | https://magyarnarancs.hu/sitemap.xml |