blog.hu
robots.txt
Robots Exclusion Standard data for blog.hu
Resource Scan
Scan Details
Site Domain | blog.hu |
Base Domain | blog.hu |
Scan Status | Ok |
Last Scan | 2024-05-23T03:43:45+00:00 |
Next Scan | 2024-05-30T03:43:45+00:00 |
Last Scan
Scanned | 2024-05-23T03:43:45+00:00 |
URL | https://blog.hu/robots.txt |
Domain IPs | 213.181.199.48, 213.181.199.49, 213.181.199.50, 213.181.199.51 |
Response IP | 213.181.199.50 |
Found | Yes |
Hash | 6aaa6373a7a55bd79d63f2eeb91563860f61c397b07d5436a4b47fac2b21f42b |
SimHash | a8062811c093 |
Groups
*
Rule | Path |
---|---|
Disallow | /admin/ |
Disallow | /common/indapassheader |
Disallow | /ad/index |
Disallow | /admin.php |
Disallow | /administrator |
Disallow | /api/zend |
Disallow | /reader |
Other Records
Field | Value |
---|---|
sitemap | https://blog.hu/sitemap_static.xml |
sitemap | https://blog.hu/users.xml |
sitemap | https://blog.hu/blogs.xml |
sitemap | https://blog.hu/rss/all |
sitemap | https://blog.hu/rss |
Warnings
- `noindex` is not a known field.