top5guides.com
robots.txt
Robots Exclusion Standard data for top5guides.com
Resource Scan
Scan Details
Site Domain | top5guides.com |
Base Domain | top5guides.com |
Scan Status | Ok |
Last Scan | 2025-06-18T13:00:21+00:00 |
Next Scan | 2025-06-25T13:00:21+00:00 |
Last Scan
Scanned | 2025-06-18T13:00:21+00:00 |
URL | https://top5guides.com/robots.txt |
Domain IPs | 2a02:4780:3c:b347:3353:6e73:d7e1:2092, 2a02:4780:3d:d52f:ec4e:fe70:372b:fc2d, 77.37.83.43, 91.108.98.82 |
Response IP | 77.37.115.167 |
Found | Yes |
Hash | bd50c1503b60e63115521200846845ebf10539d8d164c98c96e9a409b33a891a |
SimHash | 7d24590a673e |
Groups
*
Rule | Path |
---|---|
Disallow | /cgi-bin/ |
Disallow | /wp-admin/ |
Disallow | /go/ |
Disallow | /search? |
Disallow | /?p=* |
Disallow | /tag/ |
Disallow | /author/ |
Disallow | /blog/page/* |
Disallow | /comments/feed/ |
Disallow | /trackback/ |
Disallow | /xmlrpc.php |
Disallow | /readme.html |
Allow | /wp-includes/js/ |
Allow | /wp-includes/css/ |
Allow | /wp-content/cache/minify/ |
Allow | /wp-admin/admin-ajax.php |
Warnings
- `https` is not a known field.