mrhebert.org
robots.txt
Robots Exclusion Standard data for mrhebert.org
Resource Scan
Scan Details
Site Domain | mrhebert.org |
Base Domain | mrhebert.org |
Scan Status | Ok |
Last Scan | 2025-05-28T12:27:40+00:00 |
Next Scan | 2025-06-04T12:27:40+00:00 |
Last Scan
Scanned | 2025-05-28T12:27:40+00:00 |
URL | https://mrhebert.org/robots.txt |
Domain IPs | 104.21.78.246, 172.67.138.224, 2606:4700:3035::ac43:8ae0, 2606:4700:3037::6815:4ef6 |
Response IP | 172.67.138.224 |
Found | Yes |
Hash | 135d082a15d832d77adce9640f3273ca0c8f897cb64e8548c0e469af65841244 |
SimHash | 6f1088714fb2 |
Groups
*
Rule | Path |
---|---|
Disallow | /cgi-bin |
Disallow | /wp-admin/ |
Disallow | /? |
Disallow | *?s= |
Disallow | *%26s%3D |
Disallow | /search |
Disallow | /author/ |
Disallow | */xmlrpc.php |
Disallow | *utm*%3D |
Disallow | *openstat%3D |
Disallow | */embed |
Disallow | */page/ |
Allow | / |
Other Records
Field | Value |
---|---|
sitemap | https://Mrhebert.org/sitemap.xml |
Warnings
- `host` is not a known field.