matt.scharley.me
robots.txt
Robots Exclusion Standard data for matt.scharley.me
Resource Scan
Scan Details
Site Domain | matt.scharley.me |
Base Domain | scharley.me |
Scan Status | Ok |
Last Scan | 2025-08-11T09:37:29+00:00 |
Next Scan | 2025-09-10T09:37:29+00:00 |
Last Scan
Scanned | 2025-08-11T09:37:29+00:00 |
URL | https://matt.scharley.me/robots.txt |
Domain IPs | 13.33.45.109, 13.33.45.20, 13.33.45.44, 13.33.45.77 |
Response IP | 13.33.45.44 |
Found | Yes |
Hash | d3e3f64559a0024c0e0d8d92e93f6659c6615ff25a09347b32274b91231eb979 |
SimHash | 5914cf414777 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /portfolio/* |
Disallow | /links/* |
Disallow | /core/pages/view/contact |