marbleski.org
robots.txt
Robots Exclusion Standard data for marbleski.org
Resource Scan
Scan Details
| Site Domain | marbleski.org |
| Base Domain | marbleski.org |
| Scan Status | Ok |
| Last Scan | 2026-01-21T23:33:16+00:00 |
| Next Scan | 2026-01-28T23:33:16+00:00 |
Last Scan
| Scanned | 2026-01-21T23:33:16+00:00 |
| URL | https://marbleski.org/robots.txt |
| Domain IPs | 192.185.39.240 |
| Response IP | 192.185.39.240 |
| Found | Yes |
| Hash | f0378c3d39b4b9e213659620188064dd9dbf43bbcb24c9be90691e6cd2601d48 |
| SimHash | 6b67f91b51d0 |
Groups
*
| Rule | Path | Comment |
|---|---|---|
| Disallow | /urchin/ | This is an infinite virtual URL space |
| Disallow | /stylesheets/ | these don't need to be visited |
| Disallow | /style_sheets/ | ditto |
| Disallow | /templates/ | ditto |
| Disallow | /privacy_policy.html | - |
| Disallow | /cgi-bin/ | - |
| Disallow | /wp-admin/ | - |
| Disallow | /wp-includes/ | - |
| Disallow | /wp-content/ | - |
| Disallow | /wptest | - |
| Disallow | /images-adswap/uploads/ | - |
| Disallow | /images-adswap/ | - |
| Disallow | /test.html | - |
| Disallow | /images/ | - |
| Disallow | */feed/* | - |
| Disallow | /passwords-list.html | - |
Comments