smutba.se
robots.txt
Robots Exclusion Standard data for smutba.se
Resource Scan
Scan Details
| Site Domain | smutba.se |
| Base Domain | smutba.se |
| Scan Status | Ok |
| Last Scan | 2025-04-19T12:23:58+00:00 |
| Next Scan | 2025-04-26T12:23:58+00:00 |
Last Scan
| Scanned | 2025-04-19T12:23:58+00:00 |
| URL | https://smutba.se/robots.txt |
| Domain IPs | 2a01:7c8:e001:bd::cedd, 89.41.170.230 |
| Response IP | 89.41.170.230 |
| Found | Yes |
| Hash | 8b90fceffeab778dc85384926e84728fa8afda6d265c52e28cfc2012233571ad |
| SimHash | 401889f3a7b4 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /project/file/download/ |
| Disallow | /serve_file/ |
| Disallow | /media/cache/ |
| Disallow | /project/delete/ |
| Disallow | /tutorials/new/ |
| Disallow | /comments/ |
| Disallow | /static/CACHE/ |
| Disallow | /emoji/ |
| Disallow | /project/create/ |
| Disallow | /project/file/download |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |
Other Records
| Field | Value |
|---|---|
| sitemap | http://smutba.se/sitemap.xml |
Warnings
- `host` is not a known field.