sloth-dev.com
robots.txt
Robots Exclusion Standard data for sloth-dev.com
Resource Scan
Scan Details
| Site Domain | sloth-dev.com |
| Base Domain | sloth-dev.com |
| Scan Status | Ok |
| Last Scan | 2025-10-04T01:04:18+00:00 |
| Next Scan | 2025-11-03T01:04:18+00:00 |
Last Scan
| Scanned | 2025-10-04T01:04:18+00:00 |
| URL | https://sloth-dev.com/robots.txt |
| Domain IPs | 104.21.35.211, 172.67.179.225, 2606:4700:3037::6815:23d3, 2606:4700:3037::ac43:b3e1 |
| Response IP | 104.21.35.211 |
| Found | Yes |
| Hash | 5af3238578748213701817284a7d134fdf541a6f17d9590c3924f8ac5edc9d43 |
| SimHash | 462cec474691 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*route%3Daccount/ |
| Disallow | /*route%3Daffiliate/ |
| Disallow | /*route%3Dcheckout/ |
| Disallow | /*route%3Dproduct/search |
| Disallow | /*route%3Dproduct/product/review |
| Disallow | /admin/ |
| Disallow | /catalog/ |
| Disallow | /system/ |
| Disallow | /*?sort= |
| Disallow | /*%26sort%3D |
| Disallow | /*?order= |
| Disallow | /*%26order%3D |
| Disallow | /*?limit= |
| Disallow | /*%26limit%3D |
| Disallow | /*?filter= |
| Disallow | /*%26filter%3D |
| Disallow | /*?filter_name= |
| Disallow | /*%26filter_name%3D |
| Disallow | /*?filter_sub_category= |
| Disallow | /*%26filter_sub_category%3D |
| Disallow | /*?filter_description= |
| Disallow | /*%26filter_description%3D |
| Disallow | /*?tracking= |
| Disallow | /*%26tracking%3D |
| Disallow | /*?tag= |
| Disallow | /*%26tag%3D |
| Disallow | /*?journal_blog_tag= |
| Disallow | /*%26journal_blog_tag%3D |
| Disallow | /*?page= |
| Disallow | /*%26page%3D |
| Disallow | /*agree%26 |
| Allow | /catalog- |
| Allow | /catalog/view/javascript/ |
| Allow | /catalog/view/theme/*/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://sloth-dev.com/sitemap.xml |
Warnings
- `host` is not a known field.
Comments