iconscout.com
robots.txt
Robots Exclusion Standard data for iconscout.com
Resource Scan
Scan Details
| Site Domain | iconscout.com |
| Base Domain | iconscout.com |
| Scan Status | Ok |
| Last Scan | 2024-09-21T17:23:12+00:00 |
| Next Scan | 2024-09-28T17:23:12+00:00 |
Last Scan
| Scanned | 2024-09-21T17:23:12+00:00 |
| URL | https://iconscout.com/robots.txt |
| Domain IPs | 104.18.40.18, 172.64.147.238, 2606:4700:4400::6812:2812, 2606:4700:4400::ac40:93ee |
| Response IP | 172.64.147.238 |
| Found | Yes |
| Hash | 0cc49830676f83e883546fa5db0e3088f0c326827f7bf3b311696913ae330a41 |
| SimHash | 8910c220ce70 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /photo/ |
| Disallow | /photos/ |
| Disallow | /search |
| Disallow | /dashboard |
| Disallow | /upload |
| Disallow | /admin |
| Disallow | /purchase |
| Disallow | /checkout |
| Disallow | /blog/wp-admin/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://iconscout.com/sitemap/index.xml |
Warnings
- `host` is not a known field.