dictionary.com
robots.txt
Robots Exclusion Standard data for dictionary.com
Resource Scan
Scan Details
| Site Domain | dictionary.com |
| Base Domain | dictionary.com |
| Scan Status | Ok |
| Last Scan | 2024-06-28T19:36:53+00:00 |
| Next Scan | 2024-07-05T19:36:53+00:00 |
Last Scan
| Scanned | 2024-06-28T19:36:53+00:00 |
| URL | https://dictionary.com/robots.txt |
| Redirect | https://www.dictionary.com/robots.txt |
| Redirect Domain | www.dictionary.com |
| Redirect Base | dictionary.com |
| Domain IPs | 151.101.130.133, 151.101.194.133, 151.101.2.133, 151.101.66.133, 2a04:4e42:200::645, 2a04:4e42:400::645, 2a04:4e42:600::645, 2a04:4e42::645 |
| Redirect IPs | 151.101.130.133, 151.101.194.133, 151.101.2.133, 151.101.66.133, 2a04:4e42:200::645, 2a04:4e42:400::645, 2a04:4e42:600::645, 2a04:4e42::645 |
| Response IP | 199.232.46.133 |
| Found | Yes |
| Hash | d1161259a481afac180f3bf73a7052ddd5bc5ff9e8d289b5951dd85be8e94d4b |
| SimHash | 2b479870c332 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /5480.iac. |
| Disallow | /go/ |
| Disallow | /audio.html/ |
| Disallow | /houseads/ |
| Disallow | /askhome/ |
| Disallow | /23219321/iac. |
| Disallow | /*%2C* |
| Disallow | /browse-2/ |
| Allow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.dictionary.com/sitemap-dict-index.xml |
| sitemap | https://www.dictionary.com/e/sitemap_index.xml |
Comments