premium.oxforddictionaries.com
robots.txt
Robots Exclusion Standard data for premium.oxforddictionaries.com
Resource Scan
Scan Details
| Site Domain | premium.oxforddictionaries.com |
| Base Domain | oxforddictionaries.com |
| Scan Status | Ok |
| Last Scan | 2024-11-03T11:05:40+00:00 |
| Next Scan | 2024-12-03T11:05:40+00:00 |
Last Scan
| Scanned | 2024-11-03T11:05:40+00:00 |
| URL | https://premium.oxforddictionaries.com/robots.txt |
| Domain IPs | 52.202.54.216 |
| Response IP | 52.202.54.216 |
| Found | Yes |
| Hash | 29dc945b576a292ce2e8e3017f418be30540adbb7b688dd95b3f4c1076f42b95 |
| SimHash | e97b5e70eddd |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /us/onelook_american_dictionary_words.html |
| Disallow | /us/words/guotd |
| Disallow | /spellcheck/ |
| Disallow | /us/spellcheck/ |
| Disallow | /de/spellcheck/ |
| Disallow | /es/spellcheck/ |
| Disallow | /fr/spellcheck/ |
| Disallow | /it/spellcheck/ |
| Disallow | /ms/spellcheck/ |
| Disallow | /pt/verifica%C3%A7%C3%A3o_ortogr%C3%A1fica/ |
| Disallow | /zh/spellcheck/ |
| Disallow | /ru/%D0%BF%D1%80%D0%BE%D0%B2%D0%B5%D1%80%D0%BA%D0%B0_%D0%BE%D1%80%D1%84%D0%BE%D0%B3%D1%80%D0%B0%D1%84%D0%B8%D0%B8/ |
| Disallow | /search/ |
| Disallow | /us/search/ |
| Disallow | /de/suche/ |
| Disallow | /es/buscar/ |
| Disallow | /fr/chercher/ |
| Disallow | /it/cerca/ |
| Disallow | /ms/carian/ |
| Disallow | /pt/pesquisa/ |
| Disallow | /zh/%E6%90%9C%E7%B4%A2/ |
| Disallow | /ru/%D0%BF%D0%BE%D0%B8%D1%81%D0%BA/ |
| Disallow | /autocomplete/ |
| Disallow | /us/autocomplete/ |
| Disallow | /de/autocomplete/ |
| Disallow | /es/autocomplete/ |
| Disallow | /fr/autocomplete/ |
| Disallow | /it/autocomplete/ |
| Disallow | /ms/autocomplete/ |
| Disallow | /pt/autocomplete/ |
| Disallow | /zh/autocomplete/ |
| Disallow | /ru/autocomplete/ |
slurp
| Rule | Path |
|---|---|
| Disallow | /us/onelook_american_dictionary_words.html |
| Disallow | /us/words/guotd |
| Disallow | /spellcheck/ |
| Disallow | /us/spellcheck/ |
| Disallow | /de/spellcheck/ |
| Disallow | /es/spellcheck/ |
| Disallow | /fr/spellcheck/ |
| Disallow | /it/spellcheck/ |
| Disallow | /ms/spellcheck/ |
| Disallow | /pt/verifica%C3%A7%C3%A3o_ortogr%C3%A1fica/ |
| Disallow | /zh/spellcheck/ |
| Disallow | /ru/%D0%BF%D1%80%D0%BE%D0%B2%D0%B5%D1%80%D0%BA%D0%B0_%D0%BE%D1%80%D1%84%D0%BE%D0%B3%D1%80%D0%B0%D1%84%D0%B8%D0%B8/ |
| Disallow | /search/ |
| Disallow | /us/search/ |
| Disallow | /de/suche/ |
| Disallow | /es/buscar/ |
| Disallow | /fr/chercher/ |
| Disallow | /it/cerca/ |
| Disallow | /ms/carian/ |
| Disallow | /pt/pesquisa/ |
| Disallow | /zh/%E6%90%9C%E7%B4%A2/ |
| Disallow | /ru/%D0%BF%D0%BE%D0%B8%D1%81%D0%BA/ |
| Disallow | /autocomplete/ |
| Disallow | /us/autocomplete/ |
| Disallow | /de/autocomplete/ |
| Disallow | /es/autocomplete/ |
| Disallow | /fr/autocomplete/ |
| Disallow | /it/autocomplete/ |
| Disallow | /ms/autocomplete/ |
| Disallow | /pt/autocomplete/ |
| Disallow | /zh/autocomplete/ |
| Disallow | /ru/autocomplete/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://premium.oxforddictionaries.com/sitemap.xml |
| sitemap | https://premium.oxforddictionaries.com/sitemap.xml |