collinsdictionary.com
robots.txt
Robots Exclusion Standard data for collinsdictionary.com
Resource Scan
Scan Details
| Site Domain | collinsdictionary.com |
| Base Domain | collinsdictionary.com |
| Scan Status | Ok |
| Last Scan | 2025-05-24T01:46:29+00:00 |
| Next Scan | 2025-05-31T01:46:29+00:00 |
Last Scan
| Scanned | 2025-05-24T01:46:29+00:00 |
| URL | https://collinsdictionary.com/robots.txt |
| Redirect | https://www.collinsdictionary.com/robots.txt |
| Redirect Domain | www.collinsdictionary.com |
| Redirect Base | collinsdictionary.com |
| Domain IPs | 104.18.12.203, 104.18.13.203, 2606:4700::6812:ccb, 2606:4700::6812:dcb |
| Redirect IPs | 104.18.12.203, 104.18.13.203, 2606:4700::6812:ccb, 2606:4700::6812:dcb |
| Response IP | 104.18.12.203 |
| Found | Yes |
| Hash | a855f1f0c825c6db407a44267d23d1ca5a576b775dd9a7e75943e93798743e02 |
| SimHash | 201a9610a5bf |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /submission/search/ |
| Disallow | /search/ |
| Disallow | /spellcheck/ |
| Disallow | /autocomplete/ |
| Disallow | /login |
| Disallow | /us/submission/search/ |
| Disallow | /us/search/ |
| Disallow | /us/spellcheck/ |
| Disallow | /us/autocomplete/ |
| Disallow | /us/login |
| Disallow | /de/submission/suche/ |
| Disallow | /de/suche/ |
| Disallow | /de/rechtschreibpr%C3%BCfung/ |
| Disallow | /de/autocomplete/ |
| Disallow | /de/login |
| Disallow | /es/submission/buscar/ |
| Disallow | /es/buscar/ |
| Disallow | /es/corrector-ortografico/ |
| Disallow | /es/autocomplete/ |
| Disallow | /es/login |
| Disallow | /it/submission/ricerca/ |
| Disallow | /it/ricerca/ |
| Disallow | /it/correttore/ |
| Disallow | /it/autocomplete/ |
| Disallow | /it/login |
| Disallow | /pt/submission/search/ |
| Disallow | /pt/search/ |
| Disallow | /pt/spellcheck/ |
| Disallow | /pt/autocomplete/ |
| Disallow | /pt/login |
| Disallow | /hi/submission/search/ |
| Disallow | /hi/search/ |
| Disallow | /hi/spellcheck/ |
| Disallow | /hi/autocomplete/ |
| Disallow | /hi/login |
| Disallow | /ko/submission/search/ |
| Disallow | /ko/search/ |
| Disallow | /ko/spellcheck/ |
| Disallow | /ko/autocomplete/ |
| Disallow | /ko/login |
| Disallow | /jp/submission/search/ |
| Disallow | /jp/search/ |
| Disallow | /jp/spellcheck/ |
| Disallow | /jp/autocomplete/ |
| Disallow | /jp/login |
| Disallow | /zh/submission/search/ |
| Disallow | /zh/search/ |
| Disallow | /zh/spellcheck/ |
| Disallow | /zh/autocomplete/ |
| Disallow | /zh/login |
bingbot
msnbot
slurp
facebookbot
| Rule | Path |
|---|---|
| Disallow | /submission/search/ |
| Disallow | /search/ |
| Disallow | /spellcheck/ |
| Disallow | /autocomplete/ |
| Disallow | /login |
| Disallow | /us/submission/search/ |
| Disallow | /us/search/ |
| Disallow | /us/spellcheck/ |
| Disallow | /us/autocomplete/ |
| Disallow | /us/login |
| Disallow | /de/submission/suche/ |
| Disallow | /de/suche/ |
| Disallow | /de/rechtschreibpr%C3%BCfung/ |
| Disallow | /de/autocomplete/ |
| Disallow | /de/login |
| Disallow | /es/submission/buscar/ |
| Disallow | /es/buscar/ |
| Disallow | /es/corrector-ortografico/ |
| Disallow | /es/autocomplete/ |
| Disallow | /es/login |
| Disallow | /it/submission/ricerca/ |
| Disallow | /it/ricerca/ |
| Disallow | /it/correttore/ |
| Disallow | /it/autocomplete/ |
| Disallow | /it/login |
| Disallow | /pt/submission/search/ |
| Disallow | /pt/search/ |
| Disallow | /pt/spellcheck/ |
| Disallow | /pt/autocomplete/ |
| Disallow | /pt/login |
| Disallow | /hi/submission/search/ |
| Disallow | /hi/search/ |
| Disallow | /hi/spellcheck/ |
| Disallow | /hi/autocomplete/ |
| Disallow | /hi/login |
| Disallow | /ko/submission/search/ |
| Disallow | /ko/search/ |
| Disallow | /ko/spellcheck/ |
| Disallow | /ko/autocomplete/ |
| Disallow | /ko/login |
| Disallow | /jp/submission/search/ |
| Disallow | /jp/search/ |
| Disallow | /jp/spellcheck/ |
| Disallow | /jp/autocomplete/ |
| Disallow | /jp/login |
| Disallow | /zh/submission/search/ |
| Disallow | /zh/search/ |
| Disallow | /zh/spellcheck/ |
| Disallow | /zh/autocomplete/ |
| Disallow | /zh/login |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
verity/1.1
| Rule | Path |
|---|---|
| Disallow | /submission/search/ |
| Disallow | /search/ |
| Disallow | /spellcheck/ |
| Disallow | /autocomplete/ |
| Disallow | /login |
| Disallow | /us/submission/search/ |
| Disallow | /us/search/ |
| Disallow | /us/spellcheck/ |
| Disallow | /us/autocomplete/ |
| Disallow | /us/login |
| Disallow | /de/submission/suche/ |
| Disallow | /de/suche/ |
| Disallow | /de/rechtschreibpr%C3%BCfung/ |
| Disallow | /de/autocomplete/ |
| Disallow | /de/login |
| Disallow | /es/submission/buscar/ |
| Disallow | /es/buscar/ |
| Disallow | /es/corrector-ortografico/ |
| Disallow | /es/autocomplete/ |
| Disallow | /es/login |
| Disallow | /it/submission/ricerca/ |
| Disallow | /it/ricerca/ |
| Disallow | /it/correttore/ |
| Disallow | /it/autocomplete/ |
| Disallow | /it/login |
| Disallow | /pt/submission/search/ |
| Disallow | /pt/search/ |
| Disallow | /pt/spellcheck/ |
| Disallow | /pt/autocomplete/ |
| Disallow | /pt/login |
| Disallow | /hi/submission/search/ |
| Disallow | /hi/search/ |
| Disallow | /hi/spellcheck/ |
| Disallow | /hi/autocomplete/ |
| Disallow | /hi/login |
| Disallow | /ko/submission/search/ |
| Disallow | /ko/search/ |
| Disallow | /ko/spellcheck/ |
| Disallow | /ko/autocomplete/ |
| Disallow | /ko/login |
| Disallow | /jp/submission/search/ |
| Disallow | /jp/search/ |
| Disallow | /jp/spellcheck/ |
| Disallow | /jp/autocomplete/ |
| Disallow | /jp/login |
| Disallow | /zh/submission/search/ |
| Disallow | /zh/search/ |
| Disallow | /zh/spellcheck/ |
| Disallow | /zh/autocomplete/ |
| Disallow | /zh/login |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 3 |
sirdatabot
| Rule | Path |
|---|---|
| Disallow | /submission/search/ |
| Disallow | /search/ |
| Disallow | /spellcheck/ |
| Disallow | /autocomplete/ |
| Disallow | /login |
| Disallow | /us/submission/search/ |
| Disallow | /us/search/ |
| Disallow | /us/spellcheck/ |
| Disallow | /us/autocomplete/ |
| Disallow | /us/login |
| Disallow | /de/submission/suche/ |
| Disallow | /de/suche/ |
| Disallow | /de/rechtschreibpr%C3%BCfung/ |
| Disallow | /de/autocomplete/ |
| Disallow | /de/login |
| Disallow | /es/submission/buscar/ |
| Disallow | /es/buscar/ |
| Disallow | /es/corrector-ortografico/ |
| Disallow | /es/autocomplete/ |
| Disallow | /es/login |
| Disallow | /it/submission/ricerca/ |
| Disallow | /it/ricerca/ |
| Disallow | /it/correttore/ |
| Disallow | /it/autocomplete/ |
| Disallow | /it/login |
| Disallow | /pt/submission/search/ |
| Disallow | /pt/search/ |
| Disallow | /pt/spellcheck/ |
| Disallow | /pt/autocomplete/ |
| Disallow | /pt/login |
| Disallow | /hi/submission/search/ |
| Disallow | /hi/search/ |
| Disallow | /hi/spellcheck/ |
| Disallow | /hi/autocomplete/ |
| Disallow | /hi/login |
| Disallow | /ko/submission/search/ |
| Disallow | /ko/search/ |
| Disallow | /ko/spellcheck/ |
| Disallow | /ko/autocomplete/ |
| Disallow | /ko/login |
| Disallow | /jp/submission/search/ |
| Disallow | /jp/search/ |
| Disallow | /jp/spellcheck/ |
| Disallow | /jp/autocomplete/ |
| Disallow | /jp/login |
| Disallow | /zh/submission/search/ |
| Disallow | /zh/search/ |
| Disallow | /zh/spellcheck/ |
| Disallow | /zh/autocomplete/ |
| Disallow | /zh/login |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 3 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.collinsdictionary.com/sitemap.xml |
| sitemap | https://www.collinsdictionary.com/sitemap.xml |
| sitemap | https://www.collinsdictionary.com/sitemap.xml |
| sitemap | https://www.collinsdictionary.com/sitemap.xml |