spanishdictionary.com
robots.txt
Robots Exclusion Standard data for spanishdictionary.com
Resource Scan
Scan Details
| Site Domain | spanishdictionary.com |
| Base Domain | spanishdictionary.com |
| Scan Status | Ok |
| Last Scan | 2024-11-09T08:37:23+00:00 |
| Next Scan | 2024-11-16T08:37:23+00:00 |
Last Scan
| Scanned | 2024-11-09T08:37:23+00:00 |
| URL | https://spanishdictionary.com/robots.txt |
| Redirect | https://www.spanishdict.com/robots.txt |
| Redirect Domain | www.spanishdict.com |
| Redirect Base | spanishdict.com |
| Domain IPs | 104.21.28.211, 172.67.147.152, 2606:4700:3034::6815:1cd3, 2606:4700:3035::ac43:9398 |
| Redirect IPs | 104.18.39.60, 172.64.148.196, 2606:4700:4400::6812:273c, 2606:4700:4400::ac40:94c4 |
| Response IP | 172.64.148.196 |
| Found | Yes |
| Hash | bd7867e854e80ac9050a76fdf62242ccae22ae3c4a9b0c57f93d98485df92ff2 |
| SimHash | 6b84d133c333 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /m/translate/ |
| Allow | /users/login |
| Allow | /users/signup_start |
| Disallow | /drill |
| Disallow | /users/ |
| Disallow | /answers/dictionary_answers_search/ |
| Disallow | /dictionary/phrasebook_search/ |
| Disallow | /dictionary/answers_search/ |
| Disallow | /dictionary/translation_sdl |
| Disallow | /dictionary/translation_prompt |
| Disallow | /dictionary/translation_ms |
| Disallow | /flashcards/print_view |
| Disallow | /flashcards/json |
| Disallow | /vocabulary/choose-level |
| Disallow | /vocabulario/escoge-tu-nivel |
| Disallow | /examples/la%2520periodista%2520escribe%2520un%2520mensaje%2520electronico%3Ft%3D1 |
| Allow | / |
criteobot/0.1
| Rule | Path |
|---|---|
| Disallow | /m/translate/ |
| Allow | /users/login |
| Allow | /users/signup_start |
| Disallow | /drill |
| Disallow | /users/ |
| Disallow | /answers/dictionary_answers_search/ |
| Disallow | /dictionary/phrasebook_search/ |
| Disallow | /dictionary/answers_search/ |
| Disallow | /dictionary/translation_sdl |
| Disallow | /dictionary/translation_prompt |
| Disallow | /dictionary/translation_ms |
| Disallow | /flashcards/print_view |
| Disallow | /flashcards/json |
| Disallow | /vocabulary/choose-level |
| Disallow | /vocabulario/escoge-tu-nivel |
| Disallow | /examples/la%2520periodista%2520escribe%2520un%2520mensaje%2520electronico%3Ft%3D1 |
| Allow | / |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.spanishdict.com/sitemap-index-https.xml |
| sitemap | https://www.spanishdict.com/sitemap-index-https.xml |