ingles.com
robots.txt
Robots Exclusion Standard data for ingles.com
Resource Scan
Scan Details
| Site Domain | ingles.com |
| Base Domain | ingles.com |
| Scan Status | Ok |
| Last Scan | 2024-05-15T00:07:50+00:00 |
| Next Scan | 2024-05-22T00:07:50+00:00 |
Last Scan
| Scanned | 2024-05-15T00:07:50+00:00 |
| URL | https://ingles.com/robots.txt |
| Redirect | https://www.ingles.com/robots.txt |
| Redirect Domain | www.ingles.com |
| Redirect Base | ingles.com |
| Domain IPs | 18.211.182.210, 3.89.234.185, 52.204.169.157 |
| Redirect IPs | 2600:9000:2003:400:0:4223:b440:93a1, 2600:9000:2003:5e00:0:4223:b440:93a1, 2600:9000:2003:6000:0:4223:b440:93a1, 2600:9000:2003:6e00:0:4223:b440:93a1, 2600:9000:2003:7200:0:4223:b440:93a1, 2600:9000:2003:8600:0:4223:b440:93a1, 2600:9000:2003:c800:0:4223:b440:93a1, 2600:9000:2003:f400:0:4223:b440:93a1, 52.84.229.101, 52.84.229.102, 52.84.229.13, 52.84.229.45 |
| Response IP | 52.84.229.45 |
| Found | Yes |
| Hash | 069018d08320cd3dac4f8e277831c4d2e9cfdf22412791fecfe157dbe98aeb83 |
| SimHash | 6b84d933c333 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /m/translate/ |
| Allow | /users/login |
| Allow | /users/signup_start |
| Disallow | /users/ |
| Disallow | /answers/dictionary_answers_search/ |
| Disallow | /dictionary/phrasebook_search/ |
| Disallow | /dictionary/answers_search/ |
| Disallow | /dictionary/translation_sdl |
| Disallow | /dictionary/translation_prompt |
| Disallow | /dictionary/translation_ms |
| Disallow | /flashcards/print_view |
| Disallow | /flashcards/json |
| Disallow | /vocabulary/choose-level |
| Disallow | /vocabulario/escoge-tu-nivel |
| Disallow | /examples/la%2520periodista%2520escribe%2520un%2520mensaje%2520electronico%3Ft%3D1 |
| Allow | / |
criteobot/0.1
| Rule | Path |
|---|---|
| Disallow | /m/translate/ |
| Allow | /users/login |
| Allow | /users/signup_start |
| Disallow | /users/ |
| Disallow | /answers/dictionary_answers_search/ |
| Disallow | /dictionary/phrasebook_search/ |
| Disallow | /dictionary/answers_search/ |
| Disallow | /dictionary/translation_sdl |
| Disallow | /dictionary/translation_prompt |
| Disallow | /dictionary/translation_ms |
| Disallow | /flashcards/print_view |
| Disallow | /flashcards/json |
| Disallow | /vocabulary/choose-level |
| Disallow | /vocabulario/escoge-tu-nivel |
| Disallow | /examples/la%2520periodista%2520escribe%2520un%2520mensaje%2520electronico%3Ft%3D1 |
| Allow | / |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.ingles.com/sitemap-index-ingles-launch.xml |
| sitemap | https://www.ingles.com/sitemap-index-ingles-launch.xml |