en.pons.com
robots.txt

Robots Exclusion Standard data for en.pons.com

Resource Scan

Scan Details

Site Domain en.pons.com
Base Domain pons.com
Scan Status Ok
Last Scan2024-11-15T19:12:22+00:00
Next Scan 2024-11-22T19:12:22+00:00

Last Scan

Scanned2024-11-15T19:12:22+00:00
URL https://en.pons.com/robots.txt
Domain IPs 49.12.134.205, 51.68.180.201
Response IP 49.12.134.205
Found Yes
Hash d05148ff2742a2c06857817f4502e2ebf487aa9e99abff3fb22546b4e4caec55
SimHash 4a36d083d191

Groups

*

Rule Path
Disallow /*%26resetPrefersMobile%3Dtrue
Disallow /_translate/
Disallow /open_dict/deletion_nominations/
Disallow /open_dict/entries/
Disallow /open_dict/editors/
Disallow /open_dict/info/
Disallow /open_dict/user_feedbacks/
Disallow /open_dict/audio_tts/
Disallow /open_dict/cms/
Disallow /shop/meinKonto.do
Disallow /en/%C3%BCbersetzung/dict/results/*
Disallow /translate/null/*
Disallow /translate/dictionnaire-scolaire-allemand/*
Disallow /text-translation?*
Disallow /forum/*
Allow /specials/cms/press/
Allow /specials/cms/contact/
Allow /specials/cms/imprint/
Allow /specials/cms/newsletter/
Allow /specials/cms/faq/
Allow /specials/cms/tools/

ia_archiver

Rule Path
Disallow /specials
Disallow /schule2
Disallow /grammatik

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

verity/1.1

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 3

Other Records

Field Value
sitemap https://en.pons.com/translate/~sitemapindex.xml
sitemap https://en.pons.com/p/share/pons_en.xml
sitemap https://en.pons.com/verb-tables/german/~sitemapindex.xml
sitemap https://en.pons.com/verb-tables/latin/~sitemapindex.xml
sitemap https://en.pons.com/verb-tables/english/~sitemapindex.xml
sitemap https://en.pons.com/verb-tables/french/~sitemapindex.xml
sitemap https://en.pons.com/verb-tables/spanish/~sitemapindex.xml
sitemap https://en.pons.com/app-shell/sitemap.xml