en.pons.com
robots.txt

Robots Exclusion Standard data for en.pons.com

Resource Scan

Scan Details

Site Domain en.pons.com
Base Domain pons.com
Scan Status Ok
Last Scan2024-09-20T17:52:04+00:00
Next Scan 2024-09-27T17:52:04+00:00

Last Scan

Scanned2024-09-20T17:52:04+00:00
URL https://en.pons.com/robots.txt
Domain IPs 49.12.134.205, 51.68.180.201
Response IP 51.68.180.201
Found Yes
Hash 6838ac746ff5bd42f4ce06a6e15605e0d4a266486b2c01c218ddee9e6acd191b
SimHash 4a36d081d191

Groups

*

Rule Path
Disallow /*%26resetPrefersMobile%3Dtrue
Disallow /_translate/
Disallow /open_dict/deletion_nominations/
Disallow /open_dict/entries/
Disallow /open_dict/editors/
Disallow /open_dict/info/
Disallow /open_dict/user_feedbacks/
Disallow /open_dict/audio_tts/
Disallow /open_dict/cms/
Disallow /shop/meinKonto.do
Disallow /en/%C3%BCbersetzung/dict/results/*
Disallow /translate/null/*
Disallow /text-translation?*
Disallow /forum/*
Allow /specials/cms/press/
Allow /specials/cms/contact/
Allow /specials/cms/imprint/
Allow /specials/cms/newsletter/
Allow /specials/cms/faq/
Allow /specials/cms/tools/

ia_archiver

Rule Path
Disallow /specials
Disallow /schule2
Disallow /grammatik

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

verity/1.1

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 3

Other Records

Field Value
sitemap https://en.pons.com/translate/~sitemapindex.xml
sitemap https://en.pons.com/p/share/pons_en.xml
sitemap https://en.pons.com/verb-tables/german/~sitemapindex.xml
sitemap https://en.pons.com/verb-tables/latin/~sitemapindex.xml
sitemap https://en.pons.com/verb-tables/english/~sitemapindex.xml
sitemap https://en.pons.com/verb-tables/french/~sitemapindex.xml
sitemap https://en.pons.com/verb-tables/spanish/~sitemapindex.xml
sitemap https://en.pons.com/app-shell/sitemap.xml