en.pons.com
robots.txt

Robots Exclusion Standard data for en.pons.com

Resource Scan

Scan Details

Site Domain en.pons.com
Base Domain pons.com
Scan Status Ok
Last Scan2024-06-14T13:41:34+00:00
Next Scan 2024-06-21T13:41:34+00:00

Last Scan

Scanned2024-06-14T13:41:34+00:00
URL https://en.pons.com/robots.txt
Domain IPs 49.12.134.205, 51.68.180.201
Response IP 49.12.134.205
Found Yes
Hash ac91c9013376cf2097d9e88fe2bdab7a83c001e4c5b8df4d7a0411a21d15dcb6
SimHash 4a36d083d991

Groups

*

Rule Path
Disallow /*%26resetPrefersMobile%3Dtrue
Disallow /_translate/
Disallow /open_dict/deletion_nominations/
Disallow /open_dict/entries/
Disallow /open_dict/editors/
Disallow /open_dict/info/
Disallow /open_dict/user_feedbacks/
Disallow /open_dict/audio_tts/
Disallow /open_dict/cms/
Disallow /shop/meinKonto.do
Disallow /en/%C3%BCbersetzung/dict/results/*
Disallow /translate/null/*
Disallow /text-translation?*
Disallow /forum/*
Allow /specials/cms/press/
Allow /specials/cms/contact/
Allow /specials/cms/imprint/
Allow /specials/cms/newsletter/
Allow /specials/cms/faq/
Allow /specials/cms/tools/

ia_archiver

Rule Path
Disallow /specials
Disallow /schule2
Disallow /grammatik

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://en.pons.com/translate/~sitemapindex.xml
sitemap https://en.pons.com/p/share/pons_en.xml
sitemap https://en.pons.com/verb-tables/german/~sitemapindex.xml
sitemap https://en.pons.com/verb-tables/latin/~sitemapindex.xml
sitemap https://en.pons.com/verb-tables/english/~sitemapindex.xml
sitemap https://en.pons.com/verb-tables/french/~sitemapindex.xml
sitemap https://en.pons.com/verb-tables/spanish/~sitemapindex.xml