fr.pons.com
robots.txt

Robots Exclusion Standard data for fr.pons.com

Resource Scan

Scan Details

Site Domain fr.pons.com
Base Domain pons.com
Scan Status Ok
Last Scan2024-06-13T06:48:58+00:00
Next Scan 2024-06-20T06:48:58+00:00

Last Scan

Scanned2024-06-13T06:48:58+00:00
URL https://fr.pons.com/robots.txt
Domain IPs 49.12.134.205, 51.68.180.201
Response IP 51.68.180.201
Found Yes
Hash 82b6ec4b3aaeabf4b046e98878cb938b3a964177ed33c3401fb86f9b4670a536
SimHash c836c48fedb9

Groups

*

Rule Path
Disallow /*%26resetPrefersMobile%3Dtrue
Disallow /_translate/
Disallow /open_dict/deletion_nominations/
Disallow /open_dict/entries/
Disallow /open_dict/editors/
Disallow /open_dict/info/
Disallow /open_dict/user_feedbacks/
Disallow /open_dict/audio_tts/
Disallow /open_dict/cms/
Disallow /shop/meinKonto.do
Disallow /fr/%C3%BCbersetzung/dict/results/*
Disallow /traduction/null/*
Disallow /traduction-texte?*
Disallow /forum/*
Allow /specials/cms/press/
Allow /specials/cms/contact/
Allow /specials/cms/imprint/
Allow /specials/cms/newsletter/
Allow /specials/cms/faq/
Allow /specials/cms/tools/

ia_archiver

Rule Path
Disallow /specials
Disallow /schule2
Disallow /grammatik

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://fr.pons.com/traduction/~sitemapindex.xml
sitemap https://fr.pons.com/p/share/pons_fr.xml
sitemap https://fr.pons.com/tableaux-de-conjugaison/allemand/~sitemapindex.xml
sitemap https://fr.pons.com/tableaux-de-conjugaison/latin/~sitemapindex.xml
sitemap https://fr.pons.com/tableaux-de-conjugaison/anglais/~sitemapindex.xml
sitemap https://fr.pons.com/tableaux-de-conjugaison/fran%C3%A7ais/~sitemapindex.xml
sitemap https://fr.pons.com/tableaux-de-conjugaison/espagnol/~sitemapindex.xml