it.pons.com
robots.txt

Robots Exclusion Standard data for it.pons.com

Resource Scan

Scan Details

Site Domain it.pons.com
Base Domain pons.com
Scan Status Ok
Last Scan2024-09-24T20:52:10+00:00
Next Scan 2024-10-01T20:52:10+00:00

Last Scan

Scanned2024-09-24T20:52:10+00:00
URL https://it.pons.com/robots.txt
Domain IPs 49.12.134.205, 51.68.180.201
Response IP 51.68.180.201
Found Yes
Hash 3cdef499de7d99dce5c82e0451f7eee16e63e76341043c7481d00bbfa4fcbb6d
SimHash 5817c082cdb9

Groups

*

Rule Path
Disallow /*%26resetPrefersMobile%3Dtrue
Disallow /_translate/
Disallow /open_dict/deletion_nominations/
Disallow /open_dict/entries/
Disallow /open_dict/editors/
Disallow /open_dict/info/
Disallow /open_dict/user_feedbacks/
Disallow /open_dict/audio_tts/
Disallow /open_dict/cms/
Disallow /shop/meinKonto.do
Disallow /it/%C3%BCbersetzung/dict/results/*
Disallow /traduzione/null/*
Disallow /traduzione-testo?*
Disallow /forum/*
Allow /specials/cms/press/
Allow /specials/cms/contact/
Allow /specials/cms/imprint/
Allow /specials/cms/newsletter/
Allow /specials/cms/faq/
Allow /specials/cms/tools/

ia_archiver

Rule Path
Disallow /specials
Disallow /schule2
Disallow /grammatik

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

verity/1.1

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 3

Other Records

Field Value
sitemap https://it.pons.com/traduzione/~sitemapindex.xml
sitemap https://it.pons.com/p/share/pons_it.xml
sitemap https://it.pons.com/tabelle-dei-verbi/tedesco/~sitemapindex.xml
sitemap https://it.pons.com/tabelle-dei-verbi/latino/~sitemapindex.xml
sitemap https://it.pons.com/tabelle-dei-verbi/inglese/~sitemapindex.xml
sitemap https://it.pons.com/tabelle-dei-verbi/francese/~sitemapindex.xml
sitemap https://it.pons.com/tabelle-dei-verbi/spagnolo/~sitemapindex.xml
sitemap https://it.pons.com/app-shell/sitemap.xml