fr.kelkoo.be
robots.txt

Robots Exclusion Standard data for fr.kelkoo.be

Resource Scan

Scan Details

Site Domain fr.kelkoo.be
Base Domain kelkoo.be
Scan Status Ok
Last Scan2025-02-23T18:09:30+00:00
Next Scan 2025-03-25T18:09:30+00:00

Last Scan

Scanned2025-02-23T18:09:30+00:00
URL https://fr.kelkoo.be/robots.txt
Domain IPs 13.226.2.100, 13.226.2.129, 13.226.2.37, 13.226.2.50
Response IP 13.226.2.129
Found Yes
Hash 6aa22a723e23b9f060fd3e0e10dcb3b054fc6e4d6c594a8bf98cdacc5aba7b4d
SimHash c2085a88c00b

Groups

ahrefsbot

Rule Path
Disallow /

aspiegelbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

adscanner

Rule Path
Disallow /

linguee

Rule Path
Disallow /

bdcbot

Rule Path
Disallow /

*

Rule Path
Disallow /api/
Disallow /op/*
Disallow /b/*
Disallow /*?*
Disallow /comid/
Disallow /aboutSearchResultsPopup/
Allow /*ts%3Dtrue*
Allow /*ethicalType*
Allow /*marque%3D*
Allow /*type%3D*

dataforseobot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://fr.kelkoo.be/Sitemap-be_top_searches-index.xml
sitemap https://fr.kelkoo.be/Sitemap-be_content_pages-index.xml
sitemap https://fr.kelkoo.be/Sitemap-be_hp_cats_lev1-index.xml
sitemap https://fr.kelkoo.be/Sitemap-be_cats_lev2-index.xml
sitemap https://fr.kelkoo.be/Sitemap-be_cats_lev3-index.xml
sitemap https://fr.kelkoo.be/Sitemap-be_cats_lev4-index.xml
sitemap https://fr.kelkoo.be/Sitemap-be_cats_lev2_filters-index.xml
sitemap https://fr.kelkoo.be/Sitemap-be_cats_lev3_filters-index.xml
sitemap https://fr.kelkoo.be/Sitemap-be_cats_lev4_filters-index.xml
sitemap https://fr.kelkoo.be/Sitemap-be_ethical-index.xml