kelkoo.de
robots.txt

Robots Exclusion Standard data for kelkoo.de

Resource Scan

Scan Details

Site Domain kelkoo.de
Base Domain kelkoo.de
Scan Status Ok
Last Scan2024-10-18T07:35:37+00:00
Next Scan 2024-11-17T07:35:37+00:00

Last Scan

Scanned2024-10-18T07:35:37+00:00
URL https://www.kelkoo.de/robots.txt
Domain IPs 13.226.2.120, 13.226.2.2, 13.226.2.56, 13.226.2.80
Response IP 18.165.140.13
Found Yes
Hash 3f067b263e499ddd5b37e272518c5c9a2fd240c433c121fc866f9c1d2a5197cd
SimHash 1205f200cb08

Groups

ahrefsbot

Rule Path
Disallow /

aspiegelbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

adscanner

Rule Path
Disallow /

linguee

Rule Path
Disallow /

bdcbot

Rule Path
Disallow /

*

Rule Path
Disallow /api/
Disallow /op/*
Disallow /b/*
Disallow /*?*
Disallow /comid/
Disallow /aboutSearchResultsPopup/
Allow /*ts%3Dtrue*
Allow /*ethicalType*
Allow /*marke%3D*
Allow /*typ%3D*

dataforseobot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.kelkoo.de/Sitemap-de_top_searches-index.xml
sitemap https://www.kelkoo.de/Sitemap-de_pagecontent_2023-11-07.xml
sitemap https://www.kelkoo.de/Sitemap-de_pagecontent_2023-11-20.xml
sitemap https://www.kelkoo.de/Sitemap-de_content_pages-index.xml
sitemap https://www.kelkoo.de/Sitemap-de_hp_cats_lev1-index.xml
sitemap https://www.kelkoo.de/Sitemap-de_cats_lev2-index.xml
sitemap https://www.kelkoo.de/Sitemap-de_cats_lev3-index.xml
sitemap https://www.kelkoo.de/Sitemap-de_cats_lev4-index.xml
sitemap https://www.kelkoo.de/Sitemap-de_cats_lev2_filters-index.xml
sitemap https://www.kelkoo.de/Sitemap-de_cats_lev3_filters-index.xml
sitemap https://www.kelkoo.de/Sitemap-de_cats_lev4_filters-index.xml
sitemap https://www.kelkoo.de/Sitemap-de_ethical-index.xml