kelkoo.com
robots.txt

Robots Exclusion Standard data for kelkoo.com

Resource Scan

Scan Details

Site Domain kelkoo.com
Base Domain kelkoo.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-06-23T17:55:02+00:00
Next Scan 2024-08-22T17:55:02+00:00

Last Successful Scan

Scanned2022-12-07T06:53:30+00:00
URL https://kelkoo.com/robots.txt
Redirect https://www.kelkoo.co.uk/robots.txt?kpartnerid=96954666
Redirect Domain www.kelkoo.co.uk
Redirect Base kelkoo.co.uk
Domain IPs 95.211.116.48
Redirect IPs 52.84.45.113, 52.84.45.31, 52.84.45.86, 52.84.45.98
Response IP 52.84.45.86
Found Yes
Hash 3d4470186d15adc4d6046cff96ede8f4cebe13c61718bd384cb8dd35e5dfffd7
SimHash 821cda03ee12

Groups

ahrefsbot

Rule Path
Disallow /

aspiegelbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

adscanner

Rule Path
Disallow /

linguee

Rule Path
Disallow /

bdcbot

Rule Path
Disallow /

*

Rule Path
Disallow /fluxus/
Disallow /aboutSearchResultsPopup/

Other Records

Field Value
sitemap https://www.kelkoo.co.uk/Sitemap-uk_content_pages-index.xml
sitemap https://www.kelkoo.co.uk/Sitemap-uk_hp_cats_lev1-index.xml
sitemap https://www.kelkoo.co.uk/Sitemap-uk_cats_lev2-index.xml
sitemap https://www.kelkoo.co.uk/Sitemap-uk_cats_lev3-index.xml
sitemap https://www.kelkoo.co.uk/Sitemap-uk_cats_lev4-index.xml
sitemap https://www.kelkoo.co.uk/Sitemap-uk_cats_lev5-index.xml
sitemap https://www.kelkoo.co.uk/Sitemap-uk_cats_lev1_filter-index.xml
sitemap https://www.kelkoo.co.uk/Sitemap-uk_cats_lev2_filters-index.xml
sitemap https://www.kelkoo.co.uk/Sitemap-uk_cats_lev3_filters-index.xml
sitemap https://www.kelkoo.co.uk/Sitemap-uk_cats_lev4_filters-index.xml
sitemap https://www.kelkoo.co.uk/Sitemap-uk_cats_lev5_filters-index.xml