dealdoodle.co.uk
robots.txt

Robots Exclusion Standard data for dealdoodle.co.uk

Resource Scan

Scan Details

Site Domain dealdoodle.co.uk
Base Domain dealdoodle.co.uk
Scan Status Ok
Last Scan2024-10-31T13:52:09+00:00
Next Scan 2024-11-07T13:52:09+00:00

Last Scan

Scanned2024-10-31T13:52:09+00:00
URL https://dealdoodle.co.uk/robots.txt
Domain IPs 198.244.131.25
Response IP 198.244.131.25
Found Yes
Hash e1e879800c3ad1c8ef3a3e1177869e35e7fe4800faf3d5474f85217b1ddf62c5
SimHash 092cdd08a0da

Groups

baiduspider

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

pimeyes.com crawler

Rule Path
Disallow /

*

Rule Path
Disallow /?*
Disallow /page-not-found/?*
Disallow /*?*subtype=
Disallow /*?*shop=
Disallow /*?*category=
Disallow /*?*page=
Disallow /*?*onsale=
Disallow /*?*sort=
Disallow /*?*store=
Disallow /*?*brand=
Disallow /*?*min=
Disallow /*?*max=
Disallow /outlink
Disallow /redirect
Disallow /a/*
Disallow /*/ajax/*
Disallow /member
Disallow /tools

Other Records

Field Value
sitemap https://www.dealdoodle.co.uk/sitemap/index.xml