dealdoodle.com
robots.txt

Robots Exclusion Standard data for dealdoodle.com

Resource Scan

Scan Details

Site Domain dealdoodle.com
Base Domain dealdoodle.com
Scan Status Ok
Last Scan2024-09-29T07:26:05+00:00
Next Scan 2024-10-06T07:26:05+00:00

Last Scan

Scanned2024-09-29T07:26:05+00:00
URL https://dealdoodle.com/robots.txt
Domain IPs 135.148.158.216
Response IP 135.148.158.216
Found Yes
Hash 6708e2a4da7b0b0211c1e42e07f3c5e38737bff99a8fe02bf7062084cad565b3
SimHash 0d0cdd01a8da

Groups

baiduspider

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

pimeyes.com crawler

Rule Path
Disallow /

*

Rule Path
Disallow /?*
Disallow /page-not-found/?*
Disallow /*?*subtype=
Disallow /*?*shop=
Disallow /*?*category=
Disallow /*?*page=
Disallow /*?*onsale=
Disallow /*?*sort=
Disallow /*?*store=
Disallow /*?*brand=
Disallow /*?*min=
Disallow /*?*max=
Disallow /outlink
Disallow /redirect
Disallow /a/*
Disallow /*/ajax/*
Disallow /member
Disallow /tools

Other Records

Field Value
sitemap https://www.dealdoodle.com/sitemap/index.xml