thedealexpert.net
robots.txt

Robots Exclusion Standard data for thedealexpert.net

Resource Scan

Scan Details

Site Domain thedealexpert.net
Base Domain thedealexpert.net
Scan Status Ok
Last Scan2025-10-30T18:57:27+00:00
Next Scan 2025-11-06T18:57:27+00:00

Last Scan

Scanned2025-10-30T18:57:27+00:00
URL https://thedealexpert.net/robots.txt
Redirect https://www.thedealexpert.net/robots.txt
Redirect Domain www.thedealexpert.net
Redirect Base thedealexpert.net
Domain IPs 104.200.25.65, 2600:3c01::f03c:92ff:fe19:8fbc
Redirect IPs 104.200.25.65, 2600:3c01::f03c:92ff:fe19:8fbc
Response IP 104.200.25.65
Found Yes
Hash feb3312171aa712691881d567d490c785f5ab182107d9d05cf94dd07e5681164
SimHash 1a5cdc61ec10

Groups

qwantify/bleriot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

linguee

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

mbcrawler

Rule Path
Disallow /

duckduckbot-https

Rule Path
Disallow /