dax.guide
robots.txt

Robots Exclusion Standard data for dax.guide

Resource Scan

Scan Details

Site Domain dax.guide
Base Domain dax.guide
Scan Status Ok
Last Scan2025-11-08T13:40:38+00:00
Next Scan 2025-12-08T13:40:38+00:00

Last Scan

Scanned2025-11-08T13:40:38+00:00
URL https://dax.guide/robots.txt
Domain IPs 13.107.213.59, 13.107.246.59
Response IP 13.107.213.59
Found Yes
Hash 59b35a04862b305f458a65f2b0ad624a383d7c012b046fcbe713aec4c8b8c50b
SimHash 905c7890e801

Groups

serpstatbot

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

mtrobot

Rule Path
Disallow /

mauibot (crawler.feedback+wc@gmail.com)

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

app.limber.io

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

awariobot

Rule Path
Disallow /

awariosmartbot

Rule Path
Disallow /

awariorssbot

Rule Path
Disallow /

crawler

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

nutch

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

sbintuitionsbot

Rule Path
Disallow /

brightedge crawler

Rule Path
Disallow /

*

Rule Path
Disallow /wp-admin/
Disallow /u/
Disallow /cert/
Disallow /learn/
Disallow /account/
Disallow /cart/
Disallow /checkout/