daubasses.com
robots.txt

Robots Exclusion Standard data for daubasses.com

Resource Scan

Scan Details

Site Domain daubasses.com
Base Domain daubasses.com
Scan Status Ok
Last Scan2026-02-19T17:51:54+00:00
Next Scan 2026-03-21T17:51:54+00:00

Last Scan

Scanned2026-02-19T17:51:54+00:00
URL https://daubasses.com/robots.txt
Redirect https://www.daubasses.com/robots.txt
Redirect Domain www.daubasses.com
Redirect Base daubasses.com
Domain IPs 94.136.170.75
Redirect IPs 94.136.170.75
Response IP 94.136.170.75
Found Yes
Hash f50ef725166e0831df07c443a499f72f9275234382f4b239a456f122f2fb66fb
SimHash a33dc4f863b9

Groups

ahrefsbot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

nutch

Rule Path
Disallow /

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow /administrator/
Disallow /cache/
Disallow /components/
Disallow /images/
Disallow /includes/
Disallow /installation/
Disallow /libraries/
Disallow /modules/
Disallow /plugins/
Disallow /tmp/
Disallow /xmlrpc/
Disallow /b-a/

Comments

  • Disallow: /language/
  • Disallow: /media/
  • Disallow: /templates/