dilawri.com
robots.txt

Robots Exclusion Standard data for dilawri.com

Resource Scan

Scan Details

Site Domain dilawri.com
Base Domain dilawri.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned an unexpected status.
Last Scan2026-02-07T08:38:29+00:00
Next Scan 2026-05-08T08:38:29+00:00

Last Successful Scan

Scanned2025-09-05T10:30:17+00:00
URL https://dilawri.com/robots.txt
Domain IPs 2605:6f00:1234:700:1::103, 66.102.133.237
Response IP 66.102.133.237
Found Yes
Hash c07e0ca8c5e6e1ac03e14dcf14811f909eaa9a8f957cb07c689773d8094deca2
SimHash 35157d8d4f90

Groups

*

Rule Path
Disallow /contact/
Disallow /gallery/
Disallow /blog/
Disallow /docs/
Disallow /dl/
Disallow /about/resume
Disallow /flash
Disallow /splash.htm
Disallow /_dev
Disallow /_download
Disallow /lake

Comments

  • Prevent all robots from visiting the /docs directory:

Warnings

  • 4 invalid lines.