djgolu.me
robots.txt

Robots Exclusion Standard data for djgolu.me

Resource Scan

Scan Details

Site Domain djgolu.me
Base Domain djgolu.me
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-10-17T21:12:30+00:00
Next Scan 2026-01-15T21:12:30+00:00

Last Successful Scan

Scanned2023-11-15T08:56:15+00:00
URL https://djgolu.me/robots.txt
Domain IPs 104.21.53.52, 172.67.209.33, 2606:4700:3034::6815:3534, 2606:4700:3035::ac43:d121
Response IP 104.21.53.52
Found Yes
Hash ad73527bcb232091ee0dd3cad8eb7374901985e8285944693686a4b76ebb60fd
SimHash cb00de508fb0

Groups

*

Rule Path
Disallow */search?find
Disallow /adsnetwork
Allow /

Other Records

Field Value
sitemap https://djgolu.me/sitemap.xml

Warnings

  • `host` is not a known field.