djresource.eu
robots.txt

Robots Exclusion Standard data for djresource.eu

Resource Scan

Scan Details

Site Domain djresource.eu
Base Domain djresource.eu
Scan Status Ok
Last Scan2026-01-28T18:41:47+00:00
Next Scan 2026-02-04T18:41:47+00:00

Last Scan

Scanned2026-01-28T18:41:47+00:00
URL https://djresource.eu/robots.txt
Redirect https://www.djresource.eu/robots.txt
Redirect Domain www.djresource.eu
Redirect Base djresource.eu
Domain IPs 82.180.155.65
Redirect IPs 82.180.155.65
Response IP 82.180.155.65
Found Yes
Hash f1c34c91c9e9db8e5214babc0b3d640f6f3ae7108eb892fa684a24bcaa00f0c5
SimHash 781c9e42e09f

Groups

gigabot

Rule Path
Disallow /

shopwiki

Rule Path
Disallow /

sphere

Rule Path
Disallow /

steeler

Rule Path
Disallow /

ahrefssiteaudit

Rule Path
Disallow /

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 600

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 6000

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

*

Rule Path
Disallow /admin/
Disallow /includes/
Disallow /uploads/
Disallow /Profile/
Disallow /Search/

Other Records

Field Value
sitemap https://www.djresource.eu/sitemap/sitemapindex.xml