djw1.com
robots.txt

Robots Exclusion Standard data for djw1.com

Resource Scan

Scan Details

Site Domain djw1.com
Base Domain djw1.com
Scan Status Ok
Last Scan2026-04-08T12:20:42+00:00
Next Scan 2026-05-08T12:20:42+00:00

Last Scan

Scanned2026-04-08T12:20:42+00:00
URL https://djw1.com/robots.txt
Domain IPs 104.16.250.22, 104.17.25.173, 104.18.185.26, 104.21.224.5, 104.21.227.134, 2606:4700:3032::818:669e, 2606:4700:3035::1a4f:5642, 2606:4700:8ca0::3dc4:21a2, 2606:4700:e7::3151:47a9, 2a06:98c1:3120::5692:61a4
Response IP 104.16.250.22
Found Yes
Hash 4297f5018991e44c8da33f218ad367a1e7b0458a4aa981f1a0a00413e65f1ee0
SimHash 7d1c5100fa88

Groups

dataforseobot

Rule Path
Disallow /

siteauditbot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

semrushbot-coub

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

uptimebot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

mail.ru

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

extlinksbot

Rule Path
Disallow /

aihitbot

Rule Path
Disallow /

researchscan

Rule Path
Disallow /

dnyzbot

Rule Path
Disallow /

googlebot

Rule Path
Allow /$
Disallow /

googlebot-image

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

*

Rule Path
Disallow /api
Disallow /history
Disallow /search
Disallow /wp-z*
Disallow /*.php$
Disallow /tag/

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://djw1.com/wp-sitemap.xml