Log In Sign Up

dgfev.com
robots.txt

Robots Exclusion Standard data for dgfev.com

Resource Scan

Scan Details

Site Domain dgfev.com
Base Domain dgfev.com
Scan Status Ok
Last Scan2025-10-24T10:46:17+00:00
Next Scan 2025-11-23T10:46:17+00:00

Last Scan

Scanned2025-10-24T10:46:17+00:00
URL https://dgfev.com/robots.txt
Domain IPs 104.21.27.187, 172.67.143.115, 2606:4700:3034::6815:1bbb, 2606:4700:3035::ac43:8f73
Response IP 172.67.143.115
Found Yes
Hash 23d52a11e5afe47573171cd3bd4f7a6854c16c2ac473b80c23ec7832944e3630
SimHash 4940c3a25290

Groups

mj12bot

Rule Path
Disallow /

ahrefsbot/5.1

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot/1.1~bl

Rule Path
Disallow /

*
googlebot

Rule Path
Allow /

googlebot-video

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

slurp

Rule Path
Allow /

bingbot

Rule Path
Allow /

adidxbot

Rule Path
Allow /

msnbot

Rule Path
Allow /

msnbot-media

Rule Path
Allow /

yandex

Rule Path
Allow /
Back to top