digother.com
robots.txt

Robots Exclusion Standard data for digother.com

Resource Scan

Scan Details

Site Domain digother.com
Base Domain digother.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-12-15T19:18:10+00:00
Next Scan 2026-03-15T19:18:10+00:00

Last Successful Scan

Scanned2023-05-28T12:52:54+00:00
URL https://digother.com/robots.txt
Domain IPs 104.21.76.109, 172.67.193.94, 2606:4700:3033::6815:4c6d, 2606:4700:3034::ac43:c15e
Response IP 104.21.76.109
Found Yes
Hash 293e9aa20dea56387752c986c087002d343c2da43da73874345e732db0a378a2
SimHash da06bf6262db

Groups

bytespider

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

etaospider

Rule Path
Disallow /

easouspider

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

yodaobot

Rule Path
Disallow /

jikespider

Rule Path
Disallow /

iaskspider

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /