justdobest.com
robots.txt

Robots Exclusion Standard data for justdobest.com

Resource Scan

Scan Details

Site Domain justdobest.com
Base Domain justdobest.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan3/21/2025, 7:19:54 PM
Next Scan 6/19/2025, 7:19:54 PM

Last Successful Scan

Scanned5/26/2023, 7:22:58 PM
URL https://justdobest.com/robots.txt
Domain IPs 104.21.56.121, 172.67.150.214, 2606:4700:3031::6815:3879, 2606:4700:3031::ac43:96d6
Response IP 172.67.150.214
Found Yes
Hash 293e9aa20dea56387752c986c087002d343c2da43da73874345e732db0a378a2
SimHash da06bf6262db

Groups

bytespider

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

etaospider

Rule Path
Disallow /

easouspider

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

yodaobot

Rule Path
Disallow /

jikespider

Rule Path
Disallow /

iaskspider

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /