Log In Sign Up

79mb.one
robots.txt

Robots Exclusion Standard data for 79mb.one

Resource Scan

Scan Details

Site Domain 79mb.one
Base Domain 79mb.one
Scan Status Ok
Last Scan2025-04-18T01:17:54+00:00
Next Scan 2025-05-18T01:17:54+00:00

Last Scan

Scanned2025-04-18T01:17:54+00:00
URL https://79mb.one/robots.txt
Redirect https://www.79mb.one/robots.txt
Redirect Domain www.79mb.one
Redirect Base 79mb.one
Domain IPs 104.21.28.56, 172.67.170.97, 2606:4700:3035::6815:1c38, 2606:4700:3035::ac43:aa61
Redirect IPs 104.21.28.56, 172.67.170.97, 2606:4700:3035::6815:1c38, 2606:4700:3035::ac43:aa61
Response IP 172.67.170.97
Found Yes
Hash 1a644f3d5573b54742e1ceaa67c71f9f0e3c7f7742130834e83886b02dfcea94
SimHash 8a665b74a39b

Groups

*

Rule Path
Disallow

baiduspider

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

etaospider

Rule Path
Disallow /

huihuispider

Rule Path
Disallow /

gwdangspider

Rule Path
Disallow /

wochachaspider

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

sogouspider

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /
Back to top

Warnings

  • 2 invalid lines.
Back to top