Log In Sign Up

saoonline.vn
robots.txt

Robots Exclusion Standard data for saoonline.vn

Resource Scan

Scan Details

Site Domain saoonline.vn
Base Domain saoonline.vn
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2024-06-08T11:00:27+00:00
Next Scan 2024-09-06T11:00:27+00:00

Last Successful Scan

Scanned2023-10-19T16:30:40+00:00
URL https://saoonline.vn/robots.txt
Domain IPs 104.21.87.50, 172.67.141.131, 2606:4700:3032::6815:5732, 2606:4700:3032::ac43:8d83
Response IP 172.67.141.131
Found Yes
Hash 43f116d0659bc682111b83a02b253b7f2b57a2ff7938e09a71dcfe031ceafd94
SimHash 105e5cc0c22a

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /author/
Disallow /readme.html
Disallow /license.txt

ahrefsbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

blekkobot

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

metajobbot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

fyberspider

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mojeekbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider+

Rule Path
Disallow /

baiduspider+(+http://www.baidu.com/search/spider.htm)

Rule Path
Disallow /

baiduspider/2.0; +http://www.baidu.com/search/spider.html

Rule Path
Disallow /

baiduspider/2.0

Rule Path
Disallow /

mozilla/5.0(compatible;baiduspider/2.0; +http://www.baidu.com/search/spider.html)

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /
Back to top

Comments

  • Baiduspider
Back to top

Warnings

  • 8 invalid lines.
Back to top