gogleaurora.com
robots.txt

Robots Exclusion Standard data for gogleaurora.com

Resource Scan

Scan Details

Site Domain gogleaurora.com
Base Domain gogleaurora.com
Scan Status Ok
Last Scan2025-11-16T17:42:51+00:00
Next Scan 2025-12-16T17:42:51+00:00

Last Scan

Scanned2025-11-16T17:42:51+00:00
URL http://gogleaurora.com/robots.txt
Domain IPs 163.181.164.204, 163.181.164.205, 163.181.164.239, 163.181.164.240, 163.181.164.241, 163.181.164.242, 163.181.164.243, 163.181.164.244
Response IP 163.181.201.188
Found Yes
Hash adbdd8b99527fbcce70aad70085a1ec69e8e826b8bbfd295e0353a52fb1b0b7b
SimHash d865dd3c0921

Groups

baiduspider

Rule Path
Disallow /baidu
Disallow /s?
Disallow /ulink?
Disallow /link?
Disallow /home/news/data/
Disallow /bh

googlebot

Rule Path
Disallow /baidu
Disallow /s?
Disallow /shifen/
Disallow /homepage/
Disallow /cpro
Disallow /ulink?
Disallow /link?
Disallow /home/news/data/
Disallow /bh

msnbot

Rule Path
Disallow /baidu
Disallow /s?
Disallow /shifen/
Disallow /homepage/
Disallow /cpro
Disallow /ulink?
Disallow /link?
Disallow /home/news/data/
Disallow /bh

baiduspider-image

Rule Path
Disallow /baidu
Disallow /s?
Disallow /shifen/
Disallow /homepage/
Disallow /cpro
Disallow /ulink?
Disallow /link?
Disallow /home/news/data/
Disallow /bh

youdaobot

Rule Path
Disallow /baidu
Disallow /s?
Disallow /shifen/
Disallow /homepage/
Disallow /cpro
Disallow /ulink?
Disallow /link?
Disallow /home/news/data/
Disallow /bh

sogou web spider

Rule Path
Disallow /baidu
Disallow /s?
Disallow /shifen/
Disallow /homepage/
Disallow /cpro
Disallow /ulink?
Disallow /link?
Disallow /home/news/data/
Disallow /bh

sogou inst spider

Rule Path
Disallow /baidu
Disallow /s?
Disallow /shifen/
Disallow /homepage/
Disallow /cpro
Disallow /ulink?
Disallow /link?
Disallow /home/news/data/
Disallow /bh

sogou spider2

Rule Path
Disallow /baidu
Disallow /s?
Disallow /shifen/
Disallow /homepage/
Disallow /cpro
Disallow /ulink?
Disallow /link?
Disallow /home/news/data/
Disallow /bh

sogou blog

Rule Path
Disallow /baidu
Disallow /s?
Disallow /shifen/
Disallow /homepage/
Disallow /cpro
Disallow /ulink?
Disallow /link?
Disallow /home/news/data/
Disallow /bh

sogou news spider

Rule Path
Disallow /baidu
Disallow /s?
Disallow /shifen/
Disallow /homepage/
Disallow /cpro
Disallow /ulink?
Disallow /link?
Disallow /home/news/data/
Disallow /bh

sogou orion spider

Rule Path
Disallow /baidu
Disallow /s?
Disallow /shifen/
Disallow /homepage/
Disallow /cpro
Disallow /ulink?
Disallow /link?
Disallow /home/news/data/
Disallow /bh

chinasospider

Rule Path
Disallow /baidu
Disallow /s?
Disallow /shifen/
Disallow /homepage/
Disallow /cpro
Disallow /ulink?
Disallow /link?
Disallow /home/news/data/
Disallow /bh

sosospider

Rule Path
Disallow /baidu
Disallow /s?
Disallow /shifen/
Disallow /homepage/
Disallow /cpro
Disallow /ulink?
Disallow /link?
Disallow /home/news/data/
Disallow /bh

yisouspider

Rule Path
Disallow /baidu
Disallow /s?
Disallow /shifen/
Disallow /homepage/
Disallow /cpro
Disallow /ulink?
Disallow /link?
Disallow /home/news/data/
Disallow /bh

easouspider

Rule Path
Disallow /baidu
Disallow /s?
Disallow /shifen/
Disallow /homepage/
Disallow /cpro
Disallow /ulink?
Disallow /link?
Disallow /home/news/data/
Disallow /bh

*

Rule Path
Disallow /

facebookexternalhit

Rule Path
Allow /