shareaurora.com
robots.txt

Robots Exclusion Standard data for shareaurora.com

Resource Scan

Scan Details

Site Domain shareaurora.com
Base Domain shareaurora.com
Scan Status Ok
Last Scan2025-11-09T00:48:22+00:00
Next Scan 2025-12-09T00:48:22+00:00

Last Scan

Scanned2025-11-09T00:48:22+00:00
URL https://shareaurora.com/robots.txt
Domain IPs 163.181.164.204, 163.181.164.205, 163.181.164.239, 163.181.164.240, 163.181.164.241, 163.181.164.242, 163.181.164.243, 163.181.164.244
Response IP 163.181.201.182
Found Yes
Hash adbdd8b99527fbcce70aad70085a1ec69e8e826b8bbfd295e0353a52fb1b0b7b
SimHash d865dd3c0921

Groups

baiduspider

Rule Path
Disallow /baidu
Disallow /s?
Disallow /ulink?
Disallow /link?
Disallow /home/news/data/
Disallow /bh

googlebot

Rule Path
Disallow /baidu
Disallow /s?
Disallow /shifen/
Disallow /homepage/
Disallow /cpro
Disallow /ulink?
Disallow /link?
Disallow /home/news/data/
Disallow /bh

msnbot

Rule Path
Disallow /baidu
Disallow /s?
Disallow /shifen/
Disallow /homepage/
Disallow /cpro
Disallow /ulink?
Disallow /link?
Disallow /home/news/data/
Disallow /bh

baiduspider-image

Rule Path
Disallow /baidu
Disallow /s?
Disallow /shifen/
Disallow /homepage/
Disallow /cpro
Disallow /ulink?
Disallow /link?
Disallow /home/news/data/
Disallow /bh

youdaobot

Rule Path
Disallow /baidu
Disallow /s?
Disallow /shifen/
Disallow /homepage/
Disallow /cpro
Disallow /ulink?
Disallow /link?
Disallow /home/news/data/
Disallow /bh

sogou web spider

Rule Path
Disallow /baidu
Disallow /s?
Disallow /shifen/
Disallow /homepage/
Disallow /cpro
Disallow /ulink?
Disallow /link?
Disallow /home/news/data/
Disallow /bh

sogou inst spider

Rule Path
Disallow /baidu
Disallow /s?
Disallow /shifen/
Disallow /homepage/
Disallow /cpro
Disallow /ulink?
Disallow /link?
Disallow /home/news/data/
Disallow /bh

sogou spider2

Rule Path
Disallow /baidu
Disallow /s?
Disallow /shifen/
Disallow /homepage/
Disallow /cpro
Disallow /ulink?
Disallow /link?
Disallow /home/news/data/
Disallow /bh

sogou blog

Rule Path
Disallow /baidu
Disallow /s?
Disallow /shifen/
Disallow /homepage/
Disallow /cpro
Disallow /ulink?
Disallow /link?
Disallow /home/news/data/
Disallow /bh

sogou news spider

Rule Path
Disallow /baidu
Disallow /s?
Disallow /shifen/
Disallow /homepage/
Disallow /cpro
Disallow /ulink?
Disallow /link?
Disallow /home/news/data/
Disallow /bh

sogou orion spider

Rule Path
Disallow /baidu
Disallow /s?
Disallow /shifen/
Disallow /homepage/
Disallow /cpro
Disallow /ulink?
Disallow /link?
Disallow /home/news/data/
Disallow /bh

chinasospider

Rule Path
Disallow /baidu
Disallow /s?
Disallow /shifen/
Disallow /homepage/
Disallow /cpro
Disallow /ulink?
Disallow /link?
Disallow /home/news/data/
Disallow /bh

sosospider

Rule Path
Disallow /baidu
Disallow /s?
Disallow /shifen/
Disallow /homepage/
Disallow /cpro
Disallow /ulink?
Disallow /link?
Disallow /home/news/data/
Disallow /bh

yisouspider

Rule Path
Disallow /baidu
Disallow /s?
Disallow /shifen/
Disallow /homepage/
Disallow /cpro
Disallow /ulink?
Disallow /link?
Disallow /home/news/data/
Disallow /bh

easouspider

Rule Path
Disallow /baidu
Disallow /s?
Disallow /shifen/
Disallow /homepage/
Disallow /cpro
Disallow /ulink?
Disallow /link?
Disallow /home/news/data/
Disallow /bh

*

Rule Path
Disallow /

facebookexternalhit

Rule Path
Allow /