getwisetoday.com
robots.txt

Robots Exclusion Standard data for getwisetoday.com

Resource Scan

Scan Details

Site Domain getwisetoday.com
Base Domain getwisetoday.com
Scan Status Ok
Last Scan2026-02-12T02:20:52+00:00
Next Scan 2026-03-14T02:20:52+00:00

Last Scan

Scanned2026-02-12T02:20:52+00:00
URL https://www.getwisetoday.com/robots.txt
Redirect https://www.baidu.com/robots.txt
Redirect Domain www.baidu.com
Redirect Base baidu.com
Domain IPs 104.21.15.212, 172.67.207.26, 2606:4700:3031::ac43:cf1a, 2606:4700:3036::6815:fd4
Redirect IPs 103.235.46.102, 103.235.46.115
Response IP 45.113.192.101
Found Yes
Hash c28ebeffb7baf9bd6407109e80dc95d87c75c0eaecc20b23884cb33111cc5df0
SimHash d865dd3c2901

Groups

baiduspider

Rule Path
Disallow /baidu
Disallow /s?
Disallow /ulink?
Disallow /link?
Disallow /home/news/data/
Disallow /bh

googlebot

Rule Path
Disallow /baidu
Disallow /s?
Disallow /shifen/
Disallow /homepage/
Disallow /cpro
Disallow /ulink?
Disallow /link?
Disallow /home/news/data/
Disallow /bh

msnbot

Rule Path
Disallow /baidu
Disallow /s?
Disallow /shifen/
Disallow /homepage/
Disallow /cpro
Disallow /ulink?
Disallow /link?
Disallow /home/news/data/
Disallow /bh

baiduspider-image

Rule Path
Disallow /baidu
Disallow /s?
Disallow /shifen/
Disallow /homepage/
Disallow /cpro
Disallow /ulink?
Disallow /link?
Disallow /home/news/data/
Disallow /bh

youdaobot

Rule Path
Disallow /baidu
Disallow /s?
Disallow /shifen/
Disallow /homepage/
Disallow /cpro
Disallow /ulink?
Disallow /link?
Disallow /home/news/data/
Disallow /bh

sogou web spider

Rule Path
Disallow /baidu
Disallow /s?
Disallow /shifen/
Disallow /homepage/
Disallow /cpro
Disallow /ulink?
Disallow /link?
Disallow /home/news/data/
Disallow /bh

sogou inst spider

Rule Path
Disallow /baidu
Disallow /s?
Disallow /shifen/
Disallow /homepage/
Disallow /cpro
Disallow /ulink?
Disallow /link?
Disallow /home/news/data/
Disallow /bh

sogou spider2

Rule Path
Disallow /baidu
Disallow /s?
Disallow /shifen/
Disallow /homepage/
Disallow /cpro
Disallow /ulink?
Disallow /link?
Disallow /home/news/data/
Disallow /bh

sogou blog

Rule Path
Disallow /baidu
Disallow /s?
Disallow /shifen/
Disallow /homepage/
Disallow /cpro
Disallow /ulink?
Disallow /link?
Disallow /home/news/data/
Disallow /bh

sogou news spider

Rule Path
Disallow /baidu
Disallow /s?
Disallow /shifen/
Disallow /homepage/
Disallow /cpro
Disallow /ulink?
Disallow /link?
Disallow /home/news/data/
Disallow /bh

sogou orion spider

Rule Path
Disallow /baidu
Disallow /s?
Disallow /shifen/
Disallow /homepage/
Disallow /cpro
Disallow /ulink?
Disallow /link?
Disallow /home/news/data/
Disallow /bh

chinasospider

Rule Path
Disallow /baidu
Disallow /s?
Disallow /shifen/
Disallow /homepage/
Disallow /cpro
Disallow /ulink?
Disallow /link?
Disallow /home/news/data/
Disallow /bh

sosospider

Rule Path
Disallow /baidu
Disallow /s?
Disallow /shifen/
Disallow /homepage/
Disallow /cpro
Disallow /ulink?
Disallow /link?
Disallow /home/news/data/
Disallow /bh

yisouspider

Rule Path
Disallow /baidu
Disallow /s?
Disallow /shifen/
Disallow /homepage/
Disallow /cpro
Disallow /ulink?
Disallow /link?
Disallow /home/news/data/
Disallow /bh

easouspider

Rule Path
Disallow /baidu
Disallow /s?
Disallow /shifen/
Disallow /homepage/
Disallow /cpro
Disallow /ulink?
Disallow /link?
Disallow /home/news/data/
Disallow /bh

*

Rule Path
Disallow /