pixpay168.com
robots.txt
Robots Exclusion Standard data for pixpay168.com
Resource Scan
Scan Details
| Site Domain | pixpay168.com |
| Base Domain | pixpay168.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a server error. |
| Last Scan | 2024-04-07T22:09:35+00:00 |
| Next Scan | 2024-07-06T22:09:35+00:00 |
Last Successful Scan
| Scanned | 2023-11-17T22:07:45+00:00 |
| URL | https://www.pixpay168.com/robots.txt |
| Redirect | http://www.baidu.com/robots.txt |
| Redirect Domain | www.baidu.com |
| Redirect Base | baidu.com |
| Domain IPs | 104.21.84.99, 172.67.191.12, 2606:4700:3031::ac43:bf0c, 2606:4700:3036::6815:5463 |
| Redirect IPs | 45.113.192.101, 45.113.192.102 |
| Response IP | 45.113.192.102 |
| Found | Yes |
| Hash | c28ebeffb7baf9bd6407109e80dc95d87c75c0eaecc20b23884cb33111cc5df0 |
| SimHash | d865dd3c2901 |
Groups
baiduspider
| Rule | Path |
|---|---|
| Disallow | /baidu |
| Disallow | /s? |
| Disallow | /ulink? |
| Disallow | /link? |
| Disallow | /home/news/data/ |
| Disallow | /bh |
googlebot
| Rule | Path |
|---|---|
| Disallow | /baidu |
| Disallow | /s? |
| Disallow | /shifen/ |
| Disallow | /homepage/ |
| Disallow | /cpro |
| Disallow | /ulink? |
| Disallow | /link? |
| Disallow | /home/news/data/ |
| Disallow | /bh |
msnbot
| Rule | Path |
|---|---|
| Disallow | /baidu |
| Disallow | /s? |
| Disallow | /shifen/ |
| Disallow | /homepage/ |
| Disallow | /cpro |
| Disallow | /ulink? |
| Disallow | /link? |
| Disallow | /home/news/data/ |
| Disallow | /bh |
baiduspider-image
| Rule | Path |
|---|---|
| Disallow | /baidu |
| Disallow | /s? |
| Disallow | /shifen/ |
| Disallow | /homepage/ |
| Disallow | /cpro |
| Disallow | /ulink? |
| Disallow | /link? |
| Disallow | /home/news/data/ |
| Disallow | /bh |
youdaobot
| Rule | Path |
|---|---|
| Disallow | /baidu |
| Disallow | /s? |
| Disallow | /shifen/ |
| Disallow | /homepage/ |
| Disallow | /cpro |
| Disallow | /ulink? |
| Disallow | /link? |
| Disallow | /home/news/data/ |
| Disallow | /bh |
sogou web spider
| Rule | Path |
|---|---|
| Disallow | /baidu |
| Disallow | /s? |
| Disallow | /shifen/ |
| Disallow | /homepage/ |
| Disallow | /cpro |
| Disallow | /ulink? |
| Disallow | /link? |
| Disallow | /home/news/data/ |
| Disallow | /bh |
sogou inst spider
| Rule | Path |
|---|---|
| Disallow | /baidu |
| Disallow | /s? |
| Disallow | /shifen/ |
| Disallow | /homepage/ |
| Disallow | /cpro |
| Disallow | /ulink? |
| Disallow | /link? |
| Disallow | /home/news/data/ |
| Disallow | /bh |
sogou spider2
| Rule | Path |
|---|---|
| Disallow | /baidu |
| Disallow | /s? |
| Disallow | /shifen/ |
| Disallow | /homepage/ |
| Disallow | /cpro |
| Disallow | /ulink? |
| Disallow | /link? |
| Disallow | /home/news/data/ |
| Disallow | /bh |
sogou blog
| Rule | Path |
|---|---|
| Disallow | /baidu |
| Disallow | /s? |
| Disallow | /shifen/ |
| Disallow | /homepage/ |
| Disallow | /cpro |
| Disallow | /ulink? |
| Disallow | /link? |
| Disallow | /home/news/data/ |
| Disallow | /bh |
sogou news spider
| Rule | Path |
|---|---|
| Disallow | /baidu |
| Disallow | /s? |
| Disallow | /shifen/ |
| Disallow | /homepage/ |
| Disallow | /cpro |
| Disallow | /ulink? |
| Disallow | /link? |
| Disallow | /home/news/data/ |
| Disallow | /bh |
sogou orion spider
| Rule | Path |
|---|---|
| Disallow | /baidu |
| Disallow | /s? |
| Disallow | /shifen/ |
| Disallow | /homepage/ |
| Disallow | /cpro |
| Disallow | /ulink? |
| Disallow | /link? |
| Disallow | /home/news/data/ |
| Disallow | /bh |
chinasospider
| Rule | Path |
|---|---|
| Disallow | /baidu |
| Disallow | /s? |
| Disallow | /shifen/ |
| Disallow | /homepage/ |
| Disallow | /cpro |
| Disallow | /ulink? |
| Disallow | /link? |
| Disallow | /home/news/data/ |
| Disallow | /bh |
sosospider
| Rule | Path |
|---|---|
| Disallow | /baidu |
| Disallow | /s? |
| Disallow | /shifen/ |
| Disallow | /homepage/ |
| Disallow | /cpro |
| Disallow | /ulink? |
| Disallow | /link? |
| Disallow | /home/news/data/ |
| Disallow | /bh |
yisouspider
| Rule | Path |
|---|---|
| Disallow | /baidu |
| Disallow | /s? |
| Disallow | /shifen/ |
| Disallow | /homepage/ |
| Disallow | /cpro |
| Disallow | /ulink? |
| Disallow | /link? |
| Disallow | /home/news/data/ |
| Disallow | /bh |
easouspider
| Rule | Path |
|---|---|
| Disallow | /baidu |
| Disallow | /s? |
| Disallow | /shifen/ |
| Disallow | /homepage/ |
| Disallow | /cpro |
| Disallow | /ulink? |
| Disallow | /link? |
| Disallow | /home/news/data/ |
| Disallow | /bh |
*
| Rule | Path |
|---|---|
| Disallow | / |