workingscribe.com
robots.txt
Robots Exclusion Standard data for workingscribe.com
Resource Scan
Scan Details
Site Domain | workingscribe.com |
Base Domain | workingscribe.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't connect to server. |
Last Scan | 2025-09-14T09:43:44+00:00 |
Next Scan | 2025-10-14T09:43:44+00:00 |
Last Successful Scan
Scanned | 2025-07-24T08:00:40+00:00 |
URL | https://workingscribe.com/robots.txt |
Redirect | https://www.workingscribe.com/robots.txt |
Redirect Domain | www.workingscribe.com |
Redirect Base | workingscribe.com |
Domain IPs | 38.177.29.102 |
Redirect IPs | 38.177.29.102 |
Response IP | 38.177.29.102 |
Found | Yes |
Hash | c28ebeffb7baf9bd6407109e80dc95d87c75c0eaecc20b23884cb33111cc5df0 |
SimHash | d865dd3c2901 |
Groups
baiduspider
Rule | Path |
---|---|
Disallow | /baidu |
Disallow | /s? |
Disallow | /ulink? |
Disallow | /link? |
Disallow | /home/news/data/ |
Disallow | /bh |
googlebot
Rule | Path |
---|---|
Disallow | /baidu |
Disallow | /s? |
Disallow | /shifen/ |
Disallow | /homepage/ |
Disallow | /cpro |
Disallow | /ulink? |
Disallow | /link? |
Disallow | /home/news/data/ |
Disallow | /bh |
msnbot
Rule | Path |
---|---|
Disallow | /baidu |
Disallow | /s? |
Disallow | /shifen/ |
Disallow | /homepage/ |
Disallow | /cpro |
Disallow | /ulink? |
Disallow | /link? |
Disallow | /home/news/data/ |
Disallow | /bh |
baiduspider-image
Rule | Path |
---|---|
Disallow | /baidu |
Disallow | /s? |
Disallow | /shifen/ |
Disallow | /homepage/ |
Disallow | /cpro |
Disallow | /ulink? |
Disallow | /link? |
Disallow | /home/news/data/ |
Disallow | /bh |
youdaobot
Rule | Path |
---|---|
Disallow | /baidu |
Disallow | /s? |
Disallow | /shifen/ |
Disallow | /homepage/ |
Disallow | /cpro |
Disallow | /ulink? |
Disallow | /link? |
Disallow | /home/news/data/ |
Disallow | /bh |
sogou web spider
Rule | Path |
---|---|
Disallow | /baidu |
Disallow | /s? |
Disallow | /shifen/ |
Disallow | /homepage/ |
Disallow | /cpro |
Disallow | /ulink? |
Disallow | /link? |
Disallow | /home/news/data/ |
Disallow | /bh |
sogou inst spider
Rule | Path |
---|---|
Disallow | /baidu |
Disallow | /s? |
Disallow | /shifen/ |
Disallow | /homepage/ |
Disallow | /cpro |
Disallow | /ulink? |
Disallow | /link? |
Disallow | /home/news/data/ |
Disallow | /bh |
sogou spider2
Rule | Path |
---|---|
Disallow | /baidu |
Disallow | /s? |
Disallow | /shifen/ |
Disallow | /homepage/ |
Disallow | /cpro |
Disallow | /ulink? |
Disallow | /link? |
Disallow | /home/news/data/ |
Disallow | /bh |
sogou blog
Rule | Path |
---|---|
Disallow | /baidu |
Disallow | /s? |
Disallow | /shifen/ |
Disallow | /homepage/ |
Disallow | /cpro |
Disallow | /ulink? |
Disallow | /link? |
Disallow | /home/news/data/ |
Disallow | /bh |
sogou news spider
Rule | Path |
---|---|
Disallow | /baidu |
Disallow | /s? |
Disallow | /shifen/ |
Disallow | /homepage/ |
Disallow | /cpro |
Disallow | /ulink? |
Disallow | /link? |
Disallow | /home/news/data/ |
Disallow | /bh |
sogou orion spider
Rule | Path |
---|---|
Disallow | /baidu |
Disallow | /s? |
Disallow | /shifen/ |
Disallow | /homepage/ |
Disallow | /cpro |
Disallow | /ulink? |
Disallow | /link? |
Disallow | /home/news/data/ |
Disallow | /bh |
chinasospider
Rule | Path |
---|---|
Disallow | /baidu |
Disallow | /s? |
Disallow | /shifen/ |
Disallow | /homepage/ |
Disallow | /cpro |
Disallow | /ulink? |
Disallow | /link? |
Disallow | /home/news/data/ |
Disallow | /bh |
sosospider
Rule | Path |
---|---|
Disallow | /baidu |
Disallow | /s? |
Disallow | /shifen/ |
Disallow | /homepage/ |
Disallow | /cpro |
Disallow | /ulink? |
Disallow | /link? |
Disallow | /home/news/data/ |
Disallow | /bh |
yisouspider
Rule | Path |
---|---|
Disallow | /baidu |
Disallow | /s? |
Disallow | /shifen/ |
Disallow | /homepage/ |
Disallow | /cpro |
Disallow | /ulink? |
Disallow | /link? |
Disallow | /home/news/data/ |
Disallow | /bh |
easouspider
Rule | Path |
---|---|
Disallow | /baidu |
Disallow | /s? |
Disallow | /shifen/ |
Disallow | /homepage/ |
Disallow | /cpro |
Disallow | /ulink? |
Disallow | /link? |
Disallow | /home/news/data/ |
Disallow | /bh |
*
Rule | Path |
---|---|
Disallow | / |