answers.com
robots.txt
Robots Exclusion Standard data for answers.com
Resource Scan
Scan Details
| Site Domain | answers.com |
| Base Domain | answers.com |
| Scan Status | Ok |
| Last Scan | 2024-05-01T21:36:53+00:00 |
| Next Scan | 2024-05-08T21:36:53+00:00 |
Last Scan
| Scanned | 2024-05-01T21:36:53+00:00 |
| URL | https://answers.com/robots.txt |
| Redirect | https://www.answers.com/robots.txt |
| Redirect Domain | www.answers.com |
| Redirect Base | answers.com |
| Domain IPs | 151.101.0.203, 151.101.128.203, 151.101.192.203, 151.101.64.203 |
| Redirect IPs | 151.101.0.203, 151.101.128.203, 151.101.192.203, 151.101.64.203 |
| Response IP | 199.232.44.203 |
| Found | Yes |
| Hash | 79d90e9e0db86f237f1f7c0164be36ff34dd68b2118fdfcd2ff1dbb07a57b122 |
| SimHash | 2857d2314501 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /api/reactions/ |
| Disallow | /search? |
| Disallow | /redirectSearch? |
| Disallow | /http%3A// |
| Disallow | /api/ |
| Disallow | /nova/ |
| Disallow | /docs/ |
| Disallow | /notifications |
| Disallow | /user/profile |
| Disallow | /u/* |
applebot
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /api/reactions/ |
| Disallow | /search? |
| Disallow | /redirectSearch? |
| Disallow | /http%3A// |
| Disallow | /api/ |
| Disallow | /nova/ |
| Disallow | /docs/ |
| Disallow | /notifications |
| Disallow | /user/profile |
googlebot
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /api/reactions/ |
| Disallow | /search? |
| Disallow | /redirectSearch? |
| Disallow | /http%3A// |
| Disallow | /api/ |
| Disallow | /nova/ |
| Disallow | /docs/ |
| Disallow | /notifications |
| Disallow | /user/profile |
bingbot
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /api/reactions/ |
| Disallow | /search? |
| Disallow | /redirectSearch? |
| Disallow | /http%3A// |
| Disallow | /api/ |
| Disallow | /nova/ |
| Disallow | /docs/ |
| Disallow | /notifications |
| Disallow | /user/profile |
msnbot
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /api/reactions/ |
| Disallow | /search? |
| Disallow | /redirectSearch? |
| Disallow | /http%3A// |
| Disallow | /api/ |
| Disallow | /nova/ |
| Disallow | /docs/ |
| Disallow | /notifications |
| Disallow | /user/profile |
slurp
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /api/reactions/ |
| Disallow | /search? |
| Disallow | /redirectSearch? |
| Disallow | /http%3A// |
| Disallow | /api/ |
| Disallow | /nova/ |
| Disallow | /docs/ |
| Disallow | /notifications |
| Disallow | /user/profile |
facebot
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /api/reactions/ |
| Disallow | /search? |
| Disallow | /redirectSearch? |
| Disallow | /http%3A// |
| Disallow | /api/ |
| Disallow | /nova/ |
| Disallow | /docs/ |
| Disallow | /notifications |
| Disallow | /user/profile |
baiduspider
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /api/reactions/ |
| Disallow | /search? |
| Disallow | /redirectSearch? |
| Disallow | /http%3A// |
| Disallow | /api/ |
| Disallow | /nova/ |
| Disallow | /docs/ |
| Disallow | /notifications |
| Disallow | /user/profile |
sosobot
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /api/reactions/ |
| Disallow | /search? |
| Disallow | /redirectSearch? |
| Disallow | /http%3A// |
| Disallow | /api/ |
| Disallow | /nova/ |
| Disallow | /docs/ |
| Disallow | /notifications |
| Disallow | /user/profile |