algebra.com
robots.txt
Robots Exclusion Standard data for algebra.com
Resource Scan
Scan Details
| Site Domain | algebra.com |
| Base Domain | algebra.com |
| Scan Status | Ok |
| Last Scan | 2024-10-12T01:14:29+00:00 |
| Next Scan | 2024-10-19T01:14:29+00:00 |
Last Scan
| Scanned | 2024-10-12T01:14:29+00:00 |
| URL | https://www.algebra.com/robots.txt |
| Domain IPs | 104.196.52.56 |
| Response IP | 104.196.52.56 |
| Found | Yes |
| Hash | e19aa2229d65374840c333c348fe3f2d0b64969d6cd414c6d8b18b5bf480f7aa |
| SimHash | 023559106ff0 |
Groups
googlebot
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /t/ |
| Disallow | /cgi-bin/embed-solution.mpl* |
| Disallow | /cgi-bin/show-question-source.mpl* |
| Disallow | /algebra/about/history/*%3A* |
| Disallow | /algebra/about/history/*.wikipedia |
| Disallow | /algebra/about/history/*.wikibook |
| Allow | /algebra/about/history/ |
| Disallow | /index.php/ |
| Disallow | /index.php* |
| Disallow | /cgi-bin/mltapi.mpl* |
| Disallow | /tutors/faq.mpl* |
| Disallow | *.wikipedia |
| Disallow | /HyperNews/ |
| Disallow | /~pavlovd/amazon/apf4/ |
| Disallow | /~pavlovd/wiki/ |
| Disallow | /~pavlovd/ |
| Disallow | /~assgm/ |
| Disallow | /EssayExchange/ |
| Disallow | /cgi-bin/webster.mpl* |
*
| Rule | Path |
|---|---|
| Disallow | /t/ |
| Disallow | /cgi-bin/mltapi.mpl |
| Disallow | /HyperNews/ |
| Disallow | /algebra/about/history/ |
| Disallow | /cgi-bin/webster.mpl |
| Disallow | /misc/denybots/ |
| Disallow | /misc/denybots |
| Disallow | /EssayExchange/add_essay.mpl |
| Disallow | /index.php/ |
| Disallow | /~pavlovd/ |
| Disallow | /EssayExchange/ |
| Disallow | /cgi-bin/webster.mpl* |
| Disallow | *.wikipedia |
bingbot
| Rule | Path |
|---|---|
| Disallow | /t/ |
| Disallow | /cgi-bin/mltapi.mpl |
| Disallow | /HyperNews/ |
| Disallow | /algebra/about/history/ |
| Disallow | /cgi-bin/webster.mpl |
| Disallow | /misc/denybots/ |
| Disallow | /misc/denybots |
| Disallow | /EssayExchange/add_essay.mpl |
| Disallow | /index.php/ |
| Disallow | /~pavlovd/ |
| Disallow | /EssayExchange/ |
| Disallow | /cgi-bin/webster.mpl* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
Warnings
- 3 invalid lines.
Comments