angelinvestmentnetwork.com.ve
robots.txt
Robots Exclusion Standard data for angelinvestmentnetwork.com.ve
Resource Scan
Scan Details
Site Domain | angelinvestmentnetwork.com.ve |
Base Domain | angelinvestmentnetwork.com.ve |
Scan Status | Ok |
Last Scan | 2024-07-02T03:21:49+00:00 |
Next Scan | 2024-07-16T03:21:49+00:00 |
Last Scan
Scanned | 2024-07-02T03:21:49+00:00 |
URL | https://angelinvestmentnetwork.com.ve/robots.txt |
Redirect | https://www.angelinvestmentnetwork.com.ve/robots.txt |
Redirect Domain | www.angelinvestmentnetwork.com.ve |
Redirect Base | angelinvestmentnetwork.com.ve |
Domain IPs | 13.43.245.208, 18.133.93.71 |
Redirect IPs | 13.43.245.208, 18.133.93.71 |
Response IP | 18.133.93.71 |
Found | Yes |
Hash | 49af13b4c11e2f354ec73e9e59dc3f12c9ca54ede31bc809d034ea9f1684c3e2 |
SimHash | 62780020f0ee |
Groups
*
Rule | Path |
---|---|
Disallow | |
Disallow | /ads/* |
Disallow | /cgi-bin/* |
Disallow | /scripts/* |
Disallow | /admin/* |
Disallow | /tmp/* |
Disallow | /tmp_/* |
Disallow | /plugins/* |
Disallow | /lib/* |
Disallow | /config/* |
Disallow | /proposal-tag/* |
Disallow | /investor_sign_up/* |
Disallow | /entrepreneur_sign_up/* |
Disallow | /unsubscribe/* |
Disallow | /investor/report/* |
Disallow | /proposal/get_document/* |
Disallow | /app_demo/* |
Disallow | /app/* |
Disallow | /appo/* |
Disallow | /business-proposal/location* |
Disallow | /business-proposal/tag* |
Disallow | /business-proposal/country* |
Disallow | /learning/ |
Disallow | /overlay/* |
Disallow | /users/forgot_password |
Disallow | /users/login |
Disallow | /affiliate/register |
Disallow | /entrepreneur/register |
Disallow | /investor/register |
Disallow | /print/investor_legal |
Disallow | /learn/ |
Disallow | /learn |
Disallow | /html/* |
Disallow | /livlist/* |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Warnings
- 2 invalid lines.
Comments