angelinvestmentnetwork.ch
robots.txt
Robots Exclusion Standard data for angelinvestmentnetwork.ch
Resource Scan
Scan Details
Site Domain | angelinvestmentnetwork.ch |
Base Domain | angelinvestmentnetwork.ch |
Scan Status | Ok |
Last Scan | 2024-06-20T22:21:38+00:00 |
Next Scan | 2024-07-04T22:21:38+00:00 |
Last Scan
Scanned | 2024-06-20T22:21:38+00:00 |
URL | https://angelinvestmentnetwork.ch/robots.txt |
Redirect | https://www.angelinvestmentnetwork.ch/robots.txt |
Redirect Domain | www.angelinvestmentnetwork.ch |
Redirect Base | angelinvestmentnetwork.ch |
Domain IPs | 13.42.141.79, 13.43.192.42 |
Redirect IPs | 13.42.141.79, 13.43.192.42 |
Response IP | 13.42.141.79 |
Found | Yes |
Hash | 676b9cdc806cc010e5529d7de70bc9c0127b0eebb7d58b1dc2c337ca3f8921dd |
SimHash | 72784030f0ee |
Groups
*
Rule | Path |
---|---|
Disallow | |
Disallow | /ads/* |
Disallow | /cgi-bin/* |
Disallow | /scripts/* |
Disallow | /admin/* |
Disallow | /tmp/* |
Disallow | /tmp_/* |
Disallow | /plugins/* |
Disallow | /lib/* |
Disallow | /config/* |
Disallow | /proposal-tag/* |
Disallow | /investor_sign_up/* |
Disallow | /entrepreneur_sign_up/* |
Disallow | /unsubscribe/* |
Disallow | /investor/report/* |
Disallow | /proposal/get_document/* |
Disallow | /app_demo/* |
Disallow | /app/* |
Disallow | /appo/* |
Disallow | /business-proposal/location* |
Disallow | /business-proposal/tag* |
Disallow | /business-proposal/country* |
Disallow | /learning/ |
Disallow | /overlay/* |
Disallow | /users/forgot_password |
Disallow | /users/login |
Disallow | /affiliate/register |
Disallow | /entrepreneur/register |
Disallow | /investor/register |
Disallow | /print/investor_legal |
Disallow | /learn/ |
Disallow | /learn |
Disallow | /html/* |
Disallow | /livlist/* |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Warnings
- 2 invalid lines.
Comments