datocapital.nl
robots.txt
Robots Exclusion Standard data for datocapital.nl
Resource Scan
Scan Details
Site Domain | datocapital.nl |
Base Domain | datocapital.nl |
Scan Status | Ok |
Last Scan | 2024-09-21T19:31:09+00:00 |
Next Scan | 2024-09-28T19:31:09+00:00 |
Last Scan
Scanned | 2024-09-21T19:31:09+00:00 |
URL | https://datocapital.nl/robots.txt |
Domain IPs | 5.101.140.254 |
Response IP | 5.101.140.254 |
Found | Yes |
Hash | d5c30f2e987c6b499c5422ff655d72c17a04181beb4e078877c07c02f036c810 |
SimHash | 148b5ea37e01 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /uk/executives/list-*.html |
Disallow | /es/executives/list-*.html |
Disallow | /lu/executives/list-*.html |
Disallow | /nl/executives/list-*.html |
Disallow | /uk/ejecutivos/lista-*.html |
Disallow | /es/ejecutivos/lista-*.html |
Disallow | /lu/ejecutivos/lista-*.html |
Disallow | /nl/ejecutivos/lista-*.html |
Disallow | /6582961/* |
Disallow | /listado-empresas-*.html |
Disallow | /company-listing-*.html |
Disallow | /uk/empresas/listado-empresas-*.html |
Disallow | /uk/companies/company-listing-*.html |
Disallow | /uk/geo/* |
Disallow | /es/geo/* |
Disallow | /lu/geo/* |
Disallow | /vg/geo/* |
Disallow | /pa/geo/* |
Disallow | /ky/geo/* |
Disallow | /nl/geo/* |
Disallow | /gi/geo/* |
Disallow | /uk/streets/* |
Disallow | /es/streets/* |
Disallow | /lu/streets/* |
Disallow | /vg/streets/* |
Disallow | /pa/streets/* |
Disallow | /ky/streets/* |
Disallow | /nl/streets/* |
Disallow | /gi/streets/* |
Disallow | /uk/calles/* |
Disallow | /es/calles/* |
Disallow | /lu/calles/* |
Disallow | /vg/calles/* |
Disallow | /pa/calles/* |
Disallow | /ky/calles/* |
Disallow | /nl/calles/* |
Disallow | /gi/calles/* |
Disallow | /uk/region/* |
Disallow | /es/region/* |
Disallow | /lu/region/* |
Disallow | /vg/region/* |
Disallow | /pa/region/* |
Disallow | /ky/region/* |
Disallow | /nl/region/* |
Disallow | /gi/region/* |
Disallow | /EbulletinControl |
Disallow | /isn/* |
Disallow | /buy_* |
Disallow | /buy.* |
Disallow | /comprar_* |
Disallow | /comprar.* |
Disallow | /sval.jsp |
Comments