jetcost.com.br
robots.txt
Robots Exclusion Standard data for jetcost.com.br
Resource Scan
Scan Details
Site Domain | jetcost.com.br |
Base Domain | jetcost.com.br |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-09-24T09:58:39+00:00 |
Next Scan | 2024-10-01T09:58:39+00:00 |
Last Successful Scan
Scanned | 2022-11-20T06:11:14+00:00 |
URL | https://jetcost.com.br/robots.txt |
Redirect | https://www.jetcost.com.br/robots.txt |
Redirect Domain | www.jetcost.com.br |
Redirect Base | jetcost.com.br |
Response IP | 104.18.1.241, 104.18.0.241 |
Found | Yes |
Hash | e3823adf872c18edcacf8b36e2f26f2055e5b454679f6d351201a28d1bc414b8 |
SimHash | 6e18ddd04f12 |
Groups
*
Rule | Path |
---|---|
Disallow | /voos/resultados/**/*/* |
Disallow | /voos/pesquisa |
Disallow | /voos/reader |
Disallow | /voos/gateway |
Disallow | /voos/gatewayclickout |
Disallow | /voos/re-search |
Disallow | /voos/re-search-params |
Disallow | /voos/gatewaycug |
Disallow | /aluguel-de-carros/results/**/** |
Disallow | /aluguel-de-carros/search |
Disallow | /aluguel-de-carros/reader |
Disallow | /aluguel-de-carros/gateway |
Disallow | /aluguel-de-carros/gatewayclickout |
Disallow | /api/** |
Disallow | /wait.php |
Other Records
Field | Value |
---|---|
sitemap | https://www.jetcost.com.br/sitemap.xml |