fretadao.com.br
robots.txt

Robots Exclusion Standard data for fretadao.com.br

Resource Scan

Scan Details

Site Domain fretadao.com.br
Base Domain fretadao.com.br
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-11-03T02:09:10+00:00
Next Scan 2024-11-17T02:09:10+00:00

Last Successful Scan

Scanned2024-09-25T23:23:40+00:00
URL https://fretadao.com.br/robots.txt
Redirect https://www.fretadao.com.br:443/robots.txt
Redirect Domain www.fretadao.com.br
Redirect Base fretadao.com.br
Domain IPs 34.237.244.179, 44.218.1.164
Redirect IPs 108.156.133.34, 108.156.133.57, 108.156.133.62, 108.156.133.73
Response IP 108.156.133.57
Found Yes
Hash c94793f1e5b814e66696f2009c71d1aac4ea83a73b28e56ca978a987ababbf5d
SimHash a331bf8fae57

Groups

*

Rule Path
Disallow /admin/
Disallow /api/
Disallow /contato/fretados-na-minha-regiao
Disallow /fretado-compartilhamento/
Disallow /link-captacao/
Disallow /s/
Disallow /conversa/
Disallow /contratar/
Disallow /invoices/
Disallow /passageiros/
Disallow /contrato-eventual/
Disallow /busca/visualizar-no-mapa
Disallow /fretado/*/indicar
Disallow /fretado/*/trajeto.js
Disallow /passageiros/entrar

Other Records

Field Value
sitemap https://www.fretadao.com.br/sitemap.xml.gz

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file