fretebras.com.br
robots.txt

Robots Exclusion Standard data for fretebras.com.br

Resource Scan

Scan Details

Site Domain fretebras.com.br
Base Domain fretebras.com.br
Scan Status Ok
Last Scan2024-06-23T05:43:14+00:00
Next Scan 2024-07-07T05:43:14+00:00

Last Scan

Scanned2024-06-23T05:43:14+00:00
URL https://fretebras.com.br/robots.txt
Redirect https://www.fretebras.com.br/robots.txt
Redirect Domain www.fretebras.com.br
Redirect Base fretebras.com.br
Domain IPs 23.54.155.70, 23.54.155.82, 2600:1413:a000::17ca:2172, 2600:1413:a000::17ca:2191
Redirect IPs 23.54.155.170, 23.54.155.178, 2600:1413:a000::17ca:2172, 2600:1413:a000::17ca:2191
Response IP 184.27.123.120
Found Yes
Hash 2882e2d9c566d1380c8609be87e4675968ba568b41ada24ab09ef09f7162d769
SimHash d45ea35e8b47

Groups

*

Rule Path
Allow /
Disallow /fretes/1*
Disallow /fretes/2*
Disallow /fretes/3*
Disallow /fretes/4*
Disallow /fretes/5*
Disallow /fretes/6*
Disallow /fretes/7*
Disallow /fretes/8*
Disallow /fretes/9*
Disallow /fretes/*/1*
Disallow /fretes/*/2*
Disallow /fretes/*/3*
Disallow /fretes/*/4*
Disallow /fretes/*/5*
Disallow /fretes/*/6*
Disallow /fretes/*/7*
Disallow /fretes/*/8*
Disallow /fretes/*/9*

Comments

  • Excluindo as páginas que contém paginação
  • https://developers.google.com/search/docs/crawling-indexing/robots/robots_txt#url-matching-based-on-path-values