cursos.brazcubas.edu.br
robots.txt

Robots Exclusion Standard data for cursos.brazcubas.edu.br

Resource Scan

Scan Details

Site Domain cursos.brazcubas.edu.br
Base Domain brazcubas.edu.br
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan5/10/2025, 2:49:29 AM
Next Scan 7/9/2025, 2:49:29 AM

Last Successful Scan

Scanned2/17/2025, 12:31:57 AM
URL https://cursos.brazcubas.edu.br/robots.txt
Domain IPs 23.209.46.76, 23.209.46.80, 2600:1413:b000:1e::17d1:2e4c, 2600:1413:b000:1e::17d1:2e50
Response IP 23.45.207.171
Found Yes
Hash 81899e1acd7d645b601a99992640c7705244839c53a79c623f8ca529ce0b1a7e
SimHash e418cd074dd0

Groups

*

Rule Path
Disallow /img/*
Disallow /account/*
Disallow /login/*
Disallow /checkout/*
Disallow /busca/*
Disallow /quick-view/*
Disallow /espiar/*
Disallow /buscapagina/*

Comments

  • Disallow all crawlers access to certain pages.

Warnings

  • 1 invalid line.