diariogoianiense.com.br
robots.txt

Robots Exclusion Standard data for diariogoianiense.com.br

Resource Scan

Scan Details

Site Domain diariogoianiense.com.br
Base Domain diariogoianiense.com.br
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-18T08:25:00+00:00
Next Scan 2024-11-17T08:25:00+00:00

Last Successful Scan

Scanned2024-07-21T08:22:24+00:00
URL https://diariogoianiense.com.br/robots.txt
Redirect https://www.diariogoianiense.com.br/robots.txt
Redirect Domain www.diariogoianiense.com.br
Redirect Base diariogoianiense.com.br
Domain IPs 191.6.210.219, 2804:10:8002::210:219
Redirect IPs 191.6.210.219, 2804:10:8002::210:219
Response IP 191.6.210.219
Found Yes
Hash fd29ead0dd1660f931aa42dc07c39e1d3501ba4bc880f5f79253fb015b848c7e
SimHash 69507e0571f5

Groups

googlebot

Rule Path
Allow *

feedfetcher-google

Rule Path
Allow *

bingbot

Rule Path
Allow *

slurp

Rule Path
Allow *

facebot

Rule Path
Allow *

facebookexternalhit

Rule Path
Allow *

ia_archiver

Rule Path
Allow *

twitterbot

Rule Path
Allow *

*

Rule Path
Disallow /cgi-bin/
Disallow /Painel/
Disallow /meu-painel/
Disallow /arquivos/
Disallow /erros/
Disallow /includes/
Disallow /uploads/
Disallow /facebook/
Disallow /gateway/
Disallow /assets/
Disallow /instalar/
Disallow /Update_sys/
Disallow /wusage
Disallow /vendor/