empregos.com.br
robots.txt

Robots Exclusion Standard data for empregos.com.br

Resource Scan

Scan Details

Site Domain empregos.com.br
Base Domain empregos.com.br
Scan Status Ok
Last Scan2024-10-22T02:56:59+00:00
Next Scan 2024-11-21T02:56:59+00:00

Last Scan

Scanned2024-10-22T02:56:59+00:00
URL https://empregos.com.br/robots.txt
Redirect https://www.empregos.com.br/robots.txt
Redirect Domain www.empregos.com.br
Redirect Base empregos.com.br
Domain IPs 200.155.10.34
Redirect IPs 170.82.173.30, 170.82.174.30
Response IP 170.82.173.30
Found Yes
Hash 4fa4e06d59899c1c3ac130cf478eb0c87e8e3abb20be58d181561556d0b0a41c
SimHash 146cc8066c33

Groups

*

Rule Path
Disallow /*.axd$
Disallow /bin/
Disallow /pagamento/
Disallow /cancelamento/
Disallow /administracao/
Disallow /m/
Disallow /redir.aspx
Disallow /curriculos/
Disallow /cursos/
Disallow /curso/

jobbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

moget

Rule Path
Disallow /

ichiro

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider vídeo

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

baiduspider-imagem

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /
Disallow /curriculos/web-designer/guarulhos/sp/11993369

Other Records

Field Value
sitemap http://www.empregos.com.br/sitemap-index.xml

Comments

  • Arquivo robots
  • Robos destruidores
  • Sitemap
  • Pedidos de remoção