divulgavagas.com.br
robots.txt

Robots Exclusion Standard data for divulgavagas.com.br

Resource Scan

Scan Details

Site Domain divulgavagas.com.br
Base Domain divulgavagas.com.br
Scan Status Ok
Last Scan2024-05-24T15:24:12+00:00
Next Scan 2024-05-31T15:24:12+00:00

Last Scan

Scanned2024-05-24T15:24:12+00:00
URL https://divulgavagas.com.br/robots.txt
Redirect https://www.divulgavagas.com.br/robots.txt
Redirect Domain www.divulgavagas.com.br
Redirect Base divulgavagas.com.br
Domain IPs 104.26.6.8, 104.26.7.8, 172.67.70.159, 2606:4700:20::681a:608, 2606:4700:20::681a:708, 2606:4700:20::ac43:469f
Redirect IPs 104.26.6.8, 104.26.7.8, 172.67.70.159, 2606:4700:20::681a:608, 2606:4700:20::681a:708, 2606:4700:20::ac43:469f
Response IP 104.26.7.8
Found Yes
Hash da2190c25edc37e918fbe52b13bf683990206820ebe7cf3e0a0e7246f65ab010
SimHash 6b76b2f556f0

Groups

*

Rule Path
Allow /
Allow /ads.txt

googlebot
googlebot-news
googlebot-image/1.0
googlebot-video/1.0
googlebot-mobile
adsbot-google
googleweblight
google-searchbyimage
googlebot-image
mediapartners-google
bingbot
bingpreview
msnbot
msnbot-media
adidxbot
linkedinbot
*

Rule Path
Disallow /homologacao
Disallow /novoDivulga
Disallow /paginacao
Disallow /paginacao-bne
Disallow /admqwert
Disallow /vaga/
Disallow /envioCurriculo
Disallow /*.doc$
Disallow /404
Disallow /204
Disallow /cdn-cgi
Allow /avisoBNE
Allow /avisoBNE/
Allow /envioCurriculo
Allow /envioCurriculo/
Allow /aviso

Other Records

Field Value
sitemap https://www.divulgavagas.com.br/sitemap.xml
sitemap https://www.divulgavagas.com.br/post-sitemap.xml
sitemap https://www.divulgavagas.com.br/post-sitemap-bing.xml

Warnings

  • `host` is not a known field.