jus.com.br
robots.txt

Robots Exclusion Standard data for jus.com.br

Resource Scan

Scan Details

Site Domain jus.com.br
Base Domain jus.com.br
Scan Status Ok
Last Scan2024-06-23T16:19:48+00:00
Next Scan 2024-06-30T16:19:48+00:00

Last Scan

Scanned2024-06-23T16:19:48+00:00
URL https://jus.com.br/robots.txt
Domain IPs 104.26.10.241, 104.26.11.241, 172.67.69.97, 2606:4700:20::681a:af1, 2606:4700:20::681a:bf1, 2606:4700:20::ac43:4561
Response IP 104.26.11.241
Found Yes
Hash 23b3f40b5d948172809f879759355e9064952dce325ea8142cd2f2f23b438c09
SimHash 631599c47671

Groups

*

Rule Path
Disallow /forum/conta/*
Disallow /duvidas/conta/*
Disallow /extra%20bsb%20norte/*
Disallow /auth/facebook
Disallow /reset
Disallow /duvidas/292656*
Disallow /duvidas/310155*
Disallow /duvidas/320019*
Disallow /duvidas/622978*
Disallow /duvidas/65088*
Disallow /1*
Disallow /2*
Disallow /3*
Disallow /4*
Disallow /5*
Disallow /6*
Disallow /7*
Disallow /8*
Disallow /9*
Allow /

Other Records

Field Value
sitemap https://jus.com.br/sitemaps/sitemap.xml.gz
sitemap https://jus.com.br/sitemaps/tudo/sitemap.xml.gz
sitemap https://jus.com.br/sitemaps/profiles/sitemap.xml.gz
sitemap https://jus.com.br/sitemaps/sections/sitemap.xml.gz
sitemap https://jus.com.br/sitemaps/questions/sitemap.xml.gz
sitemap https://ajuda.jus.com.br/sitemap.xml

Comments

  • See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file