randstad.com.br
robots.txt

Robots Exclusion Standard data for randstad.com.br

Resource Scan

Scan Details

Site Domain randstad.com.br
Base Domain randstad.com.br
Scan Status Ok
Last Scan2024-09-08T14:42:41+00:00
Next Scan 2024-10-08T14:42:41+00:00

Last Scan

Scanned2024-09-08T14:42:41+00:00
URL https://randstad.com.br/robots.txt
Redirect https://www.randstad.com.br:443/robots.txt
Redirect Domain www.randstad.com.br
Redirect Base randstad.com.br
Domain IPs 3.225.88.152, 3.229.199.252
Redirect IPs 13.225.4.108, 13.225.4.113, 13.225.4.28, 13.225.4.89, 2600:9000:21b4:400:11:d7b2:d380:93a1, 2600:9000:21b4:6400:11:d7b2:d380:93a1, 2600:9000:21b4:8200:11:d7b2:d380:93a1, 2600:9000:21b4:a200:11:d7b2:d380:93a1, 2600:9000:21b4:a800:11:d7b2:d380:93a1, 2600:9000:21b4:aa00:11:d7b2:d380:93a1, 2600:9000:21b4:bc00:11:d7b2:d380:93a1, 2600:9000:21b4:d200:11:d7b2:d380:93a1
Response IP 13.225.4.108
Found Yes
Hash 8b065616b4365f1cdc0a64bd379824f170fc64db90a7ab20f53877bd8d522f60
SimHash fb0d9a12ebf8

Groups

*

Rule Path
Allow /
Disallow /*/km-
Disallow /*/postcode-
Disallow /*/sa-
Disallow /*/qt-
Disallow /*search%3D
Disallow /*search-app/demo/jobs/
Disallow /*vagas/mvp/
Disallow /vagas/*%2C*/
Disallow /*/sd-
Disallow /*/sh-
Disallow /*/sm-
Disallow /*/?id=*
Disallow /*/mpage-
Disallow /*/apply/
Disallow /*/?c-career-advice
Disallow /*/?c-category
Disallow /*/?c-wf360-category
Disallow /*/?c-tags
Disallow /*/?c-press-category
Disallow /taxonomy/term/
Disallow /*/profile-
Disallow /node/
Disallow /*/node/

Other Records

Field Value
sitemap https://www.randstad.com.br/sitemaps/sitemap.xml

Comments

  • Exclude | SEO
  • Job Search
  • Job Details
  • Blog
  • CMS
  • Exclude | Other
  • Node URLs
  • XML Sitemap