Log In Sign Up

randstad.pt
robots.txt

Robots Exclusion Standard data for randstad.pt

Resource Scan

Scan Details

Site Domain randstad.pt
Base Domain randstad.pt
Scan Status Ok
Last Scan2024-05-31T14:26:12+00:00
Next Scan 2024-06-30T14:26:12+00:00

Last Scan

Scanned2024-05-31T14:26:12+00:00
URL https://randstad.pt/robots.txt
Redirect https://www.randstad.pt:443/robots.txt
Redirect Domain www.randstad.pt
Redirect Base randstad.pt
Domain IPs 18.201.6.215, 52.211.215.71
Redirect IPs 18.154.7.42, 18.154.7.72, 18.154.7.78, 18.154.7.98, 2600:9000:2755:1a00:2:a3dd:51c0:93a1, 2600:9000:2755:8c00:2:a3dd:51c0:93a1, 2600:9000:2755:a000:2:a3dd:51c0:93a1, 2600:9000:2755:b000:2:a3dd:51c0:93a1, 2600:9000:2755:c200:2:a3dd:51c0:93a1, 2600:9000:2755:d400:2:a3dd:51c0:93a1, 2600:9000:2755:d600:2:a3dd:51c0:93a1, 2600:9000:2755:d800:2:a3dd:51c0:93a1
Response IP 108.156.133.117
Found Yes
Hash 3c3b0c4556413a0f33f63c68132fc7e54541710cbea9229d904a7638cccdcdba
SimHash 79119012e2fa

Groups

*

Rule Path
Allow /
Disallow /*/km-
Disallow /*/postcode-
Disallow /*/sa-
Disallow /*/qt-
Disallow /*search%3D
Disallow /*search-app/demo/empregos/
Disallow /*empregos/mvp/
Disallow /empregos/*%2C*/
Disallow /*/sd-
Disallow /*/sh-
Disallow /*/sm-
Disallow /*/?id=*
Disallow /*/mpage-
Disallow /empregos/candidatura/
Disallow /*/?c-career-advice
Disallow /*/?c-category
Disallow /*/?c-wf360-category
Disallow /*/?c-tags
Disallow /*/?c-press-category
Disallow /taxonomy/term/
Disallow /node/
Disallow /*/node/
Back to top

Other Records

Field Value
sitemap https://www.randstad.pt/sitemaps/sitemap.xml
Back to top

Comments

  • Exclude | SEO
  • Job Search
  • Job Details
  • Blog
  • Exclude | Other
  • Node URLs
  • XML Sitemap
Back to top