Log In Sign Up

randstad.it
robots.txt

Robots Exclusion Standard data for randstad.it

Resource Scan

Scan Details

Site Domain randstad.it
Base Domain randstad.it
Scan Status Ok
Last Scan2024-05-04T17:23:52+00:00
Next Scan 2024-06-03T17:23:52+00:00

Last Scan

Scanned2024-05-04T17:23:52+00:00
URL https://randstad.it/robots.txt
Redirect https://www.randstad.it/robots.txt
Redirect Domain www.randstad.it
Redirect Base randstad.it
Domain IPs 18.155.68.60, 18.155.68.61, 18.155.68.80, 18.155.68.87, 2600:9000:23d2:2600:e:26b4:3f80:93a1, 2600:9000:23d2:4200:e:26b4:3f80:93a1, 2600:9000:23d2:5000:e:26b4:3f80:93a1, 2600:9000:23d2:5e00:e:26b4:3f80:93a1, 2600:9000:23d2:7400:e:26b4:3f80:93a1, 2600:9000:23d2:8000:e:26b4:3f80:93a1, 2600:9000:23d2:f200:e:26b4:3f80:93a1, 2600:9000:23d2:fc00:e:26b4:3f80:93a1
Redirect IPs 18.155.68.60, 18.155.68.61, 18.155.68.80, 18.155.68.87, 2600:9000:219a:1a00:e:26b4:3f80:93a1, 2600:9000:219a:6c00:e:26b4:3f80:93a1, 2600:9000:219a:7400:e:26b4:3f80:93a1, 2600:9000:219a:a000:e:26b4:3f80:93a1, 2600:9000:219a:ae00:e:26b4:3f80:93a1, 2600:9000:219a:d200:e:26b4:3f80:93a1, 2600:9000:219a:ee00:e:26b4:3f80:93a1, 2600:9000:219a:f400:e:26b4:3f80:93a1
Response IP 18.155.68.61
Found Yes
Hash bb705246fab735fe6e3916390c6cade7bdb39d8552e5eb78c86c8da393ebc47e
SimHash 39059212abfa

Groups

*

Rule Path
Allow /
Disallow /*/km-
Disallow /*/postcode-
Disallow /*/sa-
Disallow /*/qt-
Disallow /*search%3D
Disallow /*search-app/demo/offerte-lavoro/
Disallow /*offerte-lavoro/mvp/
Disallow /offerte-lavoro/*%2C*/
Disallow /*/sd-
Disallow /*/sh-
Disallow /*/sm-
Disallow /*/?id=*
Disallow /*/mpage-
Disallow /*/apply/
Disallow /*/?c-career-advice
Disallow /*/?c-category
Disallow /*/?c-wf360-category
Disallow /*/?c-tags
Disallow /*/?c-press-category
Disallow /taxonomy/term/
Disallow /*/profile-
Disallow /node/
Disallow /*/node/
Back to top

Other Records

Field Value
sitemap https://www.randstad.it/sitemaps/sitemap.xml
Back to top

Comments

  • Exclude | SEO
  • Job Search
  • Job Details
  • Blog
  • CMS
  • Exclude | Other
  • Node URLs
  • XML Sitemap
Back to top