Log In Sign Up

randstad.in
robots.txt

Robots Exclusion Standard data for randstad.in

Resource Scan

Scan Details

Site Domain randstad.in
Base Domain randstad.in
Scan Status Ok
Last Scan2024-10-28T14:38:56+00:00
Next Scan 2024-11-27T14:38:56+00:00

Last Scan

Scanned2024-10-28T14:38:56+00:00
URL https://randstad.in/robots.txt
Redirect https://www.randstad.in/robots.txt
Redirect Domain www.randstad.in
Redirect Base randstad.in
Domain IPs 108.157.254.67, 108.157.254.71, 108.157.254.79, 108.157.254.97, 2600:9000:2753:1000:1e:fe5d:5700:93a1, 2600:9000:2753:1200:1e:fe5d:5700:93a1, 2600:9000:2753:1e00:1e:fe5d:5700:93a1, 2600:9000:2753:7a00:1e:fe5d:5700:93a1, 2600:9000:2753:8200:1e:fe5d:5700:93a1, 2600:9000:2753:8c00:1e:fe5d:5700:93a1, 2600:9000:2753:e200:1e:fe5d:5700:93a1, 2600:9000:2753:f600:1e:fe5d:5700:93a1
Redirect IPs 108.157.254.67, 108.157.254.71, 108.157.254.79, 108.157.254.97, 2600:9000:2753:2600:1e:fe5d:5700:93a1, 2600:9000:2753:3a00:1e:fe5d:5700:93a1, 2600:9000:2753:4400:1e:fe5d:5700:93a1, 2600:9000:2753:5000:1e:fe5d:5700:93a1, 2600:9000:2753:8600:1e:fe5d:5700:93a1, 2600:9000:2753:b400:1e:fe5d:5700:93a1, 2600:9000:2753:bc00:1e:fe5d:5700:93a1, 2600:9000:2753:c800:1e:fe5d:5700:93a1
Response IP 108.157.254.97
Found Yes
Hash 8095ec1ed24e68048a8a6799e489080375d77355c19119bd9a8cd9ccd8183009
SimHash 751dda52e3f2

Groups

*

Rule Path
Allow /
Disallow /*/km-
Disallow /*/postcode-
Disallow /*/sa-
Disallow /*/qt-
Disallow /*search%3D
Disallow /*search-app/demo/jobs/
Disallow /*jobs/mvp/
Disallow /jobs/*%2C*/
Disallow /*/sd-
Disallow /*/sh-
Disallow /*/sm-
Disallow /*/?id=*
Disallow /*/mpage-
Disallow /*/no-data
Disallow /*/apply/
Disallow /*/?c-career-advice
Disallow /*/?c-category
Disallow /*/?c-wf360-category
Disallow /*/?c-tags
Disallow /*/?c-press-category
Disallow /taxonomy/term/
Disallow /*/profile-
Disallow /node/
Disallow /*/node/
Back to top

Other Records

Field Value
sitemap https://www.randstad.in/sitemaps/sitemap.xml
Back to top

Comments

  • Exclude | SEO
  • Job Search
  • Job Details
  • Blog
  • CMS
  • Exclude | Other
  • Node URLs
  • XML Sitemap
Back to top