jobs.readysethire.com
robots.txt

Robots Exclusion Standard data for jobs.readysethire.com

Resource Scan

Scan Details

Site Domain jobs.readysethire.com
Base Domain readysethire.com
Scan Status Ok
Last Scan2024-11-03T07:11:20+00:00
Next Scan 2024-12-03T07:11:20+00:00

Last Scan

Scanned2024-11-03T07:11:20+00:00
URL https://jobs.readysethire.com/robots.txt
Domain IPs 108.157.254.105, 108.157.254.23, 108.157.254.59, 108.157.254.78
Response IP 108.157.254.105
Found Yes
Hash 39f0ff426bff6dc0e5e22f1b505449f877a7ed1141198298e558621cdf55b7e7
SimHash 691670f051d4

Groups

*
googlebot
bingbot
slurp
duckduckbot
baiduspider
ccbot
yandexbot
sogou
exabot
seznambot
qwantify
mojeekbot
petalbot

Rule Path
Allow /
Disallow /*?*clid=*
Disallow /*?*clt=*
Disallow /*?*session=*
Disallow /*?*landing=*
Disallow /*?*c0=*
Disallow /*?*c1=*
Disallow /*?*c2=*
Disallow /*?*c3=*
Disallow /*?*c4=*
Disallow /*?*c5=*
Disallow /*?*c6=*
Disallow /*?*c7=*
Disallow /*?*c8=*
Disallow /*?*c9=*
Disallow /*?*gclid=*
Disallow /*?*msclkid=*
Disallow /*?*fbclid=*
Disallow /*?*bzclid=*
Disallow /*?*wbraid=*
Disallow /*?*jcsaclid=*
Disallow /*?*jbclid=*
Disallow /*?*adqclid=*
Disallow /*?*jcclid=*
Disallow /*?*acclid=*
Disallow /*?*trclid=*

mediapartners-google
google-display-ads-bot
adidxbot
adsbot-google
adsbot-google-mobile
bingads
facebot
linkedinbot
twitterbot
slackbot
whatsapp
telegrambot
pinterest

Rule Path
Allow /