jobs.readysethire.com
robots.txt
Robots Exclusion Standard data for jobs.readysethire.com
Resource Scan
Scan Details
Site Domain | jobs.readysethire.com |
Base Domain | readysethire.com |
Scan Status | Ok |
Last Scan | 2024-11-03T07:11:20+00:00 |
Next Scan | 2024-12-03T07:11:20+00:00 |
Last Scan
Scanned | 2024-11-03T07:11:20+00:00 |
URL | https://jobs.readysethire.com/robots.txt |
Domain IPs | 108.157.254.105, 108.157.254.23, 108.157.254.59, 108.157.254.78 |
Response IP | 108.157.254.105 |
Found | Yes |
Hash | 39f0ff426bff6dc0e5e22f1b505449f877a7ed1141198298e558621cdf55b7e7 |
SimHash | 691670f051d4 |
Groups
*
googlebot
bingbot
slurp
duckduckbot
baiduspider
ccbot
yandexbot
sogou
exabot
seznambot
qwantify
mojeekbot
petalbot
Rule | Path |
---|---|
Allow | / |
Disallow | /*?*clid=* |
Disallow | /*?*clt=* |
Disallow | /*?*session=* |
Disallow | /*?*landing=* |
Disallow | /*?*c0=* |
Disallow | /*?*c1=* |
Disallow | /*?*c2=* |
Disallow | /*?*c3=* |
Disallow | /*?*c4=* |
Disallow | /*?*c5=* |
Disallow | /*?*c6=* |
Disallow | /*?*c7=* |
Disallow | /*?*c8=* |
Disallow | /*?*c9=* |
Disallow | /*?*gclid=* |
Disallow | /*?*msclkid=* |
Disallow | /*?*fbclid=* |
Disallow | /*?*bzclid=* |
Disallow | /*?*wbraid=* |
Disallow | /*?*jcsaclid=* |
Disallow | /*?*jbclid=* |
Disallow | /*?*adqclid=* |
Disallow | /*?*jcclid=* |
Disallow | /*?*acclid=* |
Disallow | /*?*trclid=* |