Log In Sign Up

hr.mcleanco.com
robots.txt

Robots Exclusion Standard data for hr.mcleanco.com

Resource Scan

Scan Details

Site Domain hr.mcleanco.com
Base Domain mcleanco.com
Scan Status Ok
Last Scan2024-10-03T03:58:36+00:00
Next Scan 2024-11-02T03:58:36+00:00

Last Scan

Scanned2024-10-03T03:58:36+00:00
URL https://hr.mcleanco.com/robots.txt
Domain IPs 34.243.122.175, 52.19.238.88
Response IP 52.19.238.88
Found Yes
Hash 25730d57a697dddc916e5de07e800b96e32da16cf363046ab63d204f30914a30
SimHash 621c8964c383

Groups

*

Rule Path
Disallow /xml/
Disallow /search/
Disallow /research/search/
Disallow /auth/*
Disallow /sso/*
Disallow /tags/*

femtosearchbot

Rule Path
Disallow *

diffbot

Rule Path
Disallow *

mj12bot

Rule Path
Disallow *

ahrefsbot

Rule Path
Disallow *

gptbot

Rule Path
Disallow /research/*

google-extended

Rule Path
Disallow /

bingbot

Rule Path
Disallow /software-reviews/categories/*/async_quadrant_load?rel=nofollow
Disallow /software-reviews/categories/*/async_diamond_load?rel=nofollow
Disallow /software-reviews/categories/*/async_offerings_load?rel=nofollow
Back to top

Other Records

Field Value
sitemap https://hr.mcleanco.com/hr_mcleanco_sitemap.xml.gz
Back to top