humanscale.com
robots.txt

Robots Exclusion Standard data for humanscale.com

Resource Scan

Scan Details

Site Domain humanscale.com
Base Domain humanscale.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-14T18:36:36+00:00
Next Scan 2024-08-12T18:36:36+00:00

Last Successful Scan

Scanned2023-03-29T13:23:58+00:00
URL https://humanscale.com/robots.txt
Domain IPs 99.86.159.25, 99.86.159.35, 99.86.159.46, 99.86.159.51
Response IP 18.65.3.85
Found Yes
Hash 544ab25f525740770cb29498c3e5ab92bcd7f65f25b62bb7922eb907feff77ae
SimHash a0185f6463d1

Groups

*

Rule Path
Disallow /about/company-overview/career-search.cfm
Disallow /mediaplayer56/
Disallow /citigroup/
Disallow /includes/
Disallow /static/

Other Records

Field Value
crawl-delay 5