threatlocker.com
robots.txt

Robots Exclusion Standard data for threatlocker.com

Resource Scan

Scan Details

Site Domain threatlocker.com
Base Domain threatlocker.com
Scan Status Ok
Last Scan2024-05-07T14:07:46+00:00
Next Scan 2024-05-21T14:07:46+00:00

Last Scan

Scanned2024-05-07T14:07:46+00:00
URL https://threatlocker.com/robots.txt
Redirect https://www.threatlocker.com/robots.txt
Redirect Domain www.threatlocker.com
Redirect Base threatlocker.com
Domain IPs 75.2.70.75, 99.83.190.102
Redirect IPs 52.197.0.54, 52.199.221.217, 54.178.223.218
Response IP 54.68.171.176
Found Yes
Hash a717b8a08d93b405793596c27b5625d67b6bd16a384cf7de72a3900e0e4f159d
SimHash 09417d304d93

Groups

*

Rule Path
Disallow /log-in
Disallow /sign-up
Disallow /reset-password
Disallow /user-account
Disallow /401
Disallow /404
Disallow /logo-carousel
Disallow /blog/understanding-the-zero-trust-maturity-model-v-2.0
Disallow /blog/85586275695
Disallow /untitled
Disallow /testimonial-builder
Disallow /access-denied
Disallow /job-listing-styling
Disallow /award-section
Disallow /cheq-ppc-invalid-users
Disallow /update-password
Disallow /demo-test-copy
Disallow /free-trial-submitted
Disallow /thank-you
Disallow /press-releases/*
Disallow /black-hat
Disallow /demo
Disallow /why-threatlocker/compare
Disallow /post-meeting
Disallow /post-presentation

Other Records

Field Value
sitemap https://www.threatlocker.com/sitemap.xml