Log In Sign Up

careers.lennar.com
robots.txt

Robots Exclusion Standard data for careers.lennar.com

Resource Scan

Scan Details

Site Domain careers.lennar.com
Base Domain lennar.com
Scan Status Ok
Last Scan2024-11-03T10:19:48+00:00
Next Scan 2024-12-03T10:19:48+00:00

Last Scan

Scanned2024-11-03T10:19:48+00:00
URL https://careers.lennar.com/robots.txt
Domain IPs 18.155.68.37, 18.155.68.77, 18.155.68.91, 18.155.68.92, 2600:9000:23d2:2400:3:3b47:6380:93a1, 2600:9000:23d2:4c00:3:3b47:6380:93a1, 2600:9000:23d2:5400:3:3b47:6380:93a1, 2600:9000:23d2:8800:3:3b47:6380:93a1, 2600:9000:23d2:9800:3:3b47:6380:93a1, 2600:9000:23d2:9a00:3:3b47:6380:93a1, 2600:9000:23d2:b800:3:3b47:6380:93a1, 2600:9000:23d2:e400:3:3b47:6380:93a1
Response IP 18.155.68.92
Found Yes
Hash 510962c422d4d7f286a794c4d5c682ac0b89aeb8724c34716f24186010b6f391
SimHash 6e6dda608a77

Groups

jooblebot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

trovitbot

Rule Path
Disallow /

jobrapido

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

jobbot

Rule Path
Disallow /

jobcrawlerbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

wijubot

Rule Path
Disallow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow
Disallow /admin
Back to top

Other Records

Field Value
sitemap https://careers.lennar.com/sitemap
Back to top