netlife.com
robots.txt

Robots Exclusion Standard data for netlife.com

Resource Scan

Scan Details

Site Domain netlife.com
Base Domain netlife.com
Scan Status Ok
Last Scan2025-10-20T20:40:35+00:00
Next Scan 2025-10-27T20:40:35+00:00

Last Scan

Scanned2025-10-20T20:40:35+00:00
URL https://netlife.com/robots.txt
Redirect https://www.netlife.com/robots.txt
Redirect Domain www.netlife.com
Redirect Base netlife.com
Domain IPs 185.91.67.251
Redirect IPs 185.91.67.251
Response IP 185.91.67.251
Found Yes
Hash 6bc79190d670d996e76895800774279d07ab7e7f18898f4df2f6b16a63195ec5
SimHash 41001d523793

Groups

*

Rule Path
Disallow /cpresources/
Disallow /vendor/
Disallow /.env
Disallow /cache/

Other Records

Field Value
sitemap https://www.netlife.com/sitemaps-1-sitemap.xml

Comments

  • robots.txt for https://www.netlife.com/
  • live - don't allow web crawlers to index cpresources/ or vendor/