lessen.com
robots.txt
Robots Exclusion Standard data for lessen.com
Resource Scan
Scan Details
Site Domain | lessen.com |
Base Domain | lessen.com |
Scan Status | Ok |
Last Scan | 2024-10-31T15:11:16+00:00 |
Next Scan | 2024-11-30T15:11:16+00:00 |
Last Scan
Scanned | 2024-10-31T15:11:16+00:00 |
URL | https://lessen.com/robots.txt |
Redirect | https://www.lessen.com/robots.txt |
Redirect Domain | www.lessen.com |
Redirect Base | lessen.com |
Domain IPs | 75.2.70.75, 99.83.190.102 |
Redirect IPs | 52.197.0.54, 52.199.221.217, 54.178.223.218 |
Response IP | 13.237.233.226 |
Found | Yes |
Hash | 8917ad24cda49865a37ee6b0a79a96d8d0a25e06e610e80cf8035d5e1064253d |
SimHash | 69512925c793 |
Groups
*
Rule | Path |
---|---|
Disallow | /cgi-bin/ |
Disallow | /residential/resources?* |
Disallow | /resource-type/blog?* |
Disallow | /resource-type/press?* |
Disallow | /resources?* |
Other Records
Field | Value |
---|---|
sitemap | https://www.lessen.com/sitemap.xml |
sitemap | https://www.lessen.com/sitemap.xml |