weblenti.com
robots.txt
Robots Exclusion Standard data for weblenti.com
Resource Scan
Scan Details
Site Domain | weblenti.com |
Base Domain | weblenti.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 5/19/2025, 3:29:36 PM |
Next Scan | 8/17/2025, 3:29:36 PM |
Last Successful Scan
Scanned | 10/28/2023, 2:52:54 PM |
URL | https://weblenti.com/robots.txt |
Domain IPs | 104.21.72.122, 172.67.184.28, 2606:4700:3030::ac43:b81c, 2606:4700:3033::6815:487a |
Response IP | 172.67.184.28 |
Found | Yes |
Hash | e2d8a13b6f9c5174754d67743957d97a4cc0fef3d725f70c640b353cc4c03e34 |
SimHash | 082fca452d93 |
Groups
*
Rule | Path |
---|---|
Disallow | /*?page=$ |
Disallow | /*%26page%3D$ |
Disallow | /*?sort= |
Disallow | /*%26sort%3D |
Disallow | /*?order= |
Disallow | /*%26order%3D |
Disallow | /*?limit= |
Disallow | /*%26limit%3D |
Disallow | /*?redirect= |
Disallow | /*%26redirect%3D |
Disallow | /*?tracking= |
Disallow | /*%26tracking%3D |
Disallow | /*?filter_name= |
Disallow | /*%26filter_name%3D |
Disallow | /*?filter_sub_category= |
Disallow | /*%26filter_sub_category%3D |
Disallow | /*?filter_description= |
Disallow | /*%26filter_description%3D |
Disallow | /*ref%3D* |
Disallow | /*refeer%3D* |