lawdepot.com
robots.txt
Robots Exclusion Standard data for lawdepot.com
Resource Scan
Scan Details
Site Domain | lawdepot.com |
Base Domain | lawdepot.com |
Scan Status | Ok |
Last Scan | 2024-05-22T15:14:41+00:00 |
Next Scan | 2024-06-21T15:14:41+00:00 |
Last Scan
Scanned | 2024-05-22T15:14:41+00:00 |
URL | https://lawdepot.com/robots.txt |
Redirect | https://www.lawdepot.com/robots.txt |
Redirect Domain | www.lawdepot.com |
Redirect Base | lawdepot.com |
Domain IPs | 45.60.105.236, 45.60.44.236 |
Redirect IPs | 45.60.48.236 |
Response IP | 45.60.48.236 |
Found | Yes |
Hash | 96d4656653f8d594e4f9d329cabf7917530d93d3db52dda9a4a941088643dcd5 |
SimHash | 639d52b3cfe6 |
Groups
*
Rule | Path |
---|---|
Disallow | /contracts/order/ |
Disallow | /contracts/orderpage/ |
Disallow | /contracts/orders/ |
Disallow | /contracts/orderasp/ |
Disallow | /*.asmx |
Disallow | /*.ashx |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
googlebot
Rule | Path |
---|---|
Disallow | /*.ashx |
Disallow | /contracts/order/ |
Disallow | /contracts/orderpage/ |
Disallow | /contracts/orders/ |
Disallow | /contracts/orderasp/ |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
bingbot
Rule | Path |
---|---|
Disallow | /*.asmx |
Disallow | /*.ashx |
Disallow | /contracts/order/ |
Disallow | /contracts/orderpage/ |
Disallow | /contracts/orders/ |
Disallow | /contracts/orderasp/ |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
msnbot
Rule | Path |
---|---|
Disallow | /*.asmx |
Disallow | /*.ashx |
Disallow | /contracts/order/ |
Disallow | /contracts/orderpage/ |
Disallow | /contracts/orders/ |
Disallow | /contracts/orderasp/ |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
slurp
Rule | Path |
---|---|
Disallow | /*.asmx |
Disallow | /*.ashx |
Disallow | /contracts/order/ |
Disallow | /contracts/orderpage/ |
Disallow | /contracts/orders/ |
Disallow | /contracts/orderasp/ |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
duckduckbot
Rule | Path |
---|---|
Disallow | /*.asmx |
Disallow | /*.ashx |
Disallow | /contracts/order/ |
Disallow | /contracts/orderpage/ |
Disallow | /contracts/orders/ |
Disallow | /contracts/orderasp/ |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
exabot
Rule | Path |
---|---|
Disallow | /*.asmx |
Disallow | /*.ashx |
Disallow | /contracts/order/ |
Disallow | /contracts/orderpage/ |
Disallow | /contracts/orders/ |
Disallow | /contracts/orderasp/ |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
aolbuild
Rule | Path |
---|---|
Disallow | /*.asmx |
Disallow | /*.ashx |
Disallow | /contracts/order/ |
Disallow | /contracts/orderpage/ |
Disallow | /contracts/orders/ |
Disallow | /contracts/orderasp/ |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Other Records
Field | Value |
---|---|
sitemap | https://www.lawdepot.com/sitemap.xml |
Warnings
- 9 invalid lines.