ls1.com.au
robots.txt
Robots Exclusion Standard data for ls1.com.au
Resource Scan
Scan Details
Site Domain | ls1.com.au |
Base Domain | ls1.com.au |
Scan Status | Ok |
Last Scan | 2024-11-14T09:28:34+00:00 |
Next Scan | 2024-11-21T09:28:34+00:00 |
Last Scan
Scanned | 2024-11-14T09:28:34+00:00 |
URL | http://www.ls1.com.au/robots.txt |
Domain IPs | 150.107.75.137 |
Response IP | 150.107.75.137 |
Found | Yes |
Hash | ce32f6558ae892f69078d3defd8cfe05e46cb711361f4cb79b6620c70a1aed82 |
SimHash | 6050d151d135 |
Groups
*
No rules defined. All paths allowed.
Other Records
Field | Value |
---|---|
crawl-delay | 1000 |