ls1.com.au
robots.txt

Robots Exclusion Standard data for ls1.com.au

Resource Scan

Scan Details

Site Domain ls1.com.au
Base Domain ls1.com.au
Scan Status Ok
Last Scan2024-11-14T09:28:34+00:00
Next Scan 2024-11-21T09:28:34+00:00

Last Scan

Scanned2024-11-14T09:28:34+00:00
URL http://www.ls1.com.au/robots.txt
Domain IPs 150.107.75.137
Response IP 150.107.75.137
Found Yes
Hash ce32f6558ae892f69078d3defd8cfe05e46cb711361f4cb79b6620c70a1aed82
SimHash 6050d151d135

Groups

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 120

psbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 120

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 120

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1000