nextdoorlust.com
robots.txt
Robots Exclusion Standard data for nextdoorlust.com
Resource Scan
Scan Details
Site Domain | nextdoorlust.com |
Base Domain | nextdoorlust.com |
Scan Status | Ok |
Last Scan | 2024-05-27T16:24:54+00:00 |
Next Scan | 2024-06-26T16:24:54+00:00 |
Last Scan
Scanned | 2024-05-27T16:24:54+00:00 |
URL | https://nextdoorlust.com/robots.txt |
Domain IPs | 104.21.234.188, 104.21.234.189, 2606:4700:3038::6815:eabc, 2606:4700:3038::6815:eabd |
Response IP | 104.21.234.188 |
Found | Yes |
Hash | 37223482ffd6e0d0816a4b3a5398df536c2b0cfa99962cd481778ea3bf7ec0d8 |
SimHash | 423ef8c0e038 |
Groups
*
Rule | Path |
---|---|
Disallow | /go |
Disallow | /search/ |
Disallow | /g/ |
Warnings
- 2 invalid lines.