nationallighting.co.uk
robots.txt
Robots Exclusion Standard data for nationallighting.co.uk
Resource Scan
Scan Details
| Site Domain | nationallighting.co.uk |
| Base Domain | nationallighting.co.uk |
| Scan Status | Ok |
| Last Scan | 2024-10-28T18:26:32+00:00 |
| Next Scan | 2024-11-27T18:26:32+00:00 |
Last Scan
| Scanned | 2024-10-28T18:26:32+00:00 |
| URL | https://nationallighting.co.uk/robots.txt |
| Redirect | https://www.nationallighting.co.uk/robots.txt |
| Redirect Domain | www.nationallighting.co.uk |
| Redirect Base | nationallighting.co.uk |
| Domain IPs | 192.124.249.157 |
| Redirect IPs | 192.124.249.157 |
| Response IP | 192.124.249.157 |
| Found | Yes |
| Hash | 14a0d86ce0cd69756a9a3b0bc4c93b70137f63e0471a09c8174fadc8e4c32cbd |
| SimHash | 673afc30e58b |
Groups
*
| Rule | Path |
|---|---|
| Disallow | */refined/* |
| Disallow | */PDFs/* |
| Disallow | /staging/* |
| Disallow | /staging19/* |
| Disallow | /nlv1/* |
| Disallow | */pid/* |
| Disallow | /OldNotworkingSrc/* |
| Disallow | /Org_06Mar/* |
| Disallow | /nlv1-org-somefiles/* |
| Disallow | /twonldemo/* |
| Disallow | /onenldemo/* |
| Disallow | */catid/* |
| Disallow | */cid/* |
| Disallow | */%26* |
| Disallow | */product/view/id/* |
| Disallow | */landing-page/* |
| Disallow | */nlight/* |
| Disallow | */ajax/* |
| Disallow | /branches/* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 20 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.nationallighting.co.uk/sitemap.xml |
Warnings
- 2 invalid lines.