lidltools.eu
robots.txt
Robots Exclusion Standard data for lidltools.eu
Resource Scan
Scan Details
Site Domain | lidltools.eu |
Base Domain | lidltools.eu |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-09-17T05:14:48+00:00 |
Next Scan | 2024-11-16T05:14:48+00:00 |
Last Successful Scan
Scanned | 2024-08-02T11:00:19+00:00 |
URL | https://lidltools.eu/robots.txt |
Domain IPs | 162.55.154.250, 2a01:4f8:1c1d:b4b::1 |
Response IP | 162.55.154.250 |
Found | Yes |
Hash | 7d8b2db34516bc9f4c91ee747bb4def304c3ce41842dcd9f7663fd7c6e05000d |
SimHash | 490d8d231632 |
Groups
*
Rule | Path |
---|---|
Disallow | /user |
Disallow | /*?page=* |
Allow | / |
Allow | /*/brand*?page=* |
Allow | /*/tag*?page=* |
Allow | /*/?page=* |
Other Records
Field | Value |
---|---|
sitemap | https://lidltools.eu/sitemap-search/sitemap-index-cz.xml |
sitemap | https://lidltools.eu/sitemap-search/sitemap-index-sk.xml |
sitemap | https://lidltools.eu/sitemap-search/sitemap-index-pl.xml |
sitemap | https://lidltools.eu/sitemap-search/sitemap-index-de.xml |
sitemap | https://lidltools.eu/sitemap-search/sitemap-index-nl.xml |
sitemap | https://lidltools.eu/sitemap-search/sitemap-index-be.xml |
sitemap | https://lidltools.eu/sitemap-search/sitemap-index-fr.xml |
Comments