lidltools.eu
robots.txt

Robots Exclusion Standard data for lidltools.eu

Resource Scan

Scan Details

Site Domain lidltools.eu
Base Domain lidltools.eu
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-17T05:14:48+00:00
Next Scan 2024-11-16T05:14:48+00:00

Last Successful Scan

Scanned2024-08-02T11:00:19+00:00
URL https://lidltools.eu/robots.txt
Domain IPs 162.55.154.250, 2a01:4f8:1c1d:b4b::1
Response IP 162.55.154.250
Found Yes
Hash 7d8b2db34516bc9f4c91ee747bb4def304c3ce41842dcd9f7663fd7c6e05000d
SimHash 490d8d231632

Groups

*

Rule Path
Disallow /user
Disallow /*?page=*
Allow /
Allow /*/brand*?page=*
Allow /*/tag*?page=*
Allow /*/?page=*

Other Records

Field Value
sitemap https://lidltools.eu/sitemap-search/sitemap-index-cz.xml
sitemap https://lidltools.eu/sitemap-search/sitemap-index-sk.xml
sitemap https://lidltools.eu/sitemap-search/sitemap-index-pl.xml
sitemap https://lidltools.eu/sitemap-search/sitemap-index-de.xml
sitemap https://lidltools.eu/sitemap-search/sitemap-index-nl.xml
sitemap https://lidltools.eu/sitemap-search/sitemap-index-be.xml
sitemap https://lidltools.eu/sitemap-search/sitemap-index-fr.xml

Comments

  • www.robotstxt.org/
  • www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449