inspired-lighting.co.uk
robots.txt

Robots Exclusion Standard data for inspired-lighting.co.uk

Resource Scan

Scan Details

Site Domain inspired-lighting.co.uk
Base Domain inspired-lighting.co.uk
Scan Status Ok
Last Scan2024-09-04T22:39:26+00:00
Next Scan 2024-10-04T22:39:26+00:00

Last Scan

Scanned2024-09-04T22:39:26+00:00
URL https://inspired-lighting.co.uk/robots.txt
Redirect https://www.inspired-lighting.co.uk/robots.txt
Redirect Domain www.inspired-lighting.co.uk
Redirect Base inspired-lighting.co.uk
Domain IPs 104.26.2.249, 104.26.3.249, 172.67.73.51, 2606:4700:20::681a:2f9, 2606:4700:20::681a:3f9, 2606:4700:20::ac43:4933
Redirect IPs 104.26.2.249, 104.26.3.249, 172.67.73.51, 2606:4700:20::681a:2f9, 2606:4700:20::681a:3f9, 2606:4700:20::ac43:4933
Response IP 172.67.73.51
Found Yes
Hash 2b455086c05226185b002c00c4854b14b26f18d50c48b23f5549c77f98813dbd
SimHash 0114d9184a50

Groups

*

Rule Path
Disallow
Disallow /Error/
Disallow /StatusError/
Disallow /cart/
Disallow /wishlist/
Disallow /reviewcart/
Disallow /account/
Disallow /Dashboard/
Disallow /content/*.html
Disallow /content/Catalogue

Comments

  • Google Image Crawler Setup
  • User-agent: Googlebot-Image
  • Disallow:
  • Crawlers Setup
  • User-agent: *
  • Directories
  • Disallow: /*.js$
  • Disallow: /*.css$
  • Disallow: /css/
  • Disallow: /lib/
  • Disallow: /wheretobuy
  • Disallow: /profileedit
  • Disallow: /editprofile
  • Disallow: /content/Catalogue
  • Files
  • Disallow: /frequently.html
  • Disallow: /wheretobuy
  • Disallow: /profileedit
  • Disallow: /editprofile