homelectrical.com
robots.txt

Robots Exclusion Standard data for homelectrical.com

Resource Scan

Scan Details

Site Domain homelectrical.com
Base Domain homelectrical.com
Scan Status Ok
Last Scan2024-09-22T13:05:38+00:00
Next Scan 2024-10-22T13:05:38+00:00

Last Scan

Scanned2024-09-22T13:05:38+00:00
URL https://homelectrical.com/robots.txt
Domain IPs 13.35.185.11, 13.35.185.61, 13.35.185.64, 13.35.185.69
Response IP 52.84.229.73
Found Yes
Hash 5c930ee5e114c0f6ad7d8394652b35532113598b8f2b87514cb4489f3ac800c5
SimHash 4d1d9e114ca1

Groups

updownerbot

Rule Path
Disallow /

deepcrawl

Rule Path
Disallow /

facebookbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /cart.html
Disallow /checkout
Disallow /checkout/
Disallow /checkout/*
Disallow /user
Disallow /user/*
Disallow /api
Disallow /api/*
Disallow /category/
Disallow /category/*

Other Records

Field Value
sitemap https://www.homelectrical.com/sitemap.xml
sitemap https://www.homelectrical.com/sitemap-products-index.xml
sitemap https://www.homelectrical.com/sitemap-blogs-index.xml
sitemap https://www.homelectrical.com/sitemap-brands-index.xml
sitemap https://www.homelectrical.com/sitemap-categories-index.xml
sitemap https://www.homelectrical.com/sitemap-image-index.xml

Comments

  • Added 2021/09/24
  • Added 2021/09/24
  • Added 2021/09/24
  • Added 2024/08/20
  • Disallow: /product/
  • Disallow: /product/*
  • Sitemap

Warnings

  • 2 invalid lines.