petsupplies4less.com
robots.txt

Robots Exclusion Standard data for petsupplies4less.com

Resource Scan

Scan Details

Site Domain petsupplies4less.com
Base Domain petsupplies4less.com
Scan Status Ok
Last Scan2024-10-17T05:24:57+00:00
Next Scan 2024-11-16T05:24:57+00:00

Last Scan

Scanned2024-10-17T05:24:57+00:00
URL https://www.petsupplies4less.com/robots.txt
Domain IPs 108.156.133.108, 108.156.133.21, 108.156.133.36, 108.156.133.74, 2600:9000:2755:2400:15:4a31:f1c0:93a1, 2600:9000:2755:3a00:15:4a31:f1c0:93a1, 2600:9000:2755:3c00:15:4a31:f1c0:93a1, 2600:9000:2755:6000:15:4a31:f1c0:93a1, 2600:9000:2755:7400:15:4a31:f1c0:93a1, 2600:9000:2755:8c00:15:4a31:f1c0:93a1, 2600:9000:2755:9e00:15:4a31:f1c0:93a1, 2600:9000:2755:b600:15:4a31:f1c0:93a1
Response IP 108.156.133.21
Found Yes
Hash 16695fa0e55a2b346317cd5f964cfe79c5721f48b2c94dab95e0b9c9302fb9de
SimHash 6048cd170f90

Groups

*

Rule Path
Allow /*.js
Allow /*.css
Allow /*.jpeg
Allow /*.png
Allow /*.webp
Allow /*.jpg
Disallow /account/*
Disallow /login/*
Disallow /logout/*
Disallow /checkout/*
Disallow /busca/*
Disallow /quick-view/*
Disallow /espiar/*
Disallow /buscapagina/*
Disallow /z--*

Other Records

Field Value
sitemap https://www.lambertvetsupply.com/sitemap.xml
sitemap https://www.petsupplies4less.com/sitemap.xml

Comments

  • Disallow all crawlers access to certain pages.