levi.pe
robots.txt
Robots Exclusion Standard data for levi.pe
Resource Scan
Scan Details
Site Domain | levi.pe |
Base Domain | levi.pe |
Scan Status | Ok |
Last Scan | 2024-09-17T04:57:16+00:00 |
Next Scan | 2024-10-17T04:57:16+00:00 |
Last Scan
Scanned | 2024-09-17T04:57:16+00:00 |
URL | https://www.levi.pe/robots.txt |
Domain IPs | 108.156.133.62, 108.156.133.70, 108.156.133.91, 108.156.133.99, 2600:9000:2755:5200:3:5acc:9840:93a1, 2600:9000:2755:5c00:3:5acc:9840:93a1, 2600:9000:2755:7800:3:5acc:9840:93a1, 2600:9000:2755:9e00:3:5acc:9840:93a1, 2600:9000:2755:cc00:3:5acc:9840:93a1, 2600:9000:2755:d400:3:5acc:9840:93a1, 2600:9000:2755:de00:3:5acc:9840:93a1, 2600:9000:2755:f800:3:5acc:9840:93a1 |
Response IP | 108.156.133.70 |
Found | Yes |
Hash | 95d1ecad71129c4e612dd7a83316ff18152180240c3bd613c7d5e535dabce784 |
SimHash | 741949474cd1 |
Groups
*
Rule | Path |
---|---|
Disallow | /img/* |
Disallow | /account/* |
Disallow | /login/* |
Disallow | /checkout/* |
Disallow | /busca/* |
Disallow | /quick-view/* |
Disallow | /espiar/* |
Disallow | /*.git$ |
Disallow | /*.csv$ |
Disallow | /*.zip$ |
Disallow | /*.svn$ |
Disallow | /*.idea$ |
Disallow | /*.sql$ |
Disallow | /*.tgz$ |
googlebot
Rule | Path |
---|---|
Disallow | /*?map=* |
Disallow | /*%26map%3D* |
Disallow | /*?initialMap=* |
Disallow | /*%26initialMap%3D* |
Disallow | /*?fuzzy=* |
Disallow | /*%26initialQuery%3D* |
Disallow | /*%26initialQuery%3D* |
Disallow | /*?_q=* |
Disallow | /*%26_q%3D* |
Disallow | /*?O=* |
Disallow | /*%26O%3D* |
Disallow | /*%26PS%3D* |
Disallow | /*?PS=* |
Disallow | /*?Mode=* |
Disallow | /*%26Mode%3D* |
Other Records
Field | Value |
---|---|
sitemap | https://www.levi.pe/sitemap.xml |
Warnings
- `noindex` is not a known field.
Comments