lebiscuit.com.br
robots.txt
Robots Exclusion Standard data for lebiscuit.com.br
Resource Scan
Scan Details
Site Domain | lebiscuit.com.br |
Base Domain | lebiscuit.com.br |
Scan Status | Ok |
Last Scan | 2024-10-01T06:27:03+00:00 |
Next Scan | 2024-10-08T06:27:03+00:00 |
Last Scan
Scanned | 2024-10-01T06:27:03+00:00 |
URL | https://www.lebiscuit.com.br/robots.txt |
Domain IPs | 104.18.10.25, 104.18.11.25, 2606:4700::6812:a19, 2606:4700::6812:b19 |
Response IP | 104.18.10.25 |
Found | Yes |
Hash | d72b0ecb93cdf89c267340482e3824d2717d351cb302e43cb83c23d7665dc4cc |
SimHash | e05bf926cd10 |
Groups
*
Rule | Path |
---|---|
Disallow | / |
googlebot
Rule | Path |
---|---|
Allow | / |
Disallow | /img/* |
Disallow | /api/* |
Disallow | /login/* |
Disallow | /login |
Disallow | /account/* |
Disallow | /account |
Disallow | /checkout |
Disallow | */sistema/* |
Disallow | /sistema/404 |
Disallow | /sistema/500 |
Disallow | /sistema/buscavazia |
Disallow | /sistema/checkout |
Disallow | /sistema/login |
Disallow | /quick-view/* |
Disallow | /espiar/* |
Disallow | /*map%3Dc%2CpriceFrom |
Disallow | */productotherpaymentsystems/* |
Disallow | */productotherpaymentsystems/* |
Disallow | /buscapagina/* |
Other Records
Field | Value |
---|---|
sitemap | https://www.lebiscuit.com.br/sitemap.xml |