karvi.com.br
robots.txt

Robots Exclusion Standard data for karvi.com.br

Resource Scan

Scan Details

Site Domain karvi.com.br
Base Domain karvi.com.br
Scan Status Ok
Last Scan2024-07-02T03:33:19+00:00
Next Scan 2024-07-09T03:33:19+00:00

Last Scan

Scanned2024-07-02T03:33:19+00:00
URL https://karvi.com.br/robots.txt
Redirect https://www.karvi.com.br/robots.txt
Redirect Domain www.karvi.com.br
Redirect Base karvi.com.br
Domain IPs 13.35.18.102, 13.35.18.18, 13.35.18.21, 13.35.18.79
Redirect IPs 108.156.133.3, 108.156.133.56, 108.156.133.67, 108.156.133.81
Response IP 108.156.133.81
Found Yes
Hash 1eee16fbcacf4d07a4c68098d984fec97225285b68651f4fabfdcb8de18c657d
SimHash 90482a42ae62

Groups

*

Rule Path
Disallow /*/wizard
Disallow /*/my/
Disallow /styles
Disallow /scripts
Disallow /static
Disallow /login/
Disallow /ofertas/*

arquivo-web-crawler

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /