karvi.com.ar
robots.txt

Robots Exclusion Standard data for karvi.com.ar

Resource Scan

Scan Details

Site Domain karvi.com.ar
Base Domain karvi.com.ar
Scan Status Ok
Last Scan2024-09-13T07:11:32+00:00
Next Scan 2024-10-13T07:11:32+00:00

Last Scan

Scanned2024-09-13T07:11:32+00:00
URL https://karvi.com.ar/robots.txt
Redirect https://www.karvi.com.ar/robots.txt
Redirect Domain www.karvi.com.ar
Redirect Base karvi.com.ar
Domain IPs 108.157.254.32, 108.157.254.59, 108.157.254.84, 108.157.254.92
Redirect IPs 52.84.229.4, 52.84.229.48, 52.84.229.64, 52.84.229.71
Response IP 52.84.229.4
Found Yes
Hash 1eee16fbcacf4d07a4c68098d984fec97225285b68651f4fabfdcb8de18c657d
SimHash 90482a42ae62

Groups

*

Rule Path
Disallow /*/wizard
Disallow /*/my/
Disallow /styles
Disallow /scripts
Disallow /static
Disallow /login/
Disallow /ofertas/*

arquivo-web-crawler

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /