woly.com.br
robots.txt

Robots Exclusion Standard data for woly.com.br

Resource Scan

Scan Details

Site Domain woly.com.br
Base Domain woly.com.br
Scan Status Ok
Last Scan2024-09-17T04:51:59+00:00
Next Scan 2024-10-17T04:51:59+00:00

Last Scan

Scanned2024-09-17T04:51:59+00:00
URL https://www.woly.com.br/robots.txt
Domain IPs 13.33.30.102, 13.33.30.13, 13.33.30.51, 13.33.30.9, 2600:9000:2079:1200:12:2737:4680:93a1, 2600:9000:2079:2400:12:2737:4680:93a1, 2600:9000:2079:5a00:12:2737:4680:93a1, 2600:9000:2079:7a00:12:2737:4680:93a1, 2600:9000:2079:a200:12:2737:4680:93a1, 2600:9000:2079:b000:12:2737:4680:93a1, 2600:9000:2079:d000:12:2737:4680:93a1, 2600:9000:2079:fc00:12:2737:4680:93a1
Response IP 13.33.30.9
Found Yes
Hash 2605bd7655ddfd470a9b30d5c5f13541a68a02b5a66c51c77a1377a1aae88f44
SimHash e010fd074d84

Groups

*

Rule Path Comment
Disallow /img/* -
Disallow /account /*
Disallow /login/* -
Disallow /checkout/* -
Disallow /busca/* -
Disallow /espiar/* -
Disallow /buscapagina/* -
Disallow /?_q=* -
Disallow /*%26searchState -
Disallow /*%26map%3Dft -

Other Records

Field Value
sitemap https://www.woly.com.br/sitemap.xml

Comments

  • Disallow all crawlers access to certain pages.

Warnings

  • 1 invalid line.