funstock.com.br
robots.txt

Robots Exclusion Standard data for funstock.com.br

Resource Scan

Scan Details

Site Domain funstock.com.br
Base Domain funstock.com.br
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-16T20:45:58+00:00
Next Scan 2024-11-15T20:45:58+00:00

Last Successful Scan

Scanned2024-04-27T20:44:25+00:00
URL https://funstock.com.br/robots.txt
Redirect https://www.funstock.com.br/robots.txt
Redirect Domain www.funstock.com.br
Redirect Base funstock.com.br
Domain IPs 104.21.74.16, 172.67.152.179, 2606:4700:3036::6815:4a10, 2606:4700:3037::ac43:98b3
Redirect IPs 108.157.254.18, 108.157.254.42, 108.157.254.80, 108.157.254.83, 2600:9000:2200:1e00:17:e381:f840:93a1, 2600:9000:2200:2c00:17:e381:f840:93a1, 2600:9000:2200:600:17:e381:f840:93a1, 2600:9000:2200:9200:17:e381:f840:93a1, 2600:9000:2200:9800:17:e381:f840:93a1, 2600:9000:2200:a400:17:e381:f840:93a1, 2600:9000:2200:c000:17:e381:f840:93a1, 2600:9000:2200:cc00:17:e381:f840:93a1
Response IP 108.157.254.83
Found Yes
Hash 2cd2c8521b6fe2ddd77467fb17252daf8ca4530d6af4d512b5c4af579d76b1fc
SimHash b418df560fd0

Groups

*

Rule Path
Disallow /account/*
Disallow /login/*
Disallow /checkout/*
Disallow /busca/*
Disallow /quick-view/*
Disallow /espiar/*
Disallow /casa-e-decoracao/dc-comics/
Disallow /casa-e-decoracao/star-wars/
Disallow /casa-e-decoracao/marvel/
Disallow /casa-e-decoracao/harry-potter/
Disallow /casa-e-decoracao/funko/
Disallow /casa-e-decoracao/disney/
Disallow /sistema/
Disallow /novidades-presentes
Disallow dev.funstock.com.br

Other Records

Field Value
sitemap https://www.funstock.com.br/sitemap.xml

Comments

  • Disallow all crawlers access to certain pages.

Warnings

  • `noindex` is not a known field.