Log In Sign Up

casadopicapau.com.br
robots.txt

Robots Exclusion Standard data for casadopicapau.com.br

Resource Scan

Scan Details

Site Domain casadopicapau.com.br
Base Domain casadopicapau.com.br
Scan Status Ok
Last Scan2024-06-29T03:52:49+00:00
Next Scan 2024-07-29T03:52:49+00:00

Last Scan

Scanned2024-06-29T03:52:49+00:00
URL https://www.casadopicapau.com.br/robots.txt
Domain IPs 18.155.68.101, 18.155.68.38, 18.155.68.58, 18.155.68.97, 2600:9000:23d2:1600:16:944e:42c0:93a1, 2600:9000:23d2:4a00:16:944e:42c0:93a1, 2600:9000:23d2:5400:16:944e:42c0:93a1, 2600:9000:23d2:7e00:16:944e:42c0:93a1, 2600:9000:23d2:8c00:16:944e:42c0:93a1, 2600:9000:23d2:ae00:16:944e:42c0:93a1, 2600:9000:23d2:dc00:16:944e:42c0:93a1, 2600:9000:23d2:e600:16:944e:42c0:93a1
Response IP 18.155.68.97
Found Yes
Hash 1179f4260ae10323ea95e91d556f3b7159e6d338351f59491deee87d588120b0
SimHash 6c55fad1c557

Groups

*

Rule Path
Disallow /stats/
Disallow /var/
Disallow /checkout/
Disallow /contacts/
Disallow /poll/
Disallow /wishlist/
Disallow /*?SID=
Disallow /*?*SID=
Disallow /login/
Disallow /account/

adsbot-google

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

googlebot

Rule Path
Disallow

googlebot-video/1.0

Rule Path
Disallow

bingbot

Rule Path
Disallow

slurp

Rule Path
Disallow

duckduckbot

Rule Path
Disallow

baiduspider

Rule Path
Disallow

yandexbot

Rule Path
Disallow

facebot

Rule Path
Disallow

ia_archiver

Rule Path
Disallow
Back to top

Other Records

Field Value
sitemap https://www.casadopicapau.com.br/sitemap.xml
Back to top

Comments

  • Disallow all crawlers access to certain pages.
  • Permitir Bots Google
  • bing
  • Yahoo
  • DuckDuckGo
  • Baidu
  • Yandex
  • Facebook
  • Alexa
Back to top