homify.com.ar
robots.txt

Robots Exclusion Standard data for homify.com.ar

Resource Scan

Scan Details

Site Domain homify.com.ar
Base Domain homify.com.ar
Scan Status Ok
Last Scan2024-12-19T04:18:16+00:00
Next Scan 2024-12-26T04:18:16+00:00

Last Scan

Scanned2024-12-19T04:18:16+00:00
URL https://homify.com.ar/robots.txt
Redirect https://www.homify.com.ar:443/robots.txt
Redirect Domain www.homify.com.ar
Redirect Base homify.com.ar
Domain IPs 108.128.28.114, 34.253.242.89, 34.255.226.218
Redirect IPs 169.150.247.37, 2400:52e0:1500::868:1
Response IP 138.199.46.68
Found Yes
Hash 654268f827925431f93efa3d27ca1256045c668f899df86c8b21f07ad073ee83
SimHash fe77cc57c701

Groups

*

Rule Path
Disallow /a/partial/
Disallow /admin/
Disallow /seleccionado/
Disallow /photo/single_delete/
Disallow /*/sign_out
Disallow /landing_page/
Disallow /comments/
Disallow /cookie
Disallow /logged_in
Disallow /500
Disallow /professionals/premium_cards
Disallow /photo/similar_photos
Disallow /photo/project_related_photos
Disallow /users_route/
Disallow /idea_book_upload_photos/
Disallow /conversations/
Disallow /leads/
Disallow /*/bewertung_anfordern/
Disallow /*/request_rating/
Disallow /*/solicitar_valoracion/
Disallow /*/demander_evaluation/
Disallow /*/richiedi_valutazione/
Disallow /*/solicitar_avaliacao/
Disallow /*/solicitar_evaluacion/
Disallow /*/rating_aanvragen/
Disallow /*/reyting_iste/
Disallow /*/popros_o_opinie/
Disallow /*/zapros-na-otzyv/
Disallow /nutzer/
Disallow /users/
Disallow /usuarios/
Disallow /utilisateurs/
Disallow /utenti/
Disallow /utilizadores/
Disallow /gebruikers/
Disallow /kullanicilar/
Disallow /uzytkownicy/
Disallow /polzovateli/
Disallow /suchen/
Disallow /buscar/
Disallow /rechercher/
Disallow /cerca/
Disallow /pesquisar/
Disallow /arama/
Disallow /szukaj/
Disallow /poisk/
Disallow /zoeken/
Disallow /search/
Disallow /*/suchen/
Disallow /*/buscar/
Disallow /*/rechercher/
Disallow /*/cerca/
Disallow /*/pesquisar/
Disallow /*/arama/
Disallow /*/szukaj/
Disallow /*/poisk/
Disallow /*/zoeken/
Disallow /*/search/
Disallow /ideenbuecher/neu
Disallow /libros_de_ideas/nuevo
Disallow /livres_idees/nouveau
Disallow /librodelleidee/nuovo
Disallow /livros_de_ideias/novo
Disallow /ideabooks/new
Disallow /ideabooks/nieuw
Disallow /yeni_fikirler/yeni
Disallow /katalogi-inspiracji/nowy
Disallow /knigi-idej/novyj
Disallow /projekte/neu
Disallow /proyectos/nuevo
Disallow /projets/nouveau
Disallow /progetti/nuovo
Disallow /projetos/novo
Disallow /projects/new
Disallow /projecten/nieuw
Disallow /projeler/yeni
Disallow /projekty/nowy
Disallow /projekty/novyj
Disallow /experten/*/bewertungen/neu
Disallow /expertos/*/valoraciones/nuevo
Disallow /experts/*/evaluations/nouveau
Disallow /esperti/*/valutazioni/nuovo
Disallow /profissionais/*/avaliacoes/novo
Disallow /profesionales/*/evaluaciones/nuevo
Disallow /professionals/*/reviews/new
Disallow /professionals/*/beoordelingen/nieuw
Disallow /profesyoneller/*/reytingler/yeni
Disallow /profesjonalisci/*/rankingi/nowy
Disallow /specialisty/*/otzyvy/novyj
Disallow /*/editieren$
Disallow /*/edit$
Disallow /*/editar$
Disallow /*/adapter$
Disallow /*/modifica$
Disallow /*/modificar$
Disallow /*/bewerken$
Disallow /*/duzenle$
Disallow /*/edytuj$
Disallow /*/redaktirovat$
Disallow /edit_after_signup
Disallow /diy/new
Disallow /gewerblich/
Disallow /commercial/
Disallow /comercial/
Disallow /commerciale/
Disallow /commercieel/
Disallow /ticari/
Disallow /komercyjne/
Disallow /komersial/
Disallow /*/b2b/

Other Records

Field Value
crawl-delay 25

yandex

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /a/partial/
Disallow /admin/seo_elements/
Disallow /seleccionado/

Other Records

Field Value
crawl-delay 3

semrushbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

coccocbot-web

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

awariobot

Rule Path
Disallow /

sentibot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

geedobot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://s3-eu-west-1.amazonaws.com/homify-production-sitemaps/ar/sitemap.xml

Comments

  • Setup roles for crawling bots
  • Allow all crawler bots
  • Request rating
  • Users
  • Search section
  • New ideabooks
  • New projects
  • New professional reviews
  • Edit pages
  • DIY
  • b2b/commercial pages