homify.com
robots.txt

Robots Exclusion Standard data for homify.com

Resource Scan

Scan Details

Site Domain homify.com
Base Domain homify.com
Scan Status Ok
Last Scan2024-09-21T13:04:53+00:00
Next Scan 2024-09-28T13:04:53+00:00

Last Scan

Scanned2024-09-21T13:04:53+00:00
URL https://homify.com/robots.txt
Redirect https://www.homify.com:443/robots.txt
Redirect Domain www.homify.com
Redirect Base homify.com
Domain IPs 52.208.169.114, 52.215.197.67, 54.170.120.41
Redirect IPs 138.199.46.68, 2400:52e0:1500::868:1
Response IP 138.199.46.68
Found Yes
Hash a6279e76ab2e7ab60e4dfc00d6a9e95cada41a1eca04f3c41fbf4224c0045add
SimHash 9c714653c721

Groups

*

Rule Path
Disallow /a/partial/
Disallow /admin/
Disallow /seleccionado/
Disallow /photo/single_delete/
Disallow /sign_out
Disallow /landing_page/
Disallow /comments/
Disallow /cookie
Disallow /logged_in
Disallow /500
Disallow /premium_cards
Disallow /photo/similar_photos
Disallow /photo/project_related_photos
Disallow /users_route/
Disallow /idea_book_upload_photos/
Disallow /bewertung_anfordern/
Disallow /request_rating/
Disallow /solicitar_valoracion/
Disallow /demander_evaluation/
Disallow /richiedi_valutazione/
Disallow /solicitar_avaliacao/
Disallow /solicitar_evaluacion/
Disallow /rating_aanvragen/
Disallow /reyting_iste/
Disallow /popros_o_opinie/
Disallow /zapros-na-otzyv/
Disallow /suchen/
Disallow /buscar/
Disallow /rechercher/
Disallow /cerca/
Disallow /pesquisar/
Disallow /arama/
Disallow /szukaj/
Disallow /poisk/
Disallow /zoeken/
Disallow /search/
Disallow /ideenbuecher/neu
Disallow /libros_de_ideas/nuevo
Disallow /livres_idees/nouveau
Disallow /librodelleidee/nuovo
Disallow /livros_de_ideias/novo
Disallow /ideabooks/new
Disallow /ideabooks/nieuw
Disallow /yeni_fikirler/yeni
Disallow /katalogi-inspiracji/nowy
Disallow /knigi-idej/novyj
Disallow /projekte/neu
Disallow /proyectos/nuevo
Disallow /projets/nouveau
Disallow /progetti/nuovo
Disallow /projetos/novo
Disallow /projects/new
Disallow /projecten/nieuw
Disallow /projeler/yeni
Disallow /projekty/nowy
Disallow /projekty/novyj
Disallow /experten/*/bewertungen/neu
Disallow /expertos/*/valoraciones/nuevo
Disallow /experts/*/evaluations/nouveau
Disallow /esperti/*/valutazioni/nuovo
Disallow /profissionais/*/avaliacoes/novo
Disallow /profesionales/*/evaluaciones/nuevo
Disallow /professionals/*/reviews/new
Disallow /professionals/*/beoordelingen/nieuw
Disallow /profesyoneller/*/reytingler/yeni
Disallow /profesjonalisci/*/rankingi/nowy
Disallow /specialisty/*/otzyvy/novyj
Disallow /editieren
Disallow /edit
Disallow /editar
Disallow /adapter
Disallow /modifica
Disallow /modificar
Disallow /bewerken
Disallow /duzenle
Disallow /edytuj
Disallow /redaktirovat
Disallow /edit_after_signup
Disallow /diy/new
Disallow /gewerblich/
Disallow /commercial/
Disallow /comercial/
Disallow /commerciale/
Disallow /commercieel/
Disallow /ticari/
Disallow /komercyjne/
Disallow /komersial/
Disallow /b2b
Disallow /b2b/

Other Records

Field Value
crawl-delay 25

yandex

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /a/partial/
Disallow /admin/seo_elements/
Disallow /seleccionado/

Other Records

Field Value
crawl-delay 3

semrushbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

coccocbot-web

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

awariobot

Rule Path
Disallow /

sentibot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

geedobot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://s3-eu-west-1.amazonaws.com/homify-production-sitemaps/us/sitemap.xml

Comments

  • Setup roles for crawling bots
  • Allow all crawler bots
  • Request rating
  • Search section
  • New ideabooks
  • New projects
  • New professional reviews
  • Edit pages
  • DIY
  • b2b/commercial pages