Big Data Developer (Snowflake)

Nice to meet you - we are Kornit Digital!

Kornit Digital is a worldwide market leader in sustainable, on-demand, digital fashion and textile production technologies. The Company is writing the operating system for fashion with end-to-end solutions including digital printing systems, inks, consumables, and an entire global ecosystem that manages workflows and fulfilment.

Every day we take the chance to re-invent, create, solve, adapt, improve and conquer the unexpected. Our engagement drives us to change the way people print on textiles today and in the future.

You are invited to be part of it to #expressyourbest!

Click to learn more >

Reports to: Software Manager

Location: Rosh Haain, Park Afek

What will you do?

Migration of existing data warehouses from Azure SQL Database to Snowflake. The current data warehouse, in addition to standard analytical functions, is also a data source for the web application.

Data warehouse implemented in the lambda architecture, combining Real Time data from IoT devices and data from other sources such as SQL server databases. This project is the beginning of the implementation of Single Source Of Truth for the entire organization.

This is an early phase of the project, starting implementation after the design phase.

● analyze and organize raw data

● evaluate business needs and objectives

● data modeling

● architecture designing

● developing ELT logic

● ensuring data quality

● code optimization

● preparing documentation

REQUIREMENTS

What should you have?

· 2 years of experience developing big data platform.

· 2 years of experience in Snowflake - Mandatory

· Azure knowledge (must have):

o Azure Data Factory

o ADLS gen2

o Event Hub/ IoT Hub/ Stream Analytics

o Networking in Azure (Vnet/ subnets/ gateway/ private endpoints) e. Roles and security (Microsoft Entra ID, security groups etc) - Advantage

o Azure Data Explorer (KQL language) will be an additional advantage

· Languages:

o Advanced SQL knowledge (query optimization, partitioning, clustering etc) -> TSQL, ANSI SQL

o Regular Python knowledge

o Git knowledge

o Basic knowledge about NoSQL databases

· Developing ADX - Advantage

· Data Warehousing knowledge – designing, data modelling, methodologies (like Kimball)

· Data Lake and Lakehouse concept – medallion architecture etc

· Big Data concepts knowledge – Hive, Spark, partitioning, scaling up and out, streaming processing

· Basic DevOps knowledge:

o Azure data DevOps (Boards, tasks, creating PR...)

o CICD processes basic knowledge

Don't check all the boxes? Don't sweat it. We’re passionate about building a diverse team of humans and as such, if you think you've got what it takes in our passionate -and-fun, remote-friendly, fast paced environment—apply anyway. While we have a pretty good idea of what we need, we're ready for you to challenge our thinking on who needs to be in this role.

KORNIT is committed to fostering a diverse and inclusive workplace and is proud to be an equal opportunity employer. We encourage people from all backgrounds to apply. We are committed to ensuring that our technology is made available and accessible to everyone. All employment decisions are made without regard to race, color, national origin, ancestry, sex, gender, gender identity or expression, sexual orientation, age, genetic information, religion, disability, medical condition, pregnancy, marital status, family status, veteran status, or any other characteristic protected by law.