Vaga de Mid Data Engineer
1 vaga: | Publicada em 04/10
- A combinar
Sobre a vaga
About the Team/Role
Were the Data Platform team. We are the core data infrastructure and workflow
group at the company, working with cutting-edge cloud data technologies. Our team
works hard, covers for one another, and maintains work-life balance. We own our
results and we take pride of ownership in everything we do.
As a Data Engineer at WEX, youll be responsible for building and maintaining the
bridge between our data and the rest of the organization. Youll work with
stakeholders to understand business requirements and then implement SQL-first
transformation workflows to deploy analytics code.
Youll help ensure the integrity, reliability, and usability of data for
stakeholders, so they can make critical data-driven decisions. Youll be part of a
collaborative scrum team that consists of an Agility Engineer, Technical Program
Manager, Integrated Data Engineers and DevOps. Youll also be supported by a
manager that is here to listen and help you grow.
Our team of professionals works hard, covers for one another, and maintains a
work-life balance. We own our results and we take pride in ownership in everything
we do.
Changing the world isnt easy, and we have a lot of work ahead of us. From new
product features to automation, to supporting microservices, weve got more work
than we can handle and were looking for great people to come along for the ride.
How youll make an impact
Design and Implement data driven strategies that transform processes to enable
efficiency and scale
Create new process flows to implement Artificial Intelligence and Machine Learning
Translate data transformation strategies into implementation plans, then execute
on those plans to deliver requirements
Respond to changing business requirements by adapting data stores to address
current business conditions
Work collaboratively with the Data Engineering team to create data streams from
WEX source systems into the Data Platform
Collaborate on, and implement solutions that enable Analysts to leverage Data
Science tools and applications to drive improvements
Youll be part of a collaborative scrum team that consists of an Agility Engineer,
Technical Program Manager, Data Engineers, QA, and DevOps. Youll also be
supported by a manager that is here to listen and help you grow.
Experience youll bring
Have a BS or MS in a relevant field OR can make us feel intensely confident that
you dont need one
Creating optimized data pipelines using any one of integration tools like
Informatica IICS, Qlik Replicate, Fivetran, custom code using Python, and
snowflake Snowpipes
Working with stakeholders to understand business requirements and then implement
SQL-first transformation workflows to deploy analytics code using dbt (data build
tool)
Creating efficient data marts that are catered towards the needs of very specific
business units, functions, or departments
Have a BS or MS in an engineering field OR can make us feel intensely confident
that you dont need one
Solid development experience in Data Engineering
Great experience working on Snowflake database ( Loading and Unloading using Copy
Into & Snowpipe, tasks, RBAC, Zero copy Cloning etc)
Great experience working on DBT to perform data transformation tasks
Experience working with Python
Experience working with SQL
Great experience working with ETL tools like Informatica IICS, Talend etc
Good understanding of data design principles and dimensional data modeling
Good SQL skills and understanding of query optimization strategies in Snowflake
Fundamental understanding of DAGs and operators in Airflow, with hands-on
experience with action and sensor operators
Fundamental understanding of Docker and deploying code as a container
Good understanding of basic programming concepts in Python or similar modern
languages
Understanding on integrating structured /unstructured data ,flat files and SaaS
(e.g. Salesforce, Workday) data sources using any of the tools like Informatica
IICS, Talend ,Qlik, SAS etc.
Have experience with DevOps practices and procedures
Be able to leverage WEXs Data Platform using documented standards & best practice