Ir para o conteúdo
Logotipo da Catho
Seu novo emprego está na palma das suas mãos! Baixe nosso app e obtenha vantagens :)
Botão App StoreBotão Play Store

Vaga de Mid Data Engineer

1 vaga: | Publicada em 04/10

Sobre a vaga

About the Team/Role Were the Data Platform team. We are the core data infrastructure and workflow group at the company, working with cutting-edge cloud data technologies. Our team works hard, covers for one another, and maintains work-life balance. We own our results and we take pride of ownership in everything we do. As a Data Engineer at WEX, youll be responsible for building and maintaining the bridge between our data and the rest of the organization. Youll work with stakeholders to understand business requirements and then implement SQL-first transformation workflows to deploy analytics code. Youll help ensure the integrity, reliability, and usability of data for stakeholders, so they can make critical data-driven decisions. Youll be part of a collaborative scrum team that consists of an Agility Engineer, Technical Program Manager, Integrated Data Engineers and DevOps. Youll also be supported by a manager that is here to listen and help you grow. Our team of professionals works hard, covers for one another, and maintains a work-life balance. We own our results and we take pride in ownership in everything we do. Changing the world isnt easy, and we have a lot of work ahead of us. From new product features to automation, to supporting microservices, weve got more work than we can handle and were looking for great people to come along for the ride. How youll make an impact Design and Implement data driven strategies that transform processes to enable efficiency and scale Create new process flows to implement Artificial Intelligence and Machine Learning Translate data transformation strategies into implementation plans, then execute on those plans to deliver requirements Respond to changing business requirements by adapting data stores to address current business conditions Work collaboratively with the Data Engineering team to create data streams from WEX source systems into the Data Platform Collaborate on, and implement solutions that enable Analysts to leverage Data Science tools and applications to drive improvements Youll be part of a collaborative scrum team that consists of an Agility Engineer, Technical Program Manager, Data Engineers, QA, and DevOps. Youll also be supported by a manager that is here to listen and help you grow. Experience youll bring Have a BS or MS in a relevant field OR can make us feel intensely confident that you dont need one Creating optimized data pipelines using any one of integration tools like Informatica IICS, Qlik Replicate, Fivetran, custom code using Python, and snowflake Snowpipes Working with stakeholders to understand business requirements and then implement SQL-first transformation workflows to deploy analytics code using dbt (data build tool) Creating efficient data marts that are catered towards the needs of very specific business units, functions, or departments Have a BS or MS in an engineering field OR can make us feel intensely confident that you dont need one Solid development experience in Data Engineering Great experience working on Snowflake database ( Loading and Unloading using Copy Into & Snowpipe, tasks, RBAC, Zero copy Cloning etc) Great experience working on DBT to perform data transformation tasks Experience working with Python Experience working with SQL Great experience working with ETL tools like Informatica IICS, Talend etc Good understanding of data design principles and dimensional data modeling Good SQL skills and understanding of query optimization strategies in Snowflake Fundamental understanding of DAGs and operators in Airflow, with hands-on experience with action and sensor operators Fundamental understanding of Docker and deploying code as a container Good understanding of basic programming concepts in Python or similar modern languages Understanding on integrating structured /unstructured data ,flat files and SaaS (e.g. Salesforce, Workday) data sources using any of the tools like Informatica IICS, Talend ,Qlik, SAS etc. Have experience with DevOps practices and procedures Be able to leverage WEXs Data Platform using documented standards & best practice