Vaga de Principal Cloud Data Engineer

Principal Cloud Data Engineer Brazil Req #2561 Friday, May 31, 2024 Questrade Financial Group (QFG) of Companies is committed to helping our customers become much more financially successful and secure. We are everything a traditional financial institution is not. At QFG, you will be constantly moving forward, bringing the future of fintech into existence. You will be a part of a collaborative team that cares deeply about our mission and each other. Your team members will help you conquer challenges, push boundaries and discover what you are truly capable of. This is a place where you can explore, discover and learn with continuous growth. As a diverse and inclusive place to work, there are flexible working arrangements so you can unleash your creativity and curiosity with no limits. If you share the same sense of infinite possibility, come shape your future at Questrade. The Questrade Technology Group (QTG) is home to a unique environment, where our culture thrives and most importantly, we get stuff done! Questrade is continuing with its digital transformation initiative and our infrastructure footprint is growing beyond our data centers and into the Google Cloud Platform. We are currently working towards our exciting strategy that is driven by business value. Join us and help solve some complex challenges such as handling low latency and high traffic market data, event streams and messaging, in a hybrid cloud environment within an industry that has so much room for disruption.Were looking for our next Principal Cloud Data Engineer. Could It Be You? The Principal Cloud Data Engineer will work with a primary focus on delivering Questrades Data Platform footprint, as an expansion of our cloud presence, enabling key initiatives such as our Digital Banking. This role will be working with several teams in the organization in a collaborative manner, helping deliver data related components that enable productivity across QTG by leveraging automation to deliver self-service components as much as possible. This key individual will be part of a team that designs and drives the implementation of data components such as pipelines, applications, sanitation, supporting our data scientists and working with the rest of the product teams while collaborating with the architecture team, influencing the design and delivery of our data footprint and striving for greater functionality in our data systems.Whats it like working as a Principal Cloud Data Engineer at Questrade?Our Principal Cloud Data Engineer needs to be able to gather and understand data requirements, present it to software engineers, and work in the team to achieve high quality data ingestion goals. This Engineer will need a passion for complex problems, and enjoy the challenge of operating complex and mission critical systems under extreme loads. Do you think you are up to the challenge? Would you like to learn more and stretch your skills and career?In this role, you will be a technical expert with significant scope and impact. You will work closely with a group of Software Engineers, Product Managers, Data Scientists, and Data Engineers to create the cloud infrastructure, ci/cd pipelines, data infrastructure and data platform capabilities necessary to drive Questrades initiatives.Successful candidates should come from a strong data and software engineering background. You need to have experience with structured and unstructured data, and being able to analyze/transform the data using various tools. You need to have experience in Cloud Foundations, Cloud Data Analytics Services, Terraform and CI/CD Pipelines. Often, the pace of innovation and change implies a need to set up connections to new data sources, and our Data Platform Engineers get to participate in deep diving business use cases in order to provide automated solutions. Your analytical skills and knowledge of schema metadata will be essential. Need more details? Keep reading... Design solutions aligned with long-term architecture and technology strategy using Google Cloud Platform for Cloud developmentCreate and maintain optimal data pipeline architecture.Design and create new features and automated solutions that meet functional / non-functional business requirements.Identify, design, and implement internal process improvements: automating manual processes,implementing data governance rules, re-designing infrastructure for greater scalability, etc.Provide strategic leadership collaborating with cross-functional teams to advise on which tools and designs to use within specific data integration scenarios.In Depth understanding of Data Protection and Network security rules setup on Cloud Infrastructure.Expand and increase data platform capabilities to resolve new data problems and challenges by identifying, sourcing, and integrating new dataWork with stakeholders to assist with data-related technical issues and support their data infrastructure needs.Peer review code and promote dev ops culture within the data teams.Have a good understanding of data platform best practices to achieve economies of scale, cost reduction and efficiencies.Monitor and anticipate trends in data engineering, and propose changes in alignment with organizational goals and needs.Stay current with new data vendor product offerings and how they might be used in the platform. So are YOU our next Principal Cloud Data Engineer? You are if& Minimum 5+ years of experience working as a Senior Engineer in the data engineering field.Proficiency in SQL language.Strong knowledge of Python language.Experience in optimization of high volume ETL processes.Experience with any of the popular Clouds (GCP, AWS, Azure).Good knowledge in Message Broker systems (e.g., Kafka, PubSub).Experience with ML Models using Google Vertex AI would be a plus.Data modeling skills.Good knowledge of popular data standards and formats (e.g, JSON, XML, Proto, Parquet, Avro, ORC, etc)Experience in building Terraform scripts will be preferred.Familiarity with microservices architecture, and experience in containerization and kubernetes is an asset.Experience in the financial industry is an asset. Google GCP data platform (Dataflow, Dataprep, Cloud Composer, BigQuery, CloudSQL) knowledge and experience is an asset, or knowledge of the equivalent open source toolset behind those products. Soft Skills Service-oriented and a willingness to mentor the team in any way to ensure project success.Demonstrated leadership, mentoring, and collaboration skills balancing strategic and tactical needs.Loves to learn and demonstrates interest in learning Questrades business and ongoing professional development.Proactive, takes ownership of tasks and drives projects through to completion.Good critical thinking and problem solving skills.Flexible to work in different settings (individually/ with team/in a fast paced environment).Flexible to take on varied responsibilities.Calm and patient under pressure.Develops constructive and cooperative working relationships with team-mates.Positive energy and ability to energize others.Excellent communication skills.Excellent English, both written and verbal. Sounds like you? Click below to apply! #LI-CP1 #LI-Remote At Questrade Financial Group of Companies, with multiple office locations around the world, we are committed to fostering a diverse, inclusive and accessible work environment. This is an environment where individuals are treated with dignity and respect. Here, the unique skills and experience you bring will be valued. You will be supported and motivated, so that you can harness your unlimited potential. Our team reflects the diversity of the communities we serve and operate in. Having a collaborative and diverse team helps us push boundaries to bring the future of fintech into existencenot only for the benefit of our customers, but for those who build their career with us. Candidates selected for an interview will be contacted directly. If you require accommodation during the recruitment/selection process, please let us know and we will work with you to meet your needs. Other details Pay Type Salary Brazil Share this job: