Ir para o conteúdo
Logotipo da Catho
Seu novo emprego está na palma das suas mãos! Baixe nosso app e obtenha vantagens :)
Botão App StoreBotão Play Store

Vaga de Data Engineer

1 vaga: | Publicada em 06/07

Sobre a vaga

ITTConnect is seeking a Data Engineer to fill a position with a US client. This is a long term (12 months+) position with a client that is a global leader in consulting, digital transformation, technology and engineering services present in nearly 50 countries. As Data Engineer, you will work on one of the world's largest social media platforms, which deals with a few petabytes of data coming to the system daily. You will contribute as part of R&D self-organized team working in a challenging, innovative environment for our client. Investigate, create, and implement the solutions for many technical challenges using cutting edge technologies, including building/enhancing Data processing platform enabling work of software used by hundreds of millions of users. Job location : Remote, work from home anywhere in Brazil . Must speak English . All interviews will be done in English, as well as the work after that. Requirements : 5+ years' experience as Data Engineer with strong Python & PySpark coding skills. 3+ years experience working in data migration, data preparation, data gateway, and data warehousing projects. 3+ years of experience in ETL orchestration in AWS S3 and workflow management tools like Airflow, or Oozie. Experience in Spark, Snowflake & Databricks. Expert in Database fundamentals, SQL and distributed computing. 3+ years' experience with Apache Superset, Apache Airflow, Spark and understanding on how these technologies work internally. Rigor in high code quality, automated testing, and other engineering best practices Strong OOP skills Effective communication, collaboration, and interpersonal skills Good English (oral & written) and communication skills in general. University degree in Computer Related Sciences or similar Would be a plus : Experience work with Apache Parquet. Benefits: None (PJ contract).