DATA ENGINEER (CLOUD: GCP)
Descrição da oferta de emprego
As a Data Engineer, you will play a key role in understanding business and technological challenges, developing efficient data pipelines, and ensuring the smooth deployment of solutions.
You will apply industry best practices while helping evolve the data architecture and infrastructure of our company.
e are seeking a skilled and motivated Data Engineer to join our dynamic team.
As a Data Engineer, you will play a key role in understanding business and technological challenges, developing efficient data pipelines, and ensuring the smooth deployment of solutions.
You will apply industry best practices while helping evolve the data architecture and infrastructure of our company.
Key Responsibilities.
Project Understanding and Communication.
Understand business challenges from the user’s perspective and clearly communicate to ensure a deep understanding of the issues.
Collaborate with the Data Architect to fully comprehend the provided architecture and ensure alignment with your work.
Communicate technical solutions with your peers and provide regular updates to the Project Manager overseeing the project.
Development.
Write clear interface contracts for new or updated features and ensure they are communicated effectively.
Develop data pipelines based on the defined architecture.
Apply best practices to ensure quality code and maintainable solutions.
Deploy infrastructure as requested, with a particular focus on using Terraform.
Conduct peer code reviews and actively engage in reviewing peers’ code when merging new versions.
Testing.
Collaborate with the Project Manager to define tests based on functional and technical requirements.
Perform tests and regularly communicate the results to the team.
Document and summarize test results for ongoing monitoring and improvements.
Deployments.
Present completed work to the Data Architect and Lead DataOps during Deployment Reviews.
Track and communicate any potential issues during the active monitoring phase after deployment.
Diligently apply the deployment process, including logging and monitoring strategies.
Key Responsibilities.
Project Understanding and Communication.
Understand business challenges from the user’s perspective and clearly communicate to ensure a deep understanding of the issues.
Collaborate with the Data Architect to fully comprehend the provided architecture and ensure alignment with your work.
Communicate technical solutions with your peers and provide regular updates to the Project Manager overseeing the project.
Development.
Write clear interface contracts for new or updated features and ensure they are communicated effectively.
Develop data pipelines based on the defined architecture.
Apply best practices to ensure quality code and maintainable solutions.
Deploy infrastructure as requested, with a particular focus on using Terraform.
Conduct peer code reviews and actively engage in reviewing peers’ code when merging new versions.
Testing.
Collaborate with the Project Manager to define tests based on functional and technical requirements.
Perform tests and regularly communicate the results to the team.
Document and summarize test results for ongoing monitoring and improvements.
Deployments.
Present completed work to the Data Architect and Lead DataOps during Deployment Reviews.
Track and communicate any potential issues during the active monitoring phase after deployment.
Diligently apply the deployment process, including logging and monitoring strategies.
Qualifications Requested Hard Skills.
Google Cloud Platform (GCP).
Strong knowledge of GCP and at least one year of hands-on experience with its services.
Azure Cloud Platform.
General knowledge of Azure is a plus.
Apache Airflow.
Minimum of two years of experience with Airflow orchestration; experience with Google Composer is an advantage.
Terraform.
Experience deploying infrastructure, especially using Terraform.
Desired Soft Skills.
Strong communication skills for effective collaboration with cross-functional teams.
Ability to tackle problems from a user perspective and ensure clear understanding across technical teams.
Strong problem-solving abilities and a proactive approach to resolving issues.
Detail-oriented, results-driven, and capable of working independently and as part of a team.
Additional Information If you have experience with data pipelines, cloud technologies, and orchestrators like Apache Airflow, and you're looking for a new challenge, we’d love to hear from you! I'm interested I'm interested Privacy Policy
Detalhes da oferta
- Indeterminado
- 17/12/2024
- 17/03/2025
Fórum selecção is looking for a senior data engineer (m/f) for a corporate bank main activities: - design high-performance data pipelines (etl) to feed a dwh using state of the art data engineering techniques according to business specifications; - implement flow automation through ci/cd pipelines and......
Claire joster is currently recruiting for a portuguese company of power generating, oil&gas; and material handling sectors, which intends to strengthen its internal structure with the integration of a mechanical engineer (m/f) in lisbon... function as a mechanical engineer, you will be responsible for:......
Please include 'automation and robotics engineer application' in the subject line... position overview: we are looking for a creative automation and robotics engineer to contribute to the design, development, and implementation of cutting-edge automation and robotics solutions... collaborate with cross-functional......
We are looking for a senior qa engineer with the following requirements: requisitos do trabalho • minimum of +6 years of relevant experience;• repository practice (i... );• user acceptance testing knowledge;• cypress;• browserstack;• java;• synthetic data creation;• iam test accounts;• appium;• experience......
Test engineer (automation) – air traffic management airspace industry in the role of the automation test engineer at atos you will: · develop and configure test automation frameworks and execute stability and performance tests... · execute performance testing and present results for validating and analysis......
Obligations: openshift/kubernetesdockersgithubartifact (jfrog)ansiblepython/powershelljira/confluencelinux administrationbasic knowledge of databasesteam player and being able to be part of a community to share information/knowledge good to have: azure/awsgerman speaker job type:full time......
Therefore we encourage all individuals to apply! please provide your cv (already with certificates, employer's references, etc... com/de/pixida3) apply now! pixida is proud to be an equal opportunity employer! we are committed to a work environment that supports, inspires and respects all individuals......
Minimo 6 anos de experiência* licenciatura em tecnologia ou engenharia informática (ou similar)* experiência em java* conhecimento de ferramentas de ci/cd (por exemplo, jenkins, circle ci)* experiência com testng: anotações e framework* experiência com bdd, nomeadamente cucumber* experiência prática......
Excellent problem-solving skills and patience when dealing with users... collect and relay user feedback to improve overall user experience... work closely with the product and development teams to resolve complex technical issues... outros dados de posição excellent remuneration package based on experience......
Excellent problem-solving skills and patience when dealing with users... collect and relay user feedback to improve overall user experience... work closely with the product and development teams to resolve complex technical issues... outros dados de posição excellent remuneration package based on experience......