DATA ENGINEER / DEVOPS
Descrição da oferta de emprego
From autonomous cars to life-saving robots, our digital and software technology experts think outside the box as they provide unique R&D and engineering services across all industries.
Join us for a career full of opportunities.
Where you can make a difference.
Where no two days are the same.
our roleWe are seeking a skilled Data Engineer to join our dynamic team.
The ideal candidate will be responsible for developing, maintaining, and optimizing our data pipeline architecture while ensuring the availability and performance of critical data workflows.
If you are passionate about data engineering, have hands-on experience with cloud platforms and big data technologies, and are a strong problem-solver, this is the role for you.
esign, build, and maintain scalable, efficient, and reliable data pipelines to support data processing and analytics;Implement best practices in Big Data tools and frameworks, ensuring data integrity and performance;Collaborate with cross-functional teams to integrate new data sources and optimize data pipelines;Work with complex datasets, ensuring data quality, transformation, and storage in BigQuery;Troubleshoot data pipeline issues and implement long-term solutions to improve system stability;Write and optimize complex SQL queries for data extraction and analysis;Utilize Kafka for real-time data streaming and event-driven architecture;Implement solutions using Python for data processing and ETL workflows;Perform code reviews and maintain high-quality code standards.
our profileProficiency in BigQuery with 3+ years of experience;3+ years of experience of Spark in large-scale data processing;3+ years of experience of SQL in writing and optimizing complex queries;Advanced proficiency in Python with 4+ years of experience in scripting and automation;2+ years of experience of Kafka with real-time data streaming;Effective communication in English, both verbal and written.
Nice to Have.
xperience with Google Dataflow and Google Dataproc for managing data pipelines in GCP;Knowledge of Scala for parallel data processing;Familiarity with Hadoop for distributed storage and processing of big data.
hat you'll love about working hereJoin a multicultural and inclusive team environment;Enjoy a supportive atmosphere promoting work-life balance;Engage in exciting national and international projects;Hybrid work;Your career growth is central to our mission.
Our array of career growth programs and diverse professionals are crafted to support you in exploring a world of opportunities;Training and certifications programs;Referral program with bonuses for talent recommendations;Great office locations.
hy Capgemini?Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like, where you’ll be supported and inspired by a collaborative community of colleagues around the world, and where you’ll be able to reimagine what’s possible.
Join us and help the world’s leading organizations unlock the value of technology and build a more sustainable, more inclusive world.
pply now!
Detalhes da oferta
- Indeterminado
- Em todo Portugal
- Indeterminado - Indeterminado
- Indeterminado
- 15/10/2024
- 12/01/2025
Fórum selecção is looking for a senior data engineer (m/f) for a corporate bank main activities: - design high-performance data pipelines (etl) to feed a dwh using state of the art data engineering techniques according to business specifications; - implement flow automation through ci/cd pipelines and......
Obligations: openshift/kubernetesdockersgithubartifact (jfrog)ansiblepython/powershelljira/confluencelinux administrationbasic knowledge of databasesteam player and being able to be part of a community to share information/knowledge good to have: azure/awsgerman speaker job type:full time......
Claire joster is currently recruiting for a portuguese company of power generating, oil&gas; and material handling sectors, which intends to strengthen its internal structure with the integration of a mechanical engineer (m/f) in lisbon... function as a mechanical engineer, you will be responsible for:......
Please include 'automation and robotics engineer application' in the subject line... position overview: we are looking for a creative automation and robotics engineer to contribute to the design, development, and implementation of cutting-edge automation and robotics solutions... collaborate with cross-functional......
We are looking for a senior qa engineer with the following requirements: requisitos do trabalho • minimum of +6 years of relevant experience;• repository practice (i... );• user acceptance testing knowledge;• cypress;• browserstack;• java;• synthetic data creation;• iam test accounts;• appium;• experience......
Test engineer (automation) – air traffic management airspace industry in the role of the automation test engineer at atos you will: · develop and configure test automation frameworks and execute stability and performance tests... · analyse performance test requirements and develop test plans and debug......
• creation of hazard analyses and risk assessments • development of reports and safety concepts with respect to iso 26262 • testing and validation in relation to functional safety requirements • definition and monitoring of development interface agreement (dia) as well as analysis of safety relevant......
Minimo 6 anos de experiência* licenciatura em tecnologia ou engenharia informática (ou similar)* experiência em java* conhecimento de ferramentas de ci/cd (por exemplo, jenkins, circle ci)* experiência com testng: anotações e framework* experiência com bdd, nomeadamente cucumber* experiência prática......
Rainsteal oil and gas will continue to establish new businesses, make acquisitions and alliances in order to steadily develop rainsteal oil and gas as a quality supplier... vacant positions: roustabouts / roughnecks, welders / mechanics, rig operators / drillers, engineers (petroleum and mechanical)......
Responsabilidades: levar a cabo projetos no âmbito do desenvolvimento da oferta para os clientes, através de soluções de business intelligence / data analytics; propor e implementar melhorias nas plataformas e processos existentes; envolvimento direto em projetos estratégicos que visam desenvolver soluções......