DEVELOPER - GCP & DATA ENGINEER
Descrição da oferta de emprego
Key Responsibilities.
• Design and develop scalable data engineering solutions using Google Cloud Platform (GCP) and PySpark.
• Optimize Spark jobs for performance, scalability, and efficient resource utilization.
• Develop, maintain, and enhance ETL pipelines using BigQuery, Apache Airflow, and Cloud Composer.
• Collaborate with data scientists, analysts, and DevOps teams to translate business requirements into technical solutions.
• Ensure data integrity and security by implementing data governance, compliance, and security best practices.
• Monitor production workloads, troubleshoot performance issues, and implement enhancements.
• Implement and enforce coding standards, best practices, and performance tuning strategies.
• Support migration activities from on-premises data warehouses to GCP-based solutions.
• Mentor junior developers and contribute to knowledge-sharing within the team.
• Stay up to date with emerging cloud technologies, tools, and best practices in the data engineering ecosystem.
Required Skills & Experience.
• ņ+ years of total experience in data engineering.
• ń+ years of hands-on experience with Google Cloud Platform (GCP), including BigQuery, Apache Airflow, and Cloud Composer.
• Strong expertise in developing and optimizing large-scale data processing solutions using Pyspark and Python.
• In-depth knowledge of SQL for data transformation and performance optimization.
• Proficiency in big data technologies such as Hadoop, HDFS, Hive, and YARN.
• Experience with distributed computing principles, data partitioning, and fault tolerance.
• Hands-on experience with CI/CD pipelines, version control (Git), and automation tools.
• Strong problem-solving, analytical, and troubleshooting skills.
• Experience working in Agile/Scrum environments.
• Excellent communication and collaboration skills to work with offshore and onshore teams.
Skills.
Analytical Thinking Google Cloud Platform Hadoop Hive Python SQL What you can expect from us.
Together, as owners, let’s turn meaningful insights into action.
Life at CGI is rooted in ownership, teamwork, respect and belonging.
Here, you’ll reach your full potential because… You are invited to be an owner from day 1 as we work together to bring our Dream to life.
That’s why we call ourselves CGI Partners rather than employees.
We benefit from our collective success and actively shape our company’s strategy and direction.
Your work creates value.
You’ll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas, embrace new opportunities, and benefit from expansive industry and technology expertise.
You’ll shape your career by joining a company built to grow and last.
You’ll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons.
Come join our team—one of the largest IT and business consulting services firms in the world.
Detalhes da oferta
- CGI
- Em todo Portugal
- Indeterminado - Indeterminado
- Indeterminado
- 09/03/2025
- 07/06/2025
Fórum selecção is looking for a senior data engineer (m/f) for a corporate bank main activities: - design high-performance data pipelines (etl) to feed a dwh using state of the art data engineering techniques according to business specifications; - implement flow automation through ci/cd pipelines and......
Js sw developer location: lisbon, portugal, occupation: full time, onsite min... net sw developer profile with a minimum experience of 3 years... we also inform you that your data will be kept in the company for a period of 5 years... js (3+ years) experience with web applications (backend), distributed......
Claire joster is currently recruiting for a portuguese company of power generating, oil&gas; and material handling sectors, which intends to strengthen its internal structure with the integration of a mechanical engineer (m/f) in lisbon... function as a mechanical engineer, you will be responsible for:......
@confidentialnote: mne library of python will be used to explore, visualise and analysehuman neurophysiological data... ● clinic needs to click on “stop data stream” to stop the recording, after thesession is completed... ● once the board is set up, the clinic needs to click on “start data stream” tostart......
Js) sw developer location: carnaxide, lisbon, portugal, occupation: full-time uniksystem is expanding the java center of excellence (coe) to support international growth and unik low-code bpm platform, our key software product... we’re looking for new team members with the profile of frontend sw developer......
Pertencendo ao grupo buyme, empresa que já conta com 25 anos no mercado, a buyme business atua na intermediação da compra e venda de empresas, na realização de projetos de investimentos, fundos perdidos, consultorias, análises de crédito entre outros, e procura: business developer......
Outros dados de posição #getready to meet with us! ready to code the future? apply with your cv in english/portuguese and agree to personal data processing: *****@*****... ability to work independently and in teams... participate in code reviews for continuous improvement... debug and troubleshoot software......
If you are interested please apply and attach your cv in english or portuguese, including a statement that you agree to our processing and storing of your personal data... deep understanding of application development lifecycle, integration, support, and maintenance outros dados de posição it is a strong......
Familiarity with related tech like cics and jcl... debug and maintain smooth operations... document changes to cobol programs... strong problem-solving skills... as a cobol developer, you'll transform legacy systems for our innovative client, enhancing critical applications... develop tests for app reliability......
Test engineer (automation) – air traffic management airspace industry in the role of the automation test engineer at atos you will: · develop and configure test automation frameworks and execute stability and performance tests... · record test results and report and verify software bug fixes to accept......
