DATA ENGINEER BIG DATA MIGRATION SPECIALIST
Descrição da oferta de emprego
The role involves ensuring performance optimization adherence to best practices and comprehensive documentation throughout the process.
Key Responsibilities.
Migration Tasks.
Migrate existing processes implemented in Scala on GCP to PySpark on Azure.
Ensure the consistency and integrity of data and processes during migration.
Optimization and Best Practices.
Identify and implement performance improvements.
Apply best practices in data engineering and cloudbased solutions.
Documentation.
Document business rules and processes implemented in the system.
Provide clear and organized technical documentation to ensure process transparency and reproducibility.
Requirements.
Proven experience with.
Google Cloud Platform (GCP) and Microsoft Azure.
Scala and PySpark for Big Data processing.
Tools like Apache Spark and Big Data pipelines.
Strong ability to document complex systems and identify optimization opportunities.
Excellent communication and organizational skills.
Details.
Work Location.
Hybrid (12 days per week at the client office in UTL Lisbon).
Take on this exciting challenge to leverage your expertise in Big Data and cloud migration in a dynamic and innovative environment!
Detalhes da oferta
- Bonapolia
- Em todo Portugal
- Indeterminado - Indeterminado
- Indeterminado
- 15/12/2024
- 15/03/2025
Fórum selecção is looking for a senior data engineer (m/f) for a corporate bank main activities: - design high-performance data pipelines (etl) to feed a dwh using state of the art data engineering techniques according to business specifications; - implement flow automation through ci/cd pipelines and......
Claire joster is currently recruiting for a portuguese company of power generating, oil&gas; and material handling sectors, which intends to strengthen its internal structure with the integration of a mechanical engineer (m/f) in lisbon... function as a mechanical engineer, you will be responsible for:......
Please include 'automation and robotics engineer application' in the subject line... position overview: we are looking for a creative automation and robotics engineer to contribute to the design, development, and implementation of cutting-edge automation and robotics solutions... collaborate with cross-functional......
We are looking for a senior qa engineer with the following requirements: requisitos do trabalho • minimum of +6 years of relevant experience;• repository practice (i... );• user acceptance testing knowledge;• cypress;• browserstack;• java;• synthetic data creation;• iam test accounts;• appium;• experience......
Job summary: our company is seeking a payroll specialist jr... responsibilities: manage and oversee all payroll functions for the company process payroll on a timely and accurate basis, including tracking hours worked, calculating pay, and deducting taxes and other withholdings ensure compliance with......
Test engineer (automation) – air traffic management airspace industry in the role of the automation test engineer at atos you will: · develop and configure test automation frameworks and execute stability and performance tests... · execute performance testing and present results for validating and analysis......
We are big on team spirit, and that's why you'll work closely with the other departments of the company to be able to give our customers the best service and to increase customer satisfaction and loyalty... requisitos do trabalho you are fluent in italian and english (written & spoken) and have an understandable......
We are big on team spirit, and that's why you'll work closely with the other departments of the company to be able to give our customers the best service and to increase customer satisfaction and loyalty... requisitos do trabalho you are fluent in french and english (written & spoken) and have an understandable......
Marketing materials:- translate brochures and other marketing materials from de>pt and en>pt... localize legal pages to comply with portuguese laws and regulations... proven experience in translation and content localization, preferably in the product or marketing sectors... content localization- translate......
Schedule: full-time schedule of 40 hours a week, monday to friday, with the breaks provided by law... job description: interfaces with customers via inbound calls, outbound calls, or through the internet depending upon client requirements... we're selecting call center operator (m/f) for a company in......
