DATA ENGINEER
Descrição da oferta de emprego
Machine Data (MDC).
MDC team delivers Data Products which fuel mission critical use cases, e.
.
Fleet Diagnostics, Process Efficiency, Availability Reporting and others.
They process data coming from machines installed worldwide (around machines sending data daily).
Currently they are focused on migrating their workloads from legacy on-prem environment to ADAP on Azure.
A candidate will be responsible for maintaining existing systems and implementing future changes as client consumption needs and ingestion evolve, becoming larger and more extensive.
What will you do? - Cloud spendings; - Pipelines performance; - Pipelines orchestration; - Data monitoring; - Understanding of impact from upstream data quality issues on downstream datasets on records level, w/o explicit DQ checks; - Maintain and enhance existing data systems; - Develop enhancements for the existing Data Platform; - Implement future changes to accommodate growing consumption needs and ingestion; - Work with complex datasets, including the addition of new datasets from scratch; - Collaborate with senior team members on complex projects, particularly when adding new large datasets; - Grow with the technological landscape, adapting to new tools and methodologies as they emerge.
What are we looking for? The customer is looking for a Data Engineer to extend the team capacity.
- Development Support of existing pipelines.
Resolving new/complex data issues and root cause analysis in the Generated Business Record (Gold layer); - Implementation of new demand coming from Data Consumers or from Platform team (e.
.
in case of changes in the Azure DevOps stack); - Proficiency in PySpark; - Knowledge of the Azure cloud stack; - Experience in working with large and complex datasets; - Ability to work in a team and collaborate with various stakeholders; - Experience in Azure Analytics Engineering; - Familiarity with DevOps practices.
What can you expect from us? - A permanent job contract for a long term project; - Tech equipment + SIM Card + personal smartphone; - Health and Life Insurance; - Social events and team buildings; - The commitment of letting you grow with us, and be rewarded accordingly; - A dynamic and young team that will be always there to support you; - Training in the latest technologies; - Coffee, fruits, snacks and a warm welcoming when you pass by the office.
Detalhes da oferta
- Caixa Mágica Software
- Indeterminado
- 13/12/2024
- 13/03/2025
Fórum selecção is looking for a senior data engineer (m/f) for a corporate bank main activities: - design high-performance data pipelines (etl) to feed a dwh using state of the art data engineering techniques according to business specifications; - implement flow automation through ci/cd pipelines and......
Claire joster is currently recruiting for a portuguese company of power generating, oil&gas; and material handling sectors, which intends to strengthen its internal structure with the integration of a mechanical engineer (m/f) in lisbon... function as a mechanical engineer, you will be responsible for:......
Please include 'automation and robotics engineer application' in the subject line... position overview: we are looking for a creative automation and robotics engineer to contribute to the design, development, and implementation of cutting-edge automation and robotics solutions... collaborate with cross-functional......
We are looking for a senior qa engineer with the following requirements: requisitos do trabalho • minimum of +6 years of relevant experience;• repository practice (i... );• user acceptance testing knowledge;• cypress;• browserstack;• java;• synthetic data creation;• iam test accounts;• appium;• experience......
Test engineer (automation) – air traffic management airspace industry in the role of the automation test engineer at atos you will: · develop and configure test automation frameworks and execute stability and performance tests... · execute performance testing and present results for validating and analysis......
Obligations: openshift/kubernetesdockersgithubartifact (jfrog)ansiblepython/powershelljira/confluencelinux administrationbasic knowledge of databasesteam player and being able to be part of a community to share information/knowledge good to have: azure/awsgerman speaker job type:full time......
Therefore we encourage all individuals to apply! please provide your cv (already with certificates, employer's references, etc... com/de/pixida3) apply now! pixida is proud to be an equal opportunity employer! we are committed to a work environment that supports, inspires and respects all individuals......
Minimo 6 anos de experiência* licenciatura em tecnologia ou engenharia informática (ou similar)* experiência em java* conhecimento de ferramentas de ci/cd (por exemplo, jenkins, circle ci)* experiência com testng: anotações e framework* experiência com bdd, nomeadamente cucumber* experiência prática......
Rainsteal oil and gas is a multidiscipline supplier to the oil and gas industry... vacant positions: roustabouts / roughnecks, welders / mechanics, rig operators / drillers, engineers (petroleum and mechanical) health and safety officer, superintendent smp, smp supervisor, document controller clerk,......
Administrative department business analyst, payroll manager, marketing specialist, administration supervisor, human resources officer, financial analyst, senior marketing analyst, logistics coordinator / expert, procurement officer, secretary / office assistants / office clerks / front desk clerks, account......