DATA ENGINEER
Descrição da oferta de emprego
MDC team delivers Data Products which fuel mission critical use cases, e.
.
Fleet Diagnostics, Process Efficiency, Availability Reporting and others They process data coming from machines installed worldwide (around machines sending data daily) Currently they are focused on migrating their workloads from legacy on-prem environment to ADAP on Azure.
Challenges.
• Cloud spendings • Pipelines performance • Pipelines orchestration • Data monitoring.
Understanding of impact from upstream data quality issues on downstream datasets on records level, w/o explicit DQ checks What are we looking for? Development Support of existing pipelines.
Resolving new/complex data issues and root cause analysis in the Generated Business Record (Gold layer) Implementation of new demand coming from Data Consumers or from Platform team (e.
.
in case of changes in the Azure DevOps stack) A candidate will be responsible for maintaining existing systems and implementing future changes as client's consumption needs and ingestion evolve, becoming larger and more extensive.
Key Responsibilities.
Maintain and enhance existing data systems Develop enhancements for the existing Data Platform Implement future changes to accommodate growing consumption needs and ingestio Work with complex datasets, including the addition of new datasets from scratch Collaborate with senior team members on complex projects, particularly when adding new large datasets Grow with the technological landscape, adapting to new tools and methodologies as they emerge Required skills and experience.
• Proficiency in PySpark • Knowledge of the Azure cloud stack • Experience in working with large and complex datasets • Ability to work in a team and collaborate with various stakeholders Nice to have.
• Experience in Azure Analytics Engineering • Familiarity with DevOps practices What can you expect from us? • A permanent job contract for a long term project • Tech equipment + SIM Card + personal smartphone • Health and Life Insurance • Social events and team buildings • The commitment of letting you grow with us, and be rewarded accordingly • A dynamic and young team that will be always there to support you • Training in the latest technologies • Coffee, fruits, snacks and a warm welcoming when you pass by the office
Detalhes da oferta
- Caixa Mágica Software
- Indeterminado
- 30/08/2024
- 28/11/2024
Maintenance) of raw data from various data sources into the data warehouse;• automation and optimization of data imports;• preparation and normalization of data;• creating sap bo reports with multiple data sources;• at least 3 year’s experience in data analysis and/or reporting, ideally in a data warehouse......
Devops engineer location: carnaxide, lisbon, portugal, occupation: full time min... com/careers/devops-engineer/ as a candidate you've decided to provide us your personal data... who we are: unikystem is a low-code bpm automation platform boosted by cognitive data capture with 100% accuracy, that turns......
Claire joster is currently recruiting for a portuguese company of power generating, oil&gas; and material handling sectors, which intends to strengthen its internal structure with the integration of a mechanical engineer (m/f) in lisbon... function as a mechanical engineer, you will be responsible for:......
Please include 'automation and robotics engineer application' in the subject line... position overview: we are looking for a creative automation and robotics engineer to contribute to the design, development, and implementation of cutting-edge automation and robotics solutions... collaborate with cross-functional......
We are looking for a senior qa engineer with the following requirements: requisitos do trabalho • minimum of +6 years of relevant experience;• repository practice (i... );• user acceptance testing knowledge;• cypress;• browserstack;• java;• synthetic data creation;• iam test accounts;• appium;• experience......
Test engineer (automation) – air traffic management airspace industry in the role of the automation test engineer at atos you will: · develop and configure test automation frameworks and execute stability and performance tests... · analyse and verify best automated and manual test approaches and execute......
Job missionbiosurfit is looking for a talented engineer to join its research and development team... biosurfit is a portuguese diagnostics company focused on the development and manufacture of ivd tests for the point-of-care market with highly innovative proprietary technology and dedicated to the provision......
Obligations: openshift/kubernetesdockersgithubartifact (jfrog)ansiblepython/powershelljira/confluencelinux administrationbasic knowledge of databasesteam player and being able to be part of a community to share information/knowledge good to have: azure/awsgerman speaker job type:full time......
De can give you an impression of our working culture! (https://www... ) in addition, we ask you to provide information about your possible start date, salary expectations and language skills... com/de/pixida3) apply now! pixida is proud to be an equal opportunity employer! we are committed to a work......
Minimo 6 anos de experiência* licenciatura em tecnologia ou engenharia informática (ou similar)* experiência em java* conhecimento de ferramentas de ci/cd (por exemplo, jenkins, circle ci)* experiência com testng: anotações e framework* experiência com bdd, nomeadamente cucumber* experiência prática......
