DATA ENGINEER (W/ DATABRICKS)
Descrição da oferta de emprego
Understand challenges from a user’s perspective, translating them into technical solutions.
You’ll work closely with Data Architects to ensure a shared understanding of project architecture and coordinate with Project Managers to keep all stakeholders aligned; Pipeline Development.
Develop and maintain robust data pipelines based on pre-defined architectures.
You’ll deploy infrastructure using Terraform, and ensure best practices and standards are followed.
Peer review and continuous code enhancement will be part of your routine; Testing & Validation.
Define and perform tests in collaboration with your project manager, ensuring all technical and functional requirements are met.
Document and regularly communicate test results to maintain transparency; Deployment & Monitoring.
Present deployment solutions in reviews with the Lead DataOps and Data Architects, ensuring smooth handovers and tracking any potential issues in post-deployment monitoring.
What are we looking for? +3 years of experience as a Data Engineer; +1 year of experience with Google Cloud Platform and knowledge of Azure Cloud Platform; +2 years of experience with Databricks, including expertise in optimizing queries and table structures (mandatory); +2 years of experience with Apache Airflow (Google Composer experience preferred); Experience with Terraform infrastructure; Experience with Pub/Sub, Kafka, Google Cloud Storage, Dataflow, or Apache Beam; Familiarity with Apache Spark and PySpark; Experience working in industrial data platforms; Fluency in English (mandatory).
What do we have to offer you? Health Insurance; Feedback&Coffee – the system that includes Aubay’s Performance Management Cycle, with regular moments of feedback and the Career Progression Model; Hybrid work model; A Training Academy designed to think of you and your needs.
You can count on technical and behavioural training sessions (e-Learning and classroom), Meet&Techs, Webinars and Mentoring; Events and Teambuildings.
What makes us different? Our organizational culture is based on values such as transparency, team spirit, regular feedback and continuous learning; Reference prizes and birthday present; We don’t have a dress code; We call you by your name and we all address each other informally; Coffee and snacks at your disposal; You will grow in good company.
Isn´t that the best way to improve professionally? If we got your attention, we now hope to spark your enthusiasm.
Ready for the first phase? We are waiting for you! We will use personal information that you have sent us to consider your application for the relevant function.
By giving us your information/documents by email, you consent to Aubay Portugal treating your personal information.
Your privacy is important to us.
Please check our Privacy Policy, which explains how we will use and store your personal information.
It also explains the rights you have regarding your information and how you can contact us for clarification of questions or requests.
Detalhes da oferta
- Aubay Portugal
- Em todo Portugal
- Indeterminado - Indeterminado
- Indeterminado
- 05/11/2024
- 03/02/2025
Fórum selecção is looking for a senior data engineer (m/f) for a corporate bank main activities: - design high-performance data pipelines (etl) to feed a dwh using state of the art data engineering techniques according to business specifications; - implement flow automation through ci/cd pipelines and......
Claire joster is currently recruiting for a portuguese company of power generating, oil&gas; and material handling sectors, which intends to strengthen its internal structure with the integration of a mechanical engineer (m/f) in lisbon... function as a mechanical engineer, you will be responsible for:......
Please include 'automation and robotics engineer application' in the subject line... position overview: we are looking for a creative automation and robotics engineer to contribute to the design, development, and implementation of cutting-edge automation and robotics solutions... collaborate with cross-functional......
We are looking for a senior qa engineer with the following requirements: requisitos do trabalho • minimum of +6 years of relevant experience;• repository practice (i... );• user acceptance testing knowledge;• cypress;• browserstack;• java;• synthetic data creation;• iam test accounts;• appium;• experience......
Test engineer (automation) – air traffic management airspace industry in the role of the automation test engineer at atos you will: · develop and configure test automation frameworks and execute stability and performance tests... · enhance test frameworks, develop and execute test automation through......
Obligations: openshift/kubernetesdockersgithubartifact (jfrog)ansiblepython/powershelljira/confluencelinux administrationbasic knowledge of databasesteam player and being able to be part of a community to share information/knowledge good to have: azure/awsgerman speaker job type:full time......
Não percas esta oportunidade de vista e envia-nos o teu cv para *****@***** com a referência ótica_santarém... do que precisas? experiência neste tipo de atendimento, alegria e muita vontade de aprender; escolaridade mínima ao nível do 12ºano; disponibilidade para realizar os seguintes horários:......
Com/de/pixida3) apply now! pixida is proud to be an equal opportunity employer! we are committed to a work environment that supports, inspires and respects all individuals and in which all aspects of employment are applied without discrimination... ) in addition, we ask you to provide information about......
Minimo 6 anos de experiência* licenciatura em tecnologia ou engenharia informática (ou similar)* experiência em java* conhecimento de ferramentas de ci/cd (por exemplo, jenkins, circle ci)* experiência com testng: anotações e framework* experiência com bdd, nomeadamente cucumber* experiência prática......
Do naszego zespołu w lizbonie poszukujemy pracowników mówiących po francusku, którzy będą wspierać naszych klientów... 2023! twoje zadania: możliwość pomocy użytkownikom w zakresie przedsprzedaży, zapytań ogólnych i problemów związanych z pomocą techniczną za pośrednictwem telefonu, poczty elektronicznej......
