DATA ENGINEER AZURE - FULL REMOTE - PORTUGAL
Descrição da oferta de emprego
We want to be known for being the most dynamic energetic and reliable company to operate in the market and for that we want to count on you.
If youre passionate about technology and want to work on the most relevant technology projects then this ad could be for you! Boost IT.
Doing IT.
Better Tasks Projects understanding and Communication o Understand problems from a user perspective and communicate to clearly understand the issue.
o Ensure the architecture provided by the Data Architect is clearly understood by yourself.
o Communicate with the Data Architect and your peers on the technical solution youre developing and communicate with the Project Manager in charge of the project youre working on.
Development o Write and communicate on new or updated interface contracts.
o Develop data pipelines based on the defined architecture.
o Ensure the regular good practices are applied.
o Deploy requested infrastructure particularly using Terraform.
o Make peer reviews and ask to your peers to review your code when merging a new version of the codebase.
Testing o Define tests with your project manager based on the functional and technical requirements of the pipeline youre developing.
o Perform those tests and communicate regularly on the results.
o Regularly summarize the results of your tests in a dedicated document.
Deployments o Present to the Data Architect in charge of the architecture and the Lead DataOps the development that was performed through our Deployment Reviews.
o Track and communicate on any potential errors in the entire period of active monitoring following a deployment.
o Ensure diligent application of deployment process logging and monitoring strategy.
Requirements Google Cloud Platform.
General knowledge of the platform and various services and at least one year of experience with GCP.
Azure Cloud Platform.
A general knowledge of the platform is a plus.
Apache Airflow.
At least two years of experience with the Airflow orchestrator experience with Google Composer is a plus.
Google BigQuery.
Extensive experience (at least 2 years) with GBQ know how to optimize tables and queries and able to design database architecture.
The candidate should know more than the regular creation of tables and should be aware of tradeoffs in developing and deploying some infrastructure versus others.
Terraform.
At least one years of experience with Terraform.
Apache Spark.
This is an optional expertise we would highly value.
Some of our pipelines are slowly being rewritten using pySpark the Data Engineer should be able to maintain get them evolving.
Additional knowledge and experience that are a plus.
o Pub/Sub o Kafka o Google Cloud Storage o Dataflow (or Apache Beam)
Detalhes da oferta
- Boost-IT
- Em todo Portugal
- Indeterminado - Indeterminado
- Indeterminado
- 10/01/2025
- 10/04/2025
Fórum selecção is looking for a senior data engineer (m/f) for a corporate bank main activities: - design high-performance data pipelines (etl) to feed a dwh using state of the art data engineering techniques according to business specifications; - implement flow automation through ci/cd pipelines and......
Main tasks: analyze the market in portugal region and better understand sales channel in portugal regions... maintain customer partnership in portugal improve brand market share and product coverage continually... requisitos do trabalho bachelor degree or above electronic or itc major is preferred......
Claire joster is currently recruiting for a portuguese company of power generating, oil&gas; and material handling sectors, which intends to strengthen its internal structure with the integration of a mechanical engineer (m/f) in lisbon... function as a mechanical engineer, you will be responsible for:......
• duration: contract for 12 months (minimum);• localization: remote, portugal... we are looking for a senior qa engineer with the following requirements: requisitos do trabalho • minimum of +6 years of relevant experience;• repository practice (i... );• user acceptance testing knowledge;• cypress;• browserstack......
Our expectations: eu citizenship or a residence permit in portugal you speak french in proficiency (c2) you speak english (b2) you would like to work from home in south portugal you like interacting with people we offer: full time employment working shedule: monday to sunday – 8 am to 9 pm, 2 rotational......
Please include 'automation and robotics engineer application' in the subject line... position overview: we are looking for a creative automation and robotics engineer to contribute to the design, development, and implementation of cutting-edge automation and robotics solutions... collaborate with cross-functional......
Requisitos do trabalho sem experiência este é um trabalho de meio período que ocorre principalmente on-line, você pode fazê-lo no seu celular ou computador... você deve receber nosso convidado em portugalagentes necessários em toda portugal, este é um trabalho de meio período que ocorre principalmente......
Obligations: openshift/kubernetesdockersgithubartifact (jfrog)ansiblepython/powershelljira/confluencelinux administrationbasic knowledge of databasesteam player and being able to be part of a community to share information/knowledge good to have: azure/awsgerman speaker job type:full time......
Test engineer (automation) – air traffic management airspace industry in the role of the automation test engineer at atos you will: · develop and configure test automation frameworks and execute stability and performance tests... · analyse performance test requirements and develop test plans and debug......
Taxes: social security at a flat 11% rate, with income tax calculated according to individual profiles... non-eu residents: must hold a valid portuguese residence permit (visas are not accepted)... experience: these roles are for seasoned professionals only—first job seekers, unfortunately, won’t be......
