DATA DRIVEN | DATA ENGINEER APACHE FLINK
Descrição da oferta de emprego
Discover how Tech for People unlocks the future, creating a positive impact on the people and the world around us.
We are a global leading player in Digital Transformation for leading organisations across EMEA, with a revenue of €1B.
We believe in transforming technology to create value for our clients, partners and employees in a world where technology is developed for people.
We are proud of the culture we have built together.
We are proud of our people at the service of technology.
We are proud of our diverse environment.
Because we are #TechforPeople.
Join our multidisciplinary team of Cloud experts, Designers, Business consultants, Security experts, Engineers, Developers and other extraordinary talents, spread across more than 20 EMEA countries.
Become one of our + tech and business leaders on cloud, data and cyber security.
Let’s fuse creativity with technology together and build innovative solutions that actively change things for the better.
Job Description We are looking for an expert in Apache Flink professional service.
As an Apache Flink expert, the professional will be responsible for developing and maintaining Flink applications, optimizing performance, and troubleshooting any issues that arise.
The expert should have a deep understanding of stream processing and batch processing using Apache Flink.
Strong programming skills in Java or Scala are required.
Experience with other big data technologies such as Hadoop and Spark is a plus.
Key Responsibilities.
Develop and Deploy Flink Applications • Complete a fully functional set of Flink applications for both batch and stream processing, integrated with required data sources.
Performance Optimization • Deliver optimized Flink pipelines, tuned for performance and resource efficiency, with benchmarks and reports on improvements made.
Flink Cluster Setup • Deploy and configure a production-ready Flink cluster, ensuring it’s optimized for scalability and fault tolerance.
Monitoring and Alerting Setup • Implement a monitoring system (e.
., Prometheus, Grafana) to track application performance and set up alerting for critical issues.
Issue Resolution • Provide a report on all identified and resolved Flink-related issues, including performance bottlenecks and job failures.
Documentation • Hand over detailed documentation covering application architecture, performance tuning, troubleshooting procedures, and operational best practices.
Final Knowledge Transfer • Conduct a final knowledge transfer session with the internal team, ensuring they are fully capable of maintaining and expanding on the delivered Flink setup.
Qualifications • Expertise in Apache Flink • Strong programming skills in Java or Scala and SQL • Knowledge of stream processing and batch processing • Familiarity with big data technologies like Hadoop and Spark • AWS data services • Proven experience with projects in Flink production Java or Scala and SQL • Experience with Hadoop and Spark Additional Information The Devoteam Group works for equal opportunities, promoting its employees based on merit and actively fights against all forms of discrimination.
We are convinced that diversity contributes to the creativity, dynamism and excellence of our organization.
All of our vacancies are open to people with disabilities.
Job Location I'm interested I'm interested Privacy Policy
Detalhes da oferta
- Indeterminado
- 28/10/2024
- 26/01/2025
Fórum selecção is looking for a senior data engineer (m/f) for a corporate bank main activities: - design high-performance data pipelines (etl) to feed a dwh using state of the art data engineering techniques according to business specifications; - implement flow automation through ci/cd pipelines and......
Claire joster is currently recruiting for a portuguese company of power generating, oil&gas; and material handling sectors, which intends to strengthen its internal structure with the integration of a mechanical engineer (m/f) in lisbon... function as a mechanical engineer, you will be responsible for:......
Please include 'automation and robotics engineer application' in the subject line... position overview: we are looking for a creative automation and robotics engineer to contribute to the design, development, and implementation of cutting-edge automation and robotics solutions... collaborate with cross-functional......
We are looking for a senior qa engineer with the following requirements: requisitos do trabalho • minimum of +6 years of relevant experience;• repository practice (i... );• user acceptance testing knowledge;• cypress;• browserstack;• java;• synthetic data creation;• iam test accounts;• appium;• experience......
Test engineer (automation) – air traffic management airspace industry in the role of the automation test engineer at atos you will: · develop and configure test automation frameworks and execute stability and performance tests... · analyse performance test requirements and develop test plans and debug......
Obligations: openshift/kubernetesdockersgithubartifact (jfrog)ansiblepython/powershelljira/confluencelinux administrationbasic knowledge of databasesteam player and being able to be part of a community to share information/knowledge good to have: azure/awsgerman speaker job type:full time......
• creation of hazard analyses and risk assessments • development of reports and safety concepts with respect to iso 26262 • testing and validation in relation to functional safety requirements • definition and monitoring of development interface agreement (dia) as well as analysis of safety relevant......
Minimo 6 anos de experiência* licenciatura em tecnologia ou engenharia informática (ou similar)* experiência em java* conhecimento de ferramentas de ci/cd (por exemplo, jenkins, circle ci)* experiência com testng: anotações e framework* experiência com bdd, nomeadamente cucumber* experiência prática......
@confidentialnote: mne library of python will be used to explore, visualise and analysehuman neurophysiological data... ● clinic needs to click on “stop data stream” to stop the recording, after thesession is completed... ● once the board is set up, the clinic needs to click on “start data stream” tostart......
As a candidate you’ve decided to provide us your personal data... who we are: unikystem is a low-code bpm automation platform boosted by cognitive data capture with 100% accuracy, that turns any unstructured text data into business-critical information... required skills and experience: being a big......