DATAOPS ENGINEER (M/F/D)
Descrição da oferta de emprego
Our mission is to make mobility efficient, accessible, and comfortable, thereby contributing to a more connected and sustainable world.
About the Role.
We are seeking a skilled DataOps Engineer to join our global team, focusing on optimizing and automating data workflows and cloud infrastructure.
You will collaborate closely with Data Scientists, Data Engineers, and DevOps Engineers to ensure smooth and reliable data operations from ingestion to deployment.
Your primary responsibility will be managing and optimizing data pipelines, while maintaining performance and scalability across our cloud-based infrastructure.
Key Responsibilities.
Develop and Manage Data Pipelines.
Build, maintain, and optimize scalable data pipelines to ensure smooth data flow and integration across systems.
Implement Data Streaming and Processing Solutions.
Manage and optimize real-time data streaming and processing systems to handle large-scale, low-latency data operations.
API Development and Integration.
Create and manage APIs to facilitate integration with data systems, enabling smooth data services for internal stakeholders.
Monitor and Automate Data Workflows.
Ensure the automation and continuous monitoring of data workflows, implementing performance improvements to enhance system efficiency.
Collaboration Across Teams.
Collaborate closely with Data Scientists, Data Engineers, and DevOps Engineers to enhance data workflows and optimize processes for operational efficiency.
Data Visualization and Reporting.
Utilize data visualization techniques to monitor pipeline performance and ensure data processes meet business and operational requirements.
Your Qualifications – Must Have.
Bachelor’s Degree in Computer Science, Data Engineering, Software Engineering, Information Technology, or a related field.
Equivalent experience in DataOps, Cloud Computing, or Data Engineering will also be considered.
3+ years of experience in data engineering, DevOps, or a related DataOps role, with practical knowledge of cloud-based data systems and workflow automation.
Programming Skills.
Strong proficiency in Python and SQL for building and optimizing data workflows.
Containerization Knowledge.
Solid experience with Docker for managing and deploying data services.
Cloud Expertise.
Experience with core AWS services such as S3, Lambda, and RDS for cloud-based data operations.
Data Streaming.
Strong experience with Apache Kafka for real-time streaming and low-latency data processing.
Automation & Monitoring.
Proficiency in automating workflows using AWS Wrangler, Boto3, and monitoring tools like Grafana and AWS CloudWatch.
Nice to Have Qualifications.
API Development.
Familiarity with FastAPI, Pydantic, or similar frameworks for building APIs.
Kafka Connect & KSQLDB.
Hands-on experience with Kafka Connect and KSQLDB for advanced streaming functionality.
Kubernetes.
Knowledge of Kubernetes for orchestrating containerized applications.
MLOps Frameworks.
Familiarity with MLFlow or Kubeflow to support machine learning model deployment and operations.
Data Validation & Testing.
Experience with tools like Great Expectations or dbt for data validation and testing.
Why Siemens Mobility? Joining Siemens Mobility means being part of a global community that is passionate about shaping the future of transportation.
We offer a competitive salary, comprehensive benefits, and opportunities for professional growth and development within an innovative and dynamic environment.
If this sounds exciting to you, then please send us your application - in English - and we will get back to you! Getting in touch with us - straightfoward and direct If you wish to discuss any initial questions with our recruitment team.
The contact person handling this job ad is Davina Difelice.
At Siemens Mobility we believe physical barriers are not related to potential.
Only the potential matters to us.
Therefore, we look forward to receiving applications of candidates with physical barriers and chronic illnesses.
We support healthy relationships between candidates with barriers and their colleagues because we believe we can create differences together.
Siemens Mobility is dedicated to quality, equality, and valuating diversity, and we encourage applications that reflect the diversity of the communities within which we work.
We look forward to receiving your online application.
Please ensure you complete all areas of the applic ation form to the best of your ability as we will use the data to review your suitability to the role.
Detalhes da oferta
- Siemens
- Indeterminado
- 08/11/2024
- 06/02/2025
Claire joster is currently recruiting for a portuguese company of power generating, oil&gas; and material handling sectors, which intends to strengthen its internal structure with the integration of a mechanical engineer (m/f) in lisbon... requirements higher education in mechanical engineer; professional......
Please include 'automation and robotics engineer application' in the subject line... position overview: we are looking for a creative automation and robotics engineer to contribute to the design, development, and implementation of cutting-edge automation and robotics solutions... collaborate with cross-functional......
Fórum selecção is looking for a senior data engineer (m/f) for a corporate bank main activities: - design high-performance data pipelines (etl) to feed a dwh using state of the art data engineering techniques according to business specifications; - implement flow automation through ci/cd pipelines and......
Test engineer (automation) – air traffic management airspace industry in the role of the automation test engineer at atos you will: · develop and configure test automation frameworks and execute stability and performance tests... · enhance test frameworks, develop and execute test automation through......
We are looking for a senior qa engineer with the following requirements: requisitos do trabalho • minimum of +6 years of relevant experience;• repository practice (i... git, gitlab or bitbucket);• quality management tools (jira, ado, etc... • mentoring and coaching team-members......
Obligations: openshift/kubernetesdockersgithubartifact (jfrog)ansiblepython/powershelljira/confluencelinux administrationbasic knowledge of databasesteam player and being able to be part of a community to share information/knowledge good to have: azure/awsgerman speaker job type:full time......
Com/de/pixida3) apply now! pixida is proud to be an equal opportunity employer! we are committed to a work environment that supports, inspires and respects all individuals and in which all aspects of employment are applied without discrimination... ) in addition, we ask you to provide information about......
Minimo 6 anos de experiência* licenciatura em tecnologia ou engenharia informática (ou similar)* experiência em java* conhecimento de ferramentas de ci/cd (por exemplo, jenkins, circle ci)* experiência com testng: anotações e framework* experiência com bdd, nomeadamente cucumber* experiência prática......
Vacant positions: roustabouts / roughnecks, welders / mechanics, rig operators / drillers, engineers (petroleum and mechanical) health and safety officer, superintendent smp, smp supervisor, document controller clerk, community superintendent, training / hrd superintendent; smp engineer, mine engineer......
Job summary we are looking for a motivated and detail-oriented project engineer to join our team... the project engineer will be responsible for planning, coordinating, and overseeing projects within the organization, ensuring they are completed on time, within scope, and within budget......