EMPREGO DATA ENGINEER PYTHON SPARK

• du bist begeistert deine kompetenzen um weiterführende azure services zu ergänzen, insbesondere in den bereichen azure data lakes, azure synapse, powerapps, azure...

And in particular the data plane/ pipe dream... we are currently seeking python and pyspark software engineers to enhance our ability to exploit maestro 2...

Connaissance des architectures data (datalake, lakehouse... contribuer à l’animation d’un collectif de data engineers et data architects pour partager les savoir-faire...

• proficiency in sql and experience with data modeling and data warehousing concepts... • develop data processing pipelines using databricks notebooks, spark sql...

€¢ apply quality control, data validation, and cleansing processes to new and existing data sources all about you • 3-5 years experience in data management, data...

• apply quality control, data validation, and cleansing processes to new and existing data sources all about you • 3-5 years experience in data management, data...

data engineer / data scientist (m/f) – hybrid (lisbon)... experience building azure data warehouses and/or data lakes... excellent analytical skills with systematic...

Java, python, c#); knowledge of data modeling in relational databases (preferably postgresql); experience with data modeling in key value stores - e...

At least 1 year of experience as data engineer... experience in resolving spark memory issues, and optimization of spark processes... ability to write and understand...

Job description you will work with azure cloud on a data engineering team, doing data cleansing and ingestion, data warehouse implementations, and various data engineering...

Experience with other big data technologies such as hadoop and spark is a plus... become one of our + tech and business leaders on cloud, data and cyber security...

Jahre programmiererfahrung im bereich python • erfahrung von mind... gegründet und nach wie vor familiengeführt, ist cgi heute einer der weltweit größten unabhängigen...

Strong data management principles, around data architecture, modeling/design, data quality, security, data organization and operations... good communication & presentation...

Strong understanding of data governance, data management, and data integration... develop data processing scripts and applications using python...

Work closely with other data engineers to develop and maintain robust, reliable data solutions... leverage dbt as a coding framework to manage data transformations...

The data engineer will be involved in the modern system's data architecture, pipeline version control, data lineage tracking, and automated testing...

• experience building and optimizing ‘big data’ data pipelines, architectures, and data sets... • build processes supporting data transformation, data structures...