EMPREGO BIG DATA DATABRICKS PORTO, PORTO

Monitor and optimize data processes to improve system performance and ensure high-quality data output... work closely with other data engineers to develop and maintain...

Understanding of big data technologies such as hadoop or spark...   data quality and governance: support data quality initiatives by performing data validation...

Preferably in azure data factory, azure data lake... developing and maintaining data lake and data warehouse schematics, layouts, architectures and relational/non-relational...

You will have the opportunity to lead and develop your skill set to keep up with the ever-growing demands of the modern data platform and enterprise data fabric...

big picture thinking - correctly diagnosing problems and productionising research... phew! it’s a big task, but you won’t do it alone... as we continue our lightning-fast...

* research and implement new data technologies... what you'll do * design scalable, end-to-end data pipelines to consume and integrate large volumes of complex data...

Snowflake, big query, redshift... you champion practices like big data processing, cloud development and warehousing within the data platform team and integrate...

big data technologies: hands-on experience with hadoop and spark, and an understanding of their integration within the flink ecosystem and broader data infrastructure...

This project is for anyone who loves to work with data... here you will be part of a team that seeks to help other organizations in their digital transformation...

Keywords: sobre a deloitte; consulting; technology #li-hybrid  #li-rsg data da publicação: ... extrair, transformar e carregar (etl) grandes volumes de dados de...

Experience with big data technologies (e... google cloud professional data engineer, aws certified big data) are a plus... understanding of data security and compliance...

For that you will: * define data reporting strategy for the (company name) group corporate quality; * design and implement data reporting processes for quality indicators...

Descrição data modeling: designing efficient data models for optimal query performance... etl and data integration: extracting, transforming, and loading data into...

• familiarity with in-house big data platforms... • good understanding of data modelling, data structures, data management and best practices...

* experience with databricks or spark: proven experience using databricks or apache spark for large-scale data processing, analytics, and building machine learning...

Are you the one? +4 years of experience in a data engineering role; experience with big data and nosql technology (hadoop, kafka, hive, spark, python); experience...

Aws data services... familiarity with big data technologies like hadoop and spark... we are looking for a data engineer to work in this project in porto (hybrid)...