SENIOR DATA ENGINEER 1
Descrição da oferta de emprego
Job description - Required skills • Senior AWS Cloud Data Engineer having more than 5+ yrs.
of experience.
• Good experience in data engineering to create pipelines for various clients to build end to end solutions using distributed computing frameworks and ETL tools.
• Have good experience and expertise in Python, Pyspark, SQL, AWS, Data warehousing, shell scripting, Bigdata components.
• Experience with building Python Code Libraries (reusable components) • Experienced working in AWS cloud computing platform using which the complete pipeline was built with toolsets such as Databricks, Glue, EMR, Redshift, RDS, Lambda, DynamoDB, EC2, S3, Airflow, SNS, SQS, experienced in building pipelines for clients using Glue using glue studio and applied custom transformation based on the business needs.
• Good knowledge in SQL to write complex queries in order to achieve client’s requirements.
• Good knowledge in creating lambda functions which have various trigger resources and events triggers with notification to stakeholders using SNS.
• Worked in VCS such as GitHub and bitbucket for maintain and managing the code versions.
• Good experience in dealing with SCD data with the incremental loads to accommodate updated to the data.
• Good exposure to cost optimization to implement best optimized method with lesser cost.
• Good knowledge about data modeling techniques (3NF, Dimensional Modelling, Data Vault).
• Good knowledge about agile, scrum way of working.
Primary Skill.
AWS, Python, SW version control and branching Skills.
Data Engineering Data Analysis Data Architecture What you can expect from us.
Together, as owners, let’s turn meaningful insights into action.
Life at CGI is rooted in ownership, teamwork, respect and belonging.
Here, you’ll reach your full potential because… You are invited to be an owner from day 1 as we work together to bring our Dream to life.
That’s why we call ourselves CGI Partners rather than employees.
We benefit from our collective success and actively shape our company’s strategy and direction.
Your work creates value.
You’ll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas, embrace new opportunities, and benefit from expansive industry and technology expertise.
You’ll shape your career by joining a company built to grow and last.
You’ll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons.
Come join our team—one of the largest IT and business consulting services firms in the world.
Detalhes da oferta
- CGI
- Em todo Portugal
- Indeterminado - Indeterminado
- Indeterminado
- 20/12/2024
- 20/03/2025
Temporary project: 1 year - schedule between 9... fórum selecção is looking for a senior data engineer (m/f) for a corporate bank main activities: - design high-performance data pipelines (etl) to feed a dwh using state of the art data engineering techniques according to business specifications; - implement......
We are looking for a senior qa engineer with the following requirements: requisitos do trabalho • minimum of +6 years of relevant experience;• repository practice (i... );• user acceptance testing knowledge;• cypress;• browserstack;• java;• synthetic data creation;• iam test accounts;• appium;• experience......
Claire joster is currently recruiting for a portuguese company of power generating, oil&gas; and material handling sectors, which intends to strengthen its internal structure with the integration of a mechanical engineer (m/f) in lisbon... function as a mechanical engineer, you will be responsible for:......
Please include 'automation and robotics engineer application' in the subject line... position overview: we are looking for a creative automation and robotics engineer to contribute to the design, development, and implementation of cutting-edge automation and robotics solutions... collaborate with cross-functional......
Outros dados de posição agradecemos que envie o seu cv atualizado para *****@*****/p>... ª civil ou equivalentes;experiência na função em sector do ambiente ou construção;experiência no desenvolvimento de planos de segurança e auditorias de segurança;cap de técnico de segurança nível vi;cap formação......
Contamos com a maior, mais experiente e divertida equipa de salesforce nacional e somos também a única empresa 100% portuguesa reconhecida 5x pelos salesforce awards (2017, 2019, 2021, 2022 e 2023)... experiência em analisar processos de negócio, assim como realizar os respetivos levantamentos de requisitos......
Test engineer (automation) – air traffic management airspace industry in the role of the automation test engineer at atos you will: · develop and configure test automation frameworks and execute stability and performance tests... · coordinate with program and development management teams in product development......
Temporary project: 1 year - schedule between 9... fórum selecção is looking for a senior developer (m/f) for a corporate bank main activities: - understand and analyse the needs expressed by the business teams, specifying and testing them in order to enable the deployment of the solution while respecting......
Requisitos do trabalho procuramos profissionais com o seguinte perfil : • mínimo 9º ano de escolaridade;• experiência em funções similares no setor automóvel (mínimo 4 anos);• experiência em orçamentação (preferencial);• elementares conhecimentos de informática, na ótica do utilizador;• elevado sentido......
Com uma frota composta por dois ferries e dois catamarans, nos seus 14 anos de atividade a atlantic ferries já transportou mais de 15 milhões de pessoas e 3,5 milhões de veículos... caso considere ter o perfil ideal e queira fazer parte das nossas equipas, envie o seu cv, indicando a referência maq......
