DATABRICKS & PYSPARK: SHAREPOINT DATA LOADER
Descrição da oferta de emprego
The function should take parameters such as SharePoint path, file name, and format, and return a DataFrame with the loaded data.
Key Requirements.
- The function should support loading files in CSV format.
- The connection between Azure Databricks and the SharePoint site must be configured correctly and documented in detail.
- Configuration of security, secrets, network settings, and/or service principles will be necessary.
- The function and its configurations must work seamlessly in my corporate environment.
Security Configuration.
- All configurations should utilize Service Principals for security or Oauth.
Network Settings.
- The function should be compatible with my current use of a Virtual Private Network (VPN).
Ideal skills for this job include.
- Extensive experience with Azure Databricks.
- Proficiency in using PySpark.
- Knowledge of SharePoint data retrieval.
- Ability to configure and document security settings using Service Principals.
- Understanding of working within a VPN.
Sharepoint Azure Computação em nuvem ID do Projeto.
# Sobre o projeto 3 propostas Aberto para ofertas Projeto remoto Ativo em 2 horas atrás
Detalhes da oferta
- Indeterminado
- Em todo Portugal
- Indeterminado - Indeterminado
- 19/11/2024
- 17/02/2025
Fórum selecção is looking for a senior data engineer (m/f) for a corporate bank main activities: - design high-performance data pipelines (etl) to feed a dwh using state of the art data engineering techniques according to business specifications; - implement flow automation through ci/cd pipelines and......
Good development skills on sharepoint and... • good skills on migration from sharepoint on-premises to sharepoint online, teams and other m365 tools... • knowledge of migration tools such as sharegate, sharepoint migration tool... net and c#• in depth knowledge of the custom development techniques......
Responsabilidades: levar a cabo projetos no âmbito do desenvolvimento da oferta para os clientes, através de soluções de business intelligence / data analytics; propor e implementar melhorias nas plataformas e processos existentes; envolvimento direto em projetos estratégicos que visam desenvolver soluções......
Responsabilidades: levar a cabo projetos no âmbito do desenvolvimento da oferta para os clientes, através de soluções de business intelligence / data analytics; propor e implementar melhorias nas plataformas e processos existentes; envolvimento direto em projetos estratégicos que visam desenvolver soluções......
As a candidate you’ve decided to provide us your personal data... who we are: unikystem is a low-code bpm automation platform boosted by cognitive data capture with 100% accuracy, that turns any unstructured text data into business-critical information... required skills and experience: being a big......
@confidentialnote: mne library of python will be used to explore, visualise and analysehuman neurophysiological data... ● clinic needs to click on “stop data stream” to stop the recording, after thesession is completed... ● once the board is set up, the clinic needs to click on “start data stream” tostart......
We also inform you that your data will be kept in the company for a period of 5 years... js (3+ years) experience with web applications (backend), distributed systems and apis preferred additional skills and experience: experienced in devops and promoter of automation mvc, jsf, jsp, j2ee, oo, distributed......
Subsistindo situações de igualdade de valoração, aplica-se a primazia na submissão da candidatura – data e hora – contadas desde a última alteração à candidatura... prazo de validade: 18 (dezoito) meses, a contar da data da homologação da lista de classificação final, ou antes, pela colocação de todos......
Requisitos do trabalho requirements: mandatory proficiency in english and dutch strong client-facing and communication skills customer service orientation available to work in fixed schedules role purpose: provide first level contact and convey resolutions to customer issues properly escalate unresolved......
Requisitos do trabalho mandatory proficiency in english and german strong client-facing and communication skills customer service orientation available to work in fixed schedules role purpose: provide first level contact and convey resolutions to customer issues properly escalate unresolved queries to......
