LEAD SOFTWARE ENGINEER &#; SCRAPING
Descrição da oferta de emprego
Our client is an innovative FinTech company and the market leader in providing data and business intelligence to help customers make faster and smarter investment decisions.
They are looking for a Lead Software Engineer to drive and own theit web scraping initiatives.
This role will lead the design, development, and maintenance of scalable scraping solutions as part of their data technology team.
The ideal candidate is an expert Python developer with strong experience in web scraping and related technologies.
Responsibilities Provide effective technical leadership and hands-on technical mentorship to developers.
Lead the design and development of web scraping applications and services, ensuring they are scalable, efficient, and meet performance requirements.
Drive technical decisions, ensuring that best practices are followed.
Provide leadership in applying design patterns and adhering to SOLID engineering principles, with a focus on reusability, modularity, scalability, and fault tolerance.
Utilize hands-on experience to design, build, and support web scraping solutions, particularly using Python and relevant libraries (e.
., Scrapy).
Promote a culture of continuous improvement and high-quality code delivery.
Partner with the broader technology leadership team to ensure service reliability through testing and release procedures.
Stay current with industry trends in web scraping, data technologies, and emerging tools.
Identify opportunities for innovation and process improvement, Ensure compliance with security and firmwide architecture standards.
Requirements Strong understanding of technical design patterns and SOLID engineering principles.
Experience mentoring engineering teams, particularly in the context of data extraction and scraping projects.
Expertise in Python development, particularly with web scraping libraries like Scrapy/Beautiful Soup.
Proven experience in developing and maintaining large-scale web scraping solutions.
Familiarity with C#/.
ET technologies is a strong plus.
Strong problem-solving skills and a proactive attitude.
Strong understanding of API design principles and best practices Experience with CI/CD pipelines and automated testing frameworks.
Familiarity with cloud platforms (AWS/GCP/Azure) Experience with software development lifecycle tools such as JIRA, Confluence, GitHub, etc.
Excellent communication and collaboration skills.
This position offers comprehensive benefits and is eligible for an annual discretionary bonus.
Fully remote candidates will be considered.
Cannot provide Visa sponsorship at this time.
Detalhes da oferta
- Next Ventures
- Em todo Portugal
- Indeterminado - Indeterminado
- 17/10/2024
- 14/01/2025
A empresa é de outsourcing, cliente area banca:junta-te a nós: desenvolvimento de software: projetar, desenvolver, testar e manter software de alta qualidade, seguindo boas práticas de engenharia de software e padrões de codificação... a familiaridade com frameworks e bibliotecas populares também é......
· prepare software defect tracking and report status of the testing activities to stakeholders... · record test results and report and verify software bug fixes to accept automation criteria... test engineer (automation) – air traffic management airspace industry in the role of the automation test engineer......
Claire joster is currently recruiting for a portuguese company of power generating, oil&gas; and material handling sectors, which intends to strengthen its internal structure with the integration of a mechanical engineer (m/f) in lisbon... requirements higher education in mechanical engineer; professional......
Please include 'automation and robotics engineer application' in the subject line... position overview: we are looking for a creative automation and robotics engineer to contribute to the design, development, and implementation of cutting-edge automation and robotics solutions... collaborate with cross-functional......
Fórum selecção is looking for a senior data engineer (m/f) for a corporate bank main activities: - design high-performance data pipelines (etl) to feed a dwh using state of the art data engineering techniques according to business specifications; - implement flow automation through ci/cd pipelines and......
Job missionbiosurfit is looking for a talented engineer to join its research and development team... the successful candidate will integrate a fast-paced multidisciplinary team in an innovative project for point-of-care diagnostics... write technical documentation such as test reports and test procedures......
We are looking for a senior qa engineer with the following requirements: requisitos do trabalho • minimum of +6 years of relevant experience;• repository practice (i... outros dados de posição responsibilities:• performing moderately complex work in research, design, development, and execution of automated......
• creation of hazard analyses and risk assessments • development of reports and safety concepts with respect to iso 26262 • testing and validation in relation to functional safety requirements • definition and monitoring of development interface agreement (dia) as well as analysis of safety relevant......
Obligations: openshift/kubernetesdockersgithubartifact (jfrog)ansiblepython/powershelljira/confluencelinux administrationbasic knowledge of databasesteam player and being able to be part of a community to share information/knowledge good to have: azure/awsgerman speaker job type:full time......
Minimo 6 anos de experiência* licenciatura em tecnologia ou engenharia informática (ou similar)* experiência em java* conhecimento de ferramentas de ci/cd (por exemplo, jenkins, circle ci)* experiência com testng: anotações e framework* experiência com bdd, nomeadamente cucumber* experiência prática......
