OPTIMIZE LARGE-SCALE KUBERNETES ARCHITECTURE
Descrição da oferta de emprego
Each publisher operates in an isolated Kubernetes namespace with dedicated components.
This architecture prioritizes security, scalability, and fault isolation, but the cost of maintaining 270+ external IPs for individual LoadBalancer ingress controllers is unsustainable.
In addition, we use Cloudflare R2 for object storage and Cloudflare’s CDN to optimize performance and security.
While leveraging Akamai, Kubernetes, and Cloudflare, we aim to achieve cost-efficiency, maintain security and performance, and ensure future scalability.
Current Setup Overview Namespace Isolation * Each publisher (e.
., ABCNews, DeltaNews) operates in its own Kubernetes namespace.
* Isolation ensures fault tolerance and security.
Ingress Configuration.
* Each namespace has a dedicated Ingress controller (LoadBalancer type).
* Each controller uses a unique external IP to route traffic to subdomains like.
- [login to view URL] - [login to view URL] - [login to view URL] Multi-Container Pods * Each publisher operates within a single pod containing.
- API server - Admin panel - Frontend Database Architecture.
* Each namespace has a dedicated PostgreSQL database instance.
Cloudflare Integration.
* Object Storage.
Cloudflare R2 serves as the primary storage for static files.
* CDN.
All sites operate behind Cloudflare for caching, DDoS protection, and global performance optimization.
Security and Scalability.
* Namespace isolation prevents cascading failures or DDoS attacks across publishers.
* Distributed ingress avoids single points of failure.
Challenges High Costs.
* Maintaining 270+ external IPs for LoadBalancer ingress controllers is expensive.
* Single Point of Failure.
While dedicated IPs help avoid a single point of failure, we seek alternatives to maintain fault isolation without one IP per publisher.
* Ingress Optimization.
Consolidating ingress configurations while maintaining security, isolation, and performance.
Objectives 1.
Cost Optimization.
Minimize expenses by reducing reliance on dedicated IPs while retaining the benefits of distributed ingress.
2.
Cloudflare Utilization.
Fully leverage Cloudflare’s CDN and R2 storage to reduce dependency on expensive Kubernetes resources.
3.
Single Point of Failure Mitigation.
Implement fault-tolerant solutions without mandating dedicated IPs for every publisher.
4.
Scalability and Performance.
Design an architecture that can efficiently scale beyond 270 namespaces.
5.
Technical Guidance.
Provide clear, actionable recommendations and an implementation roadmap.
Key Questions Ingress Optimization.
What are the best practices for configuring ingress in a multi-tenant Kubernetes environment? How can ingress be consolidated to reduce costs while maintaining namespace isolation and DDoS protection? Is a shared ingress controller (e.
., NGINX Ingress with path-based routing or host-based rules) feasible and secure? Alternative Solutions Are there alternatives to dedicated IPs that avoid single points of failure while maintaining fault isolation? Cloudflare & Akamai Integration How can we maximize the benefits of Cloudflare's CDN and R2 storage while minimizing dependency on Kubernetes LoadBalancer services? Are there Akamai features that could complement Cloudflare to improve performance and reduce costs? Implementation Plan What would an optimized architecture look like, and how can it be implemented seamlessly without service disruptions? Expectations We expect the freelancer to deliver.
1.
Technical Analysis.
Comprehensive evaluation of the current architecture.
2.
Recommendations.
Alternative ingress configurations and cost-saving solutions.
Strategies for eliminating single points of failure.
Ways to fully utilize Cloudflare’s capabilities.
3.
Implementation Plan.
Detailed, step-by-step roadmap for deploying the recommended changes.
Documentation and guidance for our internal DevOps team.
4.
Cost-Benefit Analysis.
A comparison of costs between the current setup and proposed solutions.
Additional Notes Cloudflare CDN and R2 are integral to the architecture and must be utilized for caching, traffic management, and object storage.
The proposed solution should accommodate future growth beyond 270 namespaces without major reconfiguration.
The architecture must maintain security, performance, and scalability.
Current Monolithic System This project currently operates as a monolithic application on Laravel, serving 270 publishers.
Below are the system resources used in the current setup.
This information is critical for estimating resource requirements when transitioning to Kubernetes and implementing new technologies.
64 Cores 768 GB RAM 5 TB Disk Total MySQL database size for all publishers.
350 GB These metrics can guide initial resource allocation in Kubernetes, considering the improved efficiency of modern containerized solutions.
DevOps Kubernetes Computação em nuvem Docker Amazon Web Services ID do Projeto.
# Sobre o projeto 9 propostas Aberto para ofertas Projeto remoto Ativo em 22 minutos atrás
Detalhes da oferta
- Indeterminado
- Em todo Portugal
- Indeterminado - Indeterminado
- 15/12/2024
- 15/03/2025
Program, troubleshoot, and optimize robotic systems to meet performance and quality standards... the application deadline is 23/12/2023... qualifications: bachelor's, graduated or master’s degree in robotics, automation, mechanical engineering, or a related field... responsibilities: design, develop......
Audits agents to ensure call quality and optimize sales -designing and creating learning opportunities tailored to the characteristics of individuals or groups through their needs to guide them in their process... the central reservation office of nh hotel group and tivoli hotels & resorts is recruiting......
Your main responsibilities: analyze & optimize existing cobol apps... document changes to cobol programs... requisitos do trabalho ideal if you have: proficiency in cobol with hands-on experience... debug and maintain smooth operations... collaborate on cobol system updates......
Manage room reservations for large events such as weddings or other functions... manage inventories for hotel rooms... train new staff in reservation processes... monitor billing arrangements... assist clients by telephone and in person, resolving their questions and organizing their travel plans or......
Capacidade de trabalhar em equipe e colaborar efetivamente em projetos complexos... conhecimento em kubernetes, incluindo implantação e manutenção de clusters... experiência com implantações em nuvem, preferencialmente na google cloud platform (gcp)... a vaga é para integrar a equipe responsável pelo......
Obligations: openshift/kubernetesdockersgithubartifact (jfrog)ansiblepython/powershelljira/confluencelinux administrationbasic knowledge of databasesteam player and being able to be part of a community to share information/knowledge good to have: azure/awsgerman speaker job type:full time......
Minimo 6 anos de experiência* licenciatura em tecnologia ou engenharia informática (ou similar)* experiência em java* conhecimento de ferramentas de ci/cd (por exemplo, jenkins, circle ci)* experiência com testng: anotações e framework* experiência com bdd, nomeadamente cucumber* experiência prática......
At ease with developing sql ctes, windows functions as well as robust queries;- proven expertise in implementing a dwh following a traditional bi architecture (ods -> dwh -> dtm -> tableau);- proven experience with data analytics etl tools such as: apache nifi, dataiku (a plus);- data visualization tools......