Abed Matini
Senior Backend Developer at Ogilvy
Abed Matini is a Senior Backend Developer with a background in information technology engineering. He specialises in building scalable backend systems and integrating artificial intelligence to create smarter, user-focused applications. His expertise includes generative AI, prompt engineering and AI-powered application development. Abed is particularly interested in the convergence of backend development and AI, and how it can support more intelligent software solutions.
Stop paying for easy prompts: Architecting hybrid local-to-cloud AI systems
Are you paying premium API token rates for a state-of-the-art cloud model just to summarise a three-line email or parse basic JSON? As AI integration becomes standard, relying exclusively on cloud LLMs is becoming an expensive, high-latency bottleneck. This session explores the pragmatic shift toward Hybrid AI Architectures. We will dive into how developers can harness the idle compute power sitting on their desks to handle lightweight generative tasks, reserving expensive cloud models (like Gemini Pro or Claude) strictly for heavy reasoning. In this talk, we will cover: The Tech Stack: Setting up local execution engines (Ollama, Llama.cpp) and open-source gateways (LiteLLM). Dynamic Routing & Fallbacks: How to implement intelligent routing layers (like RouteLLM or Semantic Router) to intercept prompts and mathematically decide if they should be processed locally or in the cloud. Edge Pre-processing: Using local SLMs (Small Language Models) for PII redaction and document summarization before data ever leaves your network. Attendees will leave with a clear, actionable blueprint and the open-source tooling needed to slash their AI infrastructure costs without sacrificing output quality.
Cape Town