Muhammad Hammad
10+ years building AI-powered platforms and scalable backend systems. Currently architecting LLM infrastructure at CNTXT — from RAG pipelines and distributed model serving to OpenAI-compatible endpoints and agent platforms. Deep expertise in HIPAA-compliant healthcare solutions, AWS cloud architecture, and HL7/EMR integrations.
Career
Professional Experience
Staff Software Engineer
CNTXT
- Architected and designed the Shipable Agent, enabling modular and scalable integration with external tools and platforms.
- Deployed Open-Source LLMs on GPUs using Hugging Face, VLLM, and Transformers; orchestrated distributed model serving with Ray Cluster.
- Developed OpenAI-Compatible Endpoints for TTS (Text-to-Speech), STT (Speech-to-Text), and Vision models to ensure seamless interoperability with OpenAI clients.
- Designed and implemented the 'Chat-to-Build' Agent, enabling task execution via natural language through integration with the MCP server, supporting tools such as Shopify, Web Search, and more.
- Built a robust knowledge base powered by Qdrant Vector DB, supporting ingestion from sitemaps, URLs, documents, and images for RAG-based systems.
- Implemented RAG evaluation pipelines, integrating popular frameworks like RAGAS, DeepVal, and TruLens for consistent, measurable model quality assessment.
- Extended Stripe integration, adding automated features for payment scheduling, refund processing, payment method management, and invoice generation.
- Integrated ELK Stack and APM for full observability, enabling detailed tracing and performance monitoring of LLM workflows within a Kubernetes environment.
- Developed and published plugins for Slack, Shopify, and WordPress, enabling extended access to the Shipable Agent across third-party platforms.
- Added ASR (Automatic Speech Recognition) Support through multiple publishing options, including chat bubbles, iframes, and embeddable website components.
Senior Engineer II
LocAI Ltd.
- Led IQRAA platform on technical front: AI services, backend architecture, DevOps, Cloud, LLM integrations.
- Designed NestJS backend with localization, WebSockets, event-driven patterns, and Lambda integrations.
- Built AI services: interactive quizzes, lesson planners, personalized chats using LangChain, OpenAI, Falcon, DALL-E 3.
- Integrated SonarQube, Launch Darkly, Mixpanel, RudderStack, Zitadel, Cerbos, Scalar, FCM.
- CI/CD on GitHub Actions and Jenkins; DevOps with EKS, ArgoCD, Teleport, Datadog.
Lead Software Engineer
Folio3 Software
- Supervised HL7 connector implementing ADT, RDE, and ORU message types for EMR integrations (EPIC, Cerner).
- Implemented Onion Architecture on .NET Core with localization, FCM notifications, and Hangfire queuing.
- Delivered HIPAA-compliant solutions using AWS Secrets Manager, RDS/S3 encryption, and transport security.
- Built GraphQL serverless applications on Node.js with Lambda and SST.
- Led deployment onsite for US-based client; conducted code reviews, demos, and architecture designs.
Senior Software Engineer
Folio3 Software
- Implemented CI/CD pipelines on GitHub Actions for AWS EC2.
- Integrated RingCentral Faxes, AWS SNS, and Office 365 Azure AD for patient referrals.
- Created OCR library in Python with PyTesseract and Flask.
- Full-stack development on .NET/TypeScript/Angular for livestock auction platform.
Software Engineer
Folio3 Software
- Built custom file storage server with Apache Solr and master-slave failover.
- Implemented analytics with Google Analytics, Tag Manager, and Flow Player.
- Developed mobile application on Xamarin with MVVM and Prism.
Assistant Software Architect
Axact
- Integrated Twitter APIs with ASP.NET Web APIs.
- Implemented OCR for Japanese content using Tesseract.
- Developed dynamic PDF generation from HTML using Spire.PDF.
Software Engineer
Pharma Guide
- Built .NET Web API with Entity Framework and SQL Server.
- Developed Xamarin mobile apps with FCM integration and auto subscription handling.
- Managed deployments on Azure App Services.
Work
Prominent Projects
Shipable
AI Agent Platform
Modular AI agent platform with OpenAI-compatible endpoints, RAG knowledge base, distributed LLM serving on Ray/vLLM, and full observability via ELK Stack.
IQRAA
AI Education Platform
AI-powered education platform with smart quiz generation, lesson planning, personalized chats, and multilingual support.
Bettamint
Construction Finance
AI-powered financial management for construction, connecting field operations with financial workflows. Delivers up to 30% cost reduction.
Health Quest
Infusion & Therapeutics
HIPAA-compliant infusion and therapeutics platform with real-time patient monitoring and EMR integration.
IVision
Telemedicine & EMR
Telemedicine platform with consultation management and Cerner EMR integration for healthcare providers.
Angus Media
LiveStock Auctions
Real-time livestock auction platform with advanced search, live bidding, and comprehensive analytics.
AiGenics
Mood-Based Therapy
AI-powered mental health platform with personalized mood-based therapy recommendations. Published on App Store.
Surgery Center
Surgical Workflow
Serverless surgery center management with real-time scheduling and anesthesia procedure tracking.
DAO Proptech
Digital Property Ownership
Blockchain-based real estate platform enabling fractional property ownership through DAO governance.
PharmaGuide
Drug Interaction App
Drug interaction checker and pharmaceutical app with 5K+ downloads. Published on Google Play and App Store.
Design
System Architecture
.png)
Distributed AI Infrastructure
AI/InfrastructureAI agent platform with LLM integration, RAG systems, modular tool integrations, and scalable infrastructure.
AI Education Platform
AI/EducationIntelligent education platform with SSO, LLM quiz creation, lesson planning, content optimization, and analytics.
Healthcare Platform
HealthcareHIPAA-compliant healthcare platform with real-time patient monitoring and comprehensive treatment tracking.
.png)
Crypto Trading Platform
FinTechHigh-performance trading platform with KYB/KYC, OAuth, IP rotation, exchange APIs, and real-time WebSockets.
AWS Disaster Recovery
Cloud InfrastructureEnterprise AWS DR solution with Direct Connect, multi-region deployment, and automated failover.
.png)
Cloud Licensing System
Cloud InfrastructureCloud-based licensing management with automated provisioning, usage tracking, and compliance monitoring.
Toolkit
Technical Skills
AI & LLM
Languages
Frameworks
Databases
Cloud & DevOps
Realtime & Analytics
Monitoring
APIs
Standards
Integrations
Academic
Education
M.Sc. Data Science
NED University of Engineering & Technology
Advanced degree focused on data science, machine learning, statistical modeling, and AI applications. Research contributed to a published book chapter on healthcare technology.
B.E. Computer Systems Engineering
NED University of Engineering & Technology
Foundation in computer systems engineering covering software development, algorithms, and systems architecture.
Credentials
Certifications
Industry credentials and specialized coursework in cloud, AI, and machine learning.
Contributions
Featured Work
Publications & Research
What It Takes to Serve LLMs at Scale
Article · LinkedIn · Apr 2026
Infrastructure deep-dive on self-hosted LLM inference — vLLM, Ray Serve, tensor/pipeline parallelism, AWQ quantization, and LoRA adapters.
Applications of Big Data in Smart Health Systems
Book Chapter · IGI Global
Contributing author on healthcare technology applications.
Apache Solr vs Elasticsearch
Technical Article · Folio3
In-depth comparison of enterprise search technologies.
Reach out
Contact
Let's build something
Open to consulting engagements, full-time roles, and AI/platform architecture collaborations.