AI Performance Engineer
Red Hat
August 2026 to present
Boston, Massachusetts, United States · On site
Focused on inference performance, GPU optimization, and efficient model serving across various accelerators.
Hi, I'm Saketh. A student and passionate photographer!

Hi, I'm Sai Saketh Cherukuri, an AI Performance Engineer at Red Hat. I studied Mathematics with a Computer Science specialization at Sri Sathya Sai Institute of Higher Learning. I build and study machine learning systems with a focus on inference performance, GPU optimization, and efficient model serving.
My work centers on understanding how workloads behave on real hardware. I use MLPerf inference benchmarking, CUDA, vLLM, PyTorch, Nsight Systems, and Nsight Compute to investigate throughput, latency, KV cache behavior, batching, scheduling, memory utilization, and kernel efficiency.
I approach optimization as a measurement driven engineering discipline. Recent projects include an MLPerf study of Llama 3.1 8B, an H200 quantization benchmark suite, and a periocular age and gender recognition system.
Red Hat
August 2026 to present
Boston, Massachusetts, United States · On site
Focused on inference performance, GPU optimization, and efficient model serving across various accelerators.
M.Sc. Mathematics, Computer Science specialization, 2024 to 2026
B.Sc. Mathematics, Honours, 2020 to 2023
Selected Work
Projects spanning machine learning, deep learning, LLM inference, GPU profiling, developer tooling, and systems programming.
A reproducible H200 benchmark harness that pairs vLLM throughput experiments with ROUGE validation and Nsight trace analysis.
Benchmarks AWQ, GPTQ, FP8, BF16, and NVFP4 variants on H200 MIG across throughput, TTFT, TPOT, and published accuracy tasks.
A refreshed periocular pipeline with subject safe gender evaluation, strict eye region age crops, and custom PyTorch model comparisons.
A Java toolkit that scans C++, CUDA, and Python source, dispatches language specific checks, and presents reports through JavaFX.
Implemented a compact two pass SIC/XE assembler in C++ that builds a symbol table, resolves directives, and emits standard object program records.
Built a recursive descent parser in C for a simplified Pascal like language, validating declarations, assignments, expressions, and basic control flow syntax from token streams.
Email me at ssaketh.2002@gmail.com. I am based in Boston and authorized to work in the United States without sponsorship.