Rajkumar Sakthivel

This talk addresses the significant cost associated with AI coding tools, which is often driven by excessive context sent to models rather than the model's processing. The core thesis is that by optimizing the input context, substantial cost savings can be achieved, far exceeding savings from output compression. A local code indexing and search layer is proposed as a solution to send only relevant code snippets to AI models.