Harel Lidar

AI researcher · LLM inference

I work on making large models cheaper to run (speculative decoding, batching, the KV cache) and I write to find out what I think.

These are my working notes: summaries of what I read, evergreen notes that argue one claim each, and longer essays when a thread is ready. More about me.

Recently added

Everything, by kind →

Evergreen notes

All notes →

Essays