Inference characteristics of Llama

A primer on inference math and an examination of the surprising costs of Llama.

Prompt design

Prompting is like web design. Let’s call it prompt design, and build better tools for it.