Let’s say you wanted to create a fine-tuned LLM that (1) fixes code and (2) optimizes code. But you aren’t GitHub and don’t have access to a large amount of training data. You could perform some model arbitrage from a larger model but also find data in more interesting places. Fortunately, we have tools specially made for (1) finding runtime errors and (2) optimizing code. Compilers.