Language Model Innovation