> I believe LLMs are derivative works of the pieces they are trained on

That's your opinion with 0 legal backing. IMO, calling them derivative is untenable logically for anyone with some understanding of LLM/transformer architecture.