You can't if you have to pick the 1gb of additional data before you see the 1gb ... | Hacker News

Hacker Timesnew | past | comments | ask | show | jobs | submit

		ChadNauseam on Dec 31, 2023 \| parent \| context \| favorite \| on: Adventures with compression You can't if you have to pick the 1gb of additional data before you see the 1gb file you're supposed to compress (which is the situation gpt is in)

bawolff on Dec 31, 2023 [–]

Although in this case, we know the data comes from wikipedia and i assume gpt was trained on wikipedia, so it really does seem unfair.

Consider applying for YC's Summer 2026 batch! Applications are open till May 4
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact