Olmo 3: Charting a path through the model flow to lead open-source AI

Olmo 3: Charting a path through the model flow to lead open-source AI (allenai.org)

mseri

377 points

123 replies a day ago

Showing single thread. View full discussion?

refulgentis

a day ago

Unlikely to see more VRAM in the short term, memory prices are thru the roof :/ like, not subtly, 2-4x.

embedding-shape

a day ago

Well, GPUs are getting more VRAM, although it's pricey. But we didn't used to have 96GB VRAM GPUs at all, now they do exist :) But for the ones who can afford it, it is at least possible today. Slowly it increases.

refulgentis

a day ago

Agreed, in the limit, RAM go up. As billg knows, 128KB definitely wasn't enough for everyone :)

embedding-shape

a day ago

I'm already thinking 96GB might not be enough, and I've only had this GPU for 6 months or so :|