I dunno, the I-JEPA paper only dealt with image classification, and it looks like it isn’t scaling with larger model sizes like the other techniques.
Besides, Meta was one of the biggest failures in AI model building while he was there. Not exactly a confidence booster.
I’m extremely skeptical if he’s truly raising money off of name recognition alone instead of a real demo frontier model that just needs scaling.
It’s not just Lemmy. The whole world is being flooded by ever increasing quantities of shit, and filtering through it efficiently is decreasingly easy.