• CmdrShepard49@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    20
    arrow-down
    1
    ·
    5 days ago

    Our key finding is that by injecting information through an external synthetic data verifier, whether a human or a better model, synthetic retraining will not cause model collapse.

    Lol, so to make a great model, they just need to have an even better one available first or a human who can verify every single thing it ingests.

    Hmm, call me skeptical on this claim.