• 0 Posts
  • 7 Comments
Joined 1 year ago
cake
Cake day: March 3rd, 2024

help-circle




  • Part of the reason that this jailbreak worked is that the Windows keys, a mix of Home, Pro, and Enterprise keys, had been trained into the model, Figueroa told The Register.

    Isn’t that the whole point? They’re using prompting tricks to tease out the training data. This has been done several times with copyrighted written works. That’s the only reasonable way ChatGPT could produce valid Windows keys. What would be the alternative? ChatGPT somehow reverse engineered the algorithm for generating valid Windows product keys?


  • ignirtoq@fedia.iotoTechnology@beehaw.orgThe rise of Whatever
    link
    fedilink
    arrow-up
    13
    arrow-down
    1
    ·
    8 days ago

    The thing is it’s been like that forever. Good products made by small- to medium-sized businesses have always attracted buyouts where the new owner basically converts the good reputation of the original into money through cutting corners, laying off critical workers, and other strategies that slowly (or quickly) make the product worse. Eventually the formerly good product gets bad enough there’s space in the market for an entrepreneur to introduce a new good product, and the cycle repeats.

    I think what’s different now is, since this has gone on unabated for 70+ years, economic inequality means the people with good ideas for products can’t afford to become entrepreneurs anymore. The market openings are there, but the people that made everything so bad now have all the money. So the cycle is broken not by good products staying good, but by bad products having no replacements.


  • The technological progress LLMs represent has come to completion. They’re a technological dead end. They have no practical application because of hallucinations, and hallucinations are baked into the very core of how they work. Any further progress will come from experts learning from the successes and failures of LLMs, abandoning them, and building entirely new AI systems.

    AI as a general field is not a dread end, and it will continue to improve. But we’re nowhere near the AGI that tech CEOs are promising LLMs are so close to.