• ShakingMyHead@awful.systems
    link
    fedilink
    English
    arrow-up
    9
    ·
    4 months ago

    Probably would have been easier when the context window wasn’t 128k.

    Though what the point would be should someone actually achieve that eludes me a bit.

    • bitfucker@programming.dev
      link
      fedilink
      English
      arrow-up
      10
      ·
      4 months ago

      I don’t know man. Maybe a chat bot for help center that forgot they shouldn’t give refund or non existent promotion?

    • nfultz@awful.systems
      link
      fedilink
      English
      arrow-up
      1
      ·
      4 months ago

      I have LLMs translate novels, I can tell when they run over the window because they forget characters’ gender half way through, things like that. Lots of legal documents are even longer, maybe.