Wondering if Modern LLMs like GPT4, Claude Sonnet and llama 3 are closer to human intelligence or next word predictor. Also not sure if this graph is right way to visualize it.

  • @webghost0101@sopuli.xyz
    link
    fedilink
    0
    edit-2
    8 hours ago

    This is true if you describe a pure llm, like gpt3

    However systems like claude, gpt4o and 1o are far from just a single llm, they are a blend of tailored llms, machine learning some old fashioned code to weave it all together.

    Op does ask “modern llm” so technically you are right but i believed they did mean the more advanced “products”

    Though i would not be able to actually answer ops questions, ai is hard to directly compare with a human.

    In most ways its embarrassingly stupid, in other it has already surpassed us.

    • Coriza
      link
      fedilink
      126 hours ago

      That is just next word prediction with extra steps.

    • None of which are intelligence, and all of which are catered towards predicting the next token.

      All the models have a total reliance on data and structure for inference and prediction. They appear intelligent but they are not.