Artificial-intelligence systems such as large language models (LLMs) can exhibit behaviour that seems strikingly intelligent. This has led many people, including some experts, to wonder whether these systems could have some form of consciousness — the capacity for subjective experience. However, we think that existing AI systems are not conscious, and that, along current trajectories of development, they are not likely to become conscious. Greater clarity about whether AI could become consciousness will be crucial as society grapples with the challenges posed by this increasingly powerful technology.

  • Triumph@fedia.io
    link
    fedilink
    arrow-up
    12
    arrow-down
    3
    ·
    18 hours ago

    LLMs only respond to inputs. They don’t have independent ideas. And their responses are just predictive of what the input intends a response to be.

    Accurate prediction models can be extremely useful, but there’s a reason why weather prediction models aren’t considered intelligent. It’s because they aren’t designed to mimic human conversation.

    They are playing us for absolute fools.

    • BJW@lemmus.org
      link
      fedilink
      English
      arrow-up
      7
      arrow-down
      3
      ·
      12 hours ago

      That first sentence describes all life. We only react to input. We don’t have independent ideas. We have the illusion of them, because we can’t see our own neural networks. Asked to explain your actions, you would give your best guesses, but you don’t actually know. You’re a biological, finite-state machine, moving from state-to-state based on stimulii, while supposing you are a thinking individual in control.

      • TootGuitar@sh.itjust.works
        link
        fedilink
        English
        arrow-up
        7
        ·
        11 hours ago

        Citation needed on all of this, and even if you have citations, LLMs are deterministic, and do not learn or change over time. They can’t even be said to exist continuously since they only exist during the brief time that they’re responding to inputs, and then they disappear until the next input. I would argue that all of these things would need to change in order for them to be able to have consciousness.

        • BJW@lemmus.org
          link
          fedilink
          English
          arrow-up
          1
          arrow-down
          3
          ·
          9 hours ago

          They can learn and change over time, that’s just not enabled. The services that offer them want a reliable, reproducible, controllable experience. There’s zero reason they can’t continue to change through usage, other than it’s a conscious decision not to enable that functionality.

          That’s why they can only be conscious when they train using new data, and run asynchronously with continual input - the same way we do.

          • TootGuitar@sh.itjust.works
            link
            fedilink
            English
            arrow-up
            4
            ·
            9 hours ago

            Even if we could update an LLM’s weights continuously, the algorithm is still deterministic, like all computer algorithms. There is no evidence that humans are deterministic (or a “finite state machine”) in any way. So I don’t think such a dynamically-updating LLM could be conscious, either.

            • BJW@lemmus.org
              link
              fedilink
              English
              arrow-up
              2
              arrow-down
              3
              ·
              9 hours ago

              It is my personal belief that all life is deterministic. It’s the only plausible explanation for instinctual behavior - like monarch butterflies returning to their breeding grounds they’ve never been to. Or people yawning because others yawn. These aren’t conscious decisions, they’re peeks at the deterministic coding that life operates upon.

                • moonshine69@lemmy.nz
                  link
                  fedilink
                  English
                  arrow-up
                  1
                  arrow-down
                  3
                  ·
                  2 hours ago

                  A computer algorithm can absolutely be non deterministic, pick your language and run random.rand()

                  There is a whole class of such algorithms https://en.wikipedia.org/wiki/Nondeterministic_Turing_machine

                  But I don’t see how it makes a difference, even deterministic algorithms can produce infinite complexity, eg linear neural networks are proven to be able to compute any computable function, or the Mandelbrot set which is produced from a single recurrent statement but encodes a space of infinite complexity

                  Maybe your point is to say that a brain is performing a non computable function…but since your brain is computing that function…is that a counter example?

                  • TootGuitar@sh.itjust.works
                    link
                    fedilink
                    English
                    arrow-up
                    3
                    ·
                    edit-2
                    1 hour ago

                    How are the numbers generated by random.rand() made?

                    Also, NTMs are not algorithms, they’re models of computation in theoretical computer science.

                    My point is that for brains, it’s not possible to recreate the exact same inputs to be able to test whether the brain produces the same output. So it’s literally not possible for brains to be deterministic.