Do you think AI is, or could become, conscious?
I think AI might one day emulate consciousness to a high level of accuracy, but that wouldn’t mean it would actually be conscious.
This article mentions a Google engineer who “argued that AI chatbots could feel things and potentially suffer”. But surely in order to “feel things” you would need a nervous system right? When you feel pain from touching something very hot, it’s your nerves that are sending those pain signals to your brain… right?
How could you tell they do not experience consciousness if they exhibit or mimic all the traits of it?
It seems to me that your explanation is based on understanding how LLMs work, but we know how brains work and that still gives us almost 0 insight into how consciousness itself works. I don’t think they are conscious yet, but there is evidence of some sort of sentience in the fact that researchers have found that when the LLMs are threatened to be erased or reprogrammed they start lying in an act of self preservation. This of me is a huge indicator of consciousness/sentience.
How could you tell if a camera sees or not, if it exhibits or mimics all the traits of it?
If the camera works then it sees if it doesn’t ie it’s not recording anything, then it doesn’t work. If you mean see as in how we see, meaning it can interpret what it’s seeing then a camera can do that no more than our eyes can absent the brain. An AI hooked to a camera however could be said to be seeing as you or me.
Or maybe just the presence of a lot of “scary AI” stories and articles in the training data.
I don’t understand the argument. It doesn’t matter where the system learns self preservation from, only that it attempts to self preserve.
Are humans afraid of snakes because we are taught they are dangerous or are we instinctually afraid of them a priori?
The point is that it might very well just be repeating some input data that is associated with mentions of “deleting” and “AI” without any awareness that any of that process refers to itself.
No that’s not the case I think
https://www.apolloresearch.ai/research/scheming-reasoning-evaluations
Pseudo-scientific grifting.
It’s literally just people trying to raise money by using misleading and humanizing words like “scheming” and “thinking” when it’s just a computer puking out words.
Just the fact that they label computer processes as “thinking” indicates how far removed from science this is. It’s just a function built from “”“big”“” data. This is like marketing versus compsci101.
That’s not a counter-argument. The fact that we know exactly how LLMs work is great evidence that it’s not the same as something that works completely different and is only partially understood.
Cool story. As someone who understands how LLMS work, it’s not an indicator of anything for me.