Artificial-intelligence systems such as large language models (LLMs) can exhibit behaviour that seems strikingly intelligent. This has led many people, including some experts, to wonder whether these systems could have some form of consciousness — the capacity for subjective experience. However, we think that existing AI systems are not conscious, and that, along current trajectories of development, they are not likely to become conscious. Greater clarity about whether AI could become consciousness will be crucial as society grapples with the challenges posed by this increasingly powerful technology.
Also an LLM only produces output when it is prompted to do so. Between prompts it’s not sitting there - waiting, wondering about the meaning of life, getting bored - until you prompt it again. It’s basically dead.
I like to compare llms to a Galton Board. Instead of the regular layout of pins someone added or removed pins so the marbles on the bottom fall into nice to look patterns.
Why is this a good measure of consciousness?
If continuity isn’t relevant for qualia, then LLMs could have perpetually incomplete perception like the edge of the image drawn on a CRT screen when captured at high frame rates. You never see a complete picture even if it’s technically represented.
It is certainly interesting to think about what your conscious experience would be like if it changed every brain cycle instead of being a continuous stream of information