ok so this is difficult to explain: the difference between consciousness and whatever LLMs are doing is that computers lack the experience that living beings make. the reason why LLMs will never be reliable, i.e. not make grave mistakes, is because they lack a concept of responsibility, i.e. they are careless because there’s nothing on the line for them. they don’t know what it’s like to make a mistake and be wiped out from existence, trained over billions of years to not make these mistakes. meanwhile, living beings do. and that’s the difference.


Humans are consciouss, yet we too confidently spread false information constantly and it would be just as naive to blindly trust information only because it’s coming from a human.
Also, we can’t measure consciousness so claiming that LLM either is or isn’t consciouss is equally baseless - we simply can’t know and are only making assumptions that could one day turn out to be false.