The prospect of artificial consciousness raises ethical, safety, and societal challenges significantly beyond those already posed by AI. Some of these challenges arise even when AI systems merely seem to be conscious, even if, under the hood, they are just algorithms whirring away in subjective oblivion. What does AI know? What do these large language models know? How can they be categorized?