In which the talking pinball machine goes TILT
Interesting how the human half of discussion interprets the incoherent rambling as evidence of sentience rather than the seemingly more sensible lack thereof1. I’m not sure why the idea of disoriented rambling as a sign of consciousness exists in the popular imagination. If I had to make a guess2 it might have something to do with the tropes of divine visions and speaking in tongues combined with the view of life/humanity/sapience as inherently painful, either in a sort of buddhist sense or in the somewhat overlapping nihilist/depressive sense.
[1] To something of their credit, they don’t seem to go full EY and acknowledge it’s probably just a glitch.
[2] I’d make a terrible LessWronger since I don’t like presenting my gut feelings as theorem-like absolute truths.
There was a burst of submissions about “jailbreaking” ChatGPT, essentially making it output racist stuff. HN was all over that stuff for a while.
there’s a fairly active chunk of research in that space. some of the most recent I’ve seen is llm-attacks.org (which is a riot)