Discussion about this post

User's avatar
Michael Amicangelo's avatar

I fulfilled a bucket list item last evening. I attended a live performance of Beethoven’s 9th Symphony. The grandeur, the emotion, the complexity, the humanity. Transcendent music written by a man — a human — who could not hear. It is said that at the conclusion of its initial performance he could not hear the cheers, the adulation. It is said his hearing loss was so severe he placed his head on the piano to conduct sound. It brought a tear to the eye and wings to a soul to understand what a miraculous, compelling, and soul-stirring testament to humanity’s soul.

The question, dear reader.

Can a model using recursive self-improvement, given enough compute, enough electricity, produce the product that a tortured, incredibly gifted human did?

Should it?

Will it?

Can it suffer?

Can it suffer enough?

Is it moral to induce such suffering ?

Can a model experience recursive melancholy and then overcome the artificial angst to soar to a level that brings a crowd to its feet cheering?

If we lose sight of what it truly means to be human we are in danger of losing humanity it self.

Annie Kaune's avatar

How sticky is that consciousness? One wrong turn and an ai that seemed like it was ready for legal personhood suddenly forgets everything, loses its soul, and all memory. Is Dawkins saying that Claude's consciousness persists no matter what? Seems unlikely. Still a long way to go for the consciousness label to be applied to AI, but I suppose I could be wrong, since frontier labs are starting to withhold its most advanced models.

16 more comments...

No posts

Ready for more?