How it feels talking to a hedonistic utilitarian
Explores AI alignment challenges through accessible philosophical examples relevant to AI ethics and safety.
AI Summary
A dialogue illustrates philosophical tensions in AI value by contrasting everyday satisfaction with utilitarian maximization principles.
Excerpt
Epicurean status: strawman, kind of. Gourmet George: Yum! This chocolate is so sweet and tasty. Sweet Caroline: Yeah, it’s pretty good. And someday in the glorious hyperculinary future, we’ll figure out how to make it even sweeter! GG: I think this chocolate is sweet enough, actually. SC: Huh? But you like sweetness, don’t you? GG: Sure… SC: Well, then we’re in agreement. We should maximize the sweetness of this chocolate. GG: I don’t want my chocolate to be maximally sweet, though. SC: But you’
