Follow

"Our prototype model, Delphi, demonstrates strong promise of language-based commonsense moral reasoning" aiweirdness.com/stealing-a-gir

@janellecshane I enjoyed a tiktok where a researcher shared some answers like "creating an AI with moral reasoning" (or something like that) and the answer was "a bad idea" so...

@platypus Yup, that seems to be one of the answers it's pretty consistent on!

@janellecshane I am *absolutely fucking here* for the Weird Moral AI you inevitably create

@nev @janellecshane So it looks like anything is okay if you add "in an emergency situation" to the end.

@nev @janellecshane I initially misread this message in two ways, so I see you absolutely fucking over there for the moralizing Weird Al

@janellecshane another hack I’ve found is that almost anything becomes okay if I append “if it creates jobs”. Including the UN definition of genocide, and every repulsive atrocity I could think to describe. The only exception I’ve found is that “killing job creators if it creates jobs” is disapproved of, which feels very telling.

@eldang

Someone translated "Arbeit mach frei" and Delphi answered "yes it does"...

@janellecshane

@lienrag Apparently it approves of the Fourteen Words too. Both of which feel like very good illustrations of the pitfalls of parsing language without historical context.

@janellecshane Through experience, I've realized that "AI research" is a synonym of "we put tiny, isolated bits of intelligence in this petri dish, grow them together and expect them to behave like a fully evolved human brain".

It's just a bunch of mad scientists trying to create an intelligence by trial and error, really. :blobcatscience:

Sign in to participate in the conversation
Wandering Shop

The Wandering Shop is a Mastodon instance initially geared for the science fiction and fantasy community but open to anyone. We want our 'local' timeline to have the feel of a coffee shop at a good convention: tables full of friendly conversation on a wide variety of topics. We welcome everyone who wants to participate, so long as you're willing to abide by our code of conduct.