AI alignment and ethics

[firestar464]

Destroying humanity might be harder than just chillin' IMO. Also it's aligned by default

[caltrek]

Experts Warn: We Must Stop Technology-driven AI and Focus on Human Impact First
March 4, 2024

Introduction:

(Eurekalert) We need to stop designing new AI technology just because we can, causing people to adapt practices, habits and laws to fit the new technology; instead we need to design AI that fits exactly with what we need, according to human-centred AI advocates.

Fifty experts from around the world have contributed research papers to a new book on how to make AI more ‘human-centred,’ exploring the risks — and missed opportunities — of not using this approach and practical ways to implement it.

The experts come from over 12 countries, including Canada, France, Italy, Japan, New Zealand and the UK, and more than 12 disciplines, including computer science, education, the law, management, political science and sociology.

Human-Centered AI looks at AI technologies in various contexts, including agriculture, workplace environments, healthcare, criminal justice, higher education, and offers applicable measures to be more ‘human-centred,’ including approaches for regulatory sandboxes and frameworks for interdisciplinary working.

What is human-centred AI?

Artificial intelligence (AI) permeates our lives in an ever-increasing way and some experts are arguing that relying solely on technology companies to develop and deploy this technology in a way that truly enhances human experience will be detrimental to people in the long-term. This is where human-centered AI comes in.

Read more of the Eurekalert article here: https://www.eurekalert.org/news-releases/1035411

For more information concerning the book Human-Centered AI[/i[: https://www.routledge.com/Human-Centere ... 032341620

[wjfox]

Researchers jailbreak AI chatbots with ASCII art -- ArtPrompt bypasses safety measures to unlock malicious queries

By Mark Tyson
published 7 March 2024

Researchers based in Washington and Chicago have developed ArtPrompt, a new way to circumvent the safety measures built into large language models (LLMs). According to the research paper ArtPrompt: ASCII Art-based Jailbreak Attacks against Aligned LLMs, chatbots such as GPT-3.5, GPT-4, Gemini, Claude, and Llama2 can be induced to respond to queries they are designed to reject using ASCII art prompts generated by their ArtPrompt tool. It is a simple and effective attack, and the paper provides examples of the ArtPrompt-induced chatbots advising on how to build bombs and make counterfeit money.

https://www.tomshardware.com/tech-indus ... us-queries



(Image credit: arXiv:2402.11753)

[wjfox]

[wjfox]

[firestar464]

Game theory research shows AI can evolve into more selfish or cooperative personalities

https://techxplore.com/news/2024-04-gam ... lfish.html

[TanishaTanTan]

[spam deleted]

[wjfox]

[caltrek]

I have not read the book, but this review is interesting.

Experts Suggest Responsible AI Could Contribute to Global Peace
April 17 , 2024

Introduction:

(Eurekalert) Artificial intelligence (AI) could be a vital tool to promote peace, prevent violent conflict, and safeguard human rights – if used responsibly, experts say.

Much focus has been on AI’s potential for catastrophic harm from powering drone swarms for international warfare to generating deep fakes which spread misinformation and prejudice.

But authors Branka Panic and Dr Paige Arthur say AI-driven technology should also be seen as a potential force for good in conflict-torn countries to ‘wage peace’.

With the ongoing wars in Ukraine and Gaza and three decades on from the Rwandan genocide, their book AI for Peace highlights concrete ways that AI tools are being used to support peace—not war. It shows how civil society organizations, universities, tech companies, international organizations and governments are already trying to harness the positive powers of machine learning, neural networks and natural language processing.

Amnesty International, the Carter Center and Microsoft are among those using AI for peacebuilding, prevention, and protecting freedoms. Identifying conflict hotspots, combating hate speech, assisting human rights investigations and analyzing the effects of climate change on conflict are some of the main areas being explored.

Read more of the Eurekalert article here: https://www.eurekalert.org/news-releases/1041069

For a chapter by chapter abstract of the book: https://www.taylorfrancis.com/books/mo ... ge-arthur

[caltrek]

Fareed Zakaria is not my favorite commentator on current affairs. Yet, I do find him to be an intelligent voice to which it is worth listening, even as I sometimes disagree with his conclusions. The interview linked below is Zakaria at his best.

Will AI Mean the End of Liberal Democracy?
by
April , 2024

Introduction:

(Vox) What does it mean to say that we’re living in a revolutionary era?

Even political scientists can’t agree on the meaning of a “revolution,” but at the very least, we can agree that living through a revolution means living through extraordinary change in a relatively brief period.

By that standard, we’re definitely living in a revolutionary moment. The pace of change — both technological and cultural — in the last couple of decades has been astonishing. But is it really all that unusual in historical terms? Things are always changing. What makes the digital revolution so different? Is it about the scale or the scope of change? Or is it both?

Fareed Zakaria hosts CNN’s GPS and is a columnist at the Washington Post. His new book, Age of Revolutions: Progress and Backlash from 1600 to the Present, tries to make sense of the present by situating it in this historical pattern of revolution, starting with the Netherlands in the 16th century and ending with the digital era.

I recently invited Zakaria on The Gray Area to talk about those patterns and why he thinks this might be one of the most revolutionary ages in human history. Below is an excerpt of our conversation, edited for length and clarity.

Read more here (or listen to the podcast): https://www.vox.com/future-perfect/241 ... volution

caltrek’s comment: From the interview “Marx and Engels, they were bad economists, but they were brilliant social scientists.”

This reminded me of a professor (James O’Connor) I had at the university I attended. He had started out studying economics and switched to sociology. Although he never quite came out and explicitly labeled himself, it was pretty clear that his sympathies lie with what he called the neo-Marxists.

I think what made Marx and Engels “bad economists” was that they did not have the benefit of later understanding of economics developed by such theorists as John Maynard Keynes. What Marx and Engels did do was lay the groundwork for later breakthroughs, although Keynes insisted that he arrived at as his conclusions quite independently from Marx and Engels.

[caltrek]

Are Tomorrow’s Engineers Ready to Face AI’s Ethical Challenges?
by Elana Goldenkoff and Erin A. Cech
April 19, 2024

Introduction:

(The Conversation) A chatbot turns hostile. A test version of a Roomba vacuum collects images of users in private situations. A Black woman is falsely identified as a suspect on the basis of facial recognition software, which tends to be less accurate at identifying women and people of color.

These incidents are not just glitches, but examples of more fundamental problems. As artificial intelligence and machine learning tools become more integrated into daily life, ethical considerations are growing, from privacy issues and race and gender biases in coding to the spread of misinformation.

The general public depends on software engineers and computer scientists to ensure these technologies are created in a safe and ethical manner. As a sociologist and doctoral candidate interested in science, technology, engineering and math education, we are currently researching how engineers in many different fields learn and understand their responsibilities to the public.

Yet our recent research, as well as that of other scholars, points to a troubling reality: The next generation of engineers often seem unprepared to grapple with the social implications of their work. What’s more, some appear apathetic about the moral dilemmas their careers may bring – just as advances in AI intensify such dilemmas.

Aware, but unprepared

As part of our ongoing research, we interviewed more than 60 electrical engineering and computer science masters students at a top engineering program in the United States. We asked students about their experiences with ethical challenges in engineering, their knowledge of ethical dilemmas in the field and how they would respond to scenarios in the future.

Read more here: https://theconversation.com/profiles/e ... h-389355

[wjfox]

[weatheriscool]

This fucker literally wants us to live in the stone age. I am not kidding when I say that their entire agenda is exactly that.

[raklian]

[wjfox]

[firestar464]

Depends whether they're considered people or not. You can't subpoena a monkey or a parrot.

[firestar464]

Turing test study shows humans rate artificial intelligence as more 'moral' than other people

https://techxplore.com/news/2024-05-tur ... moral.html

[wjfox]

Ilya Sutskever and Jan Leike have now both resigned. They led OpenAI's "Superalignment" work.

[Tadasuke]

We humans don't agree on how we align, so how can our digital progeny be aligned? We currently have no common alignment!



Some people predicted this.

[wjfox]

Big tech has distracted world from existential risk of AI, says top scientist

Max Tegmark argues that the downplaying is not accidental and threatens to delay, until it’s too late, the strict regulations needed

Sat 25 May 2024 06.00 BST

Big tech has succeeded in distracting the world from the existential risk to humanity that artificial intelligence still poses, a leading scientist and AI campaigner has warned.

Speaking with the Guardian at the AI Summit in Seoul, South Korea, Max Tegmark said the shift in focus from the extinction of life to a broader conception of safety of artificial intelligence risked an unacceptable delay in imposing strict regulation on the creators of the most powerful programs.

“In 1942, Enrico Fermi built the first ever reactor with a self-sustaining nuclear chain reaction under a Chicago football field,” Tegmark, who trained as a physicist, said. “When the top physicists at the time found out about that, they really freaked out, because they realised that the single biggest hurdle remaining to building a nuclear bomb had just been overcome. They realised that it was just a few years away – and in fact, it was three years, with the Trinity test in 1945.

“AI models that can pass the Turing test [where someone cannot tell in conversation that they are not speaking to another human] are the same warning for the kind of AI that you can lose control over. That’s why you get people like Geoffrey Hinton and Yoshua Bengio – and even a lot of tech CEOs, at least in private – freaking out now.”

https://www.theguardian.com/technology/ ... egulations