AI alignment and ethics

firestar464
Posts: 823
Joined: Wed Oct 12, 2022 7:45 am

Re: AI alignment and ethics

Post by firestar464 »

Destroying humanity might be harder than just chillin' IMO. Also it's aligned by default
User avatar
caltrek
Posts: 6613
Joined: Mon May 17, 2021 1:17 pm

Re: AI alignment and ethics

Post by caltrek »

Experts Warn: We Must Stop Technology-driven AI and Focus on Human Impact First
March 4, 2024

Introduction:
(Eurekalert) We need to stop designing new AI technology just because we can, causing people to adapt practices, habits and laws to fit the new technology; instead we need to design AI that fits exactly with what we need, according to human-centred AI advocates.

Fifty experts from around the world have contributed research papers to a new book on how to make AI more ‘human-centred,’ exploring the risks — and missed opportunities — of not using this approach and practical ways to implement it.

The experts come from over 12 countries, including Canada, France, Italy, Japan, New Zealand and the UK, and more than 12 disciplines, including computer science, education, the law, management, political science and sociology.

Human-Centered AI looks at AI technologies in various contexts, including agriculture, workplace environments, healthcare, criminal justice, higher education, and offers applicable measures to be more ‘human-centred,’ including approaches for regulatory sandboxes and frameworks for interdisciplinary working.

What is human-centred AI?

Artificial intelligence (AI) permeates our lives in an ever-increasing way and some experts are arguing that relying solely on technology companies to develop and deploy this technology in a way that truly enhances human experience will be detrimental to people in the long-term. This is where human-centered AI comes in.
Read more of the Eurekalert article here: https://www.eurekalert.org/news-releases/1035411

For more information concerning the book Human-Centered AI[/i[: https://www.routledge.com/Human-Centere ... 032341620
Don't mourn, organize.

-Joe Hill
User avatar
wjfox
Site Admin
Posts: 8939
Joined: Sat May 15, 2021 6:09 pm
Location: London, UK
Contact:

Re: AI alignment and ethics

Post by wjfox »

Researchers jailbreak AI chatbots with ASCII art -- ArtPrompt bypasses safety measures to unlock malicious queries

By Mark Tyson
published 7 March 2024

Researchers based in Washington and Chicago have developed ArtPrompt, a new way to circumvent the safety measures built into large language models (LLMs). According to the research paper ArtPrompt: ASCII Art-based Jailbreak Attacks against Aligned LLMs, chatbots such as GPT-3.5, GPT-4, Gemini, Claude, and Llama2 can be induced to respond to queries they are designed to reject using ASCII art prompts generated by their ArtPrompt tool. It is a simple and effective attack, and the paper provides examples of the ArtPrompt-induced chatbots advising on how to build bombs and make counterfeit money.

https://www.tomshardware.com/tech-indus ... us-queries


Image
(Image credit: arXiv:2402.11753)
User avatar
wjfox
Site Admin
Posts: 8939
Joined: Sat May 15, 2021 6:09 pm
Location: London, UK
Contact:

Re: AI alignment and ethics

Post by wjfox »

User avatar
wjfox
Site Admin
Posts: 8939
Joined: Sat May 15, 2021 6:09 pm
Location: London, UK
Contact:

Re: AI alignment and ethics

Post by wjfox »

firestar464
Posts: 823
Joined: Wed Oct 12, 2022 7:45 am

Re: AI alignment and ethics

Post by firestar464 »

Game theory research shows AI can evolve into more selfish or cooperative personalities

https://techxplore.com/news/2024-04-gam ... lfish.html
User avatar
TanishaTanTan
Posts: 22
Joined: Tue Jan 10, 2023 10:23 pm

Re: AI alignment and ethics

Post by TanishaTanTan »

Lariliss wrote: Mon Oct 18, 2021 4:36 pm AI is reshaping the society in sense of data processing, effectiveness. But still it is not fully data driven (within society, not taking into account the hazardous applications where humans cannot really go, being our hands and eyes).

The questions of the human/AI society have been there since the AI appeared. Let them appear for the awareness and deeds.

This case is not about human values as we are used to think of.
AI is reshaping society in a way of data-driven technologies -appeal to the desire for certainty, and the yearning to understand and predict.
The algorithms faster and deeper to understanding and human behaviour, education, control over human habits and target marketing.
That is the subject.
We are not putting human features ti AI, we are making those features clearer to ourselves with the help of AI productivity of data processing and prediction. This topic can be debated for a long time. The interaction between AI and society requires a balance between innovation and protecting the interests of people. We will see all this in the future, for now this is just the beginning. I'm currently studying artificial intelligence a lot, I found here a lot of information . You shouldn’t put pros and cons right away. This is pointless for now, since AI is still in its development stage.
Every piece of technology has two coin sides, just to have the brightest example of the internet.
Soon we will attribute human qualities to artificial intelligence.
Last edited by TanishaTanTan on Wed Apr 24, 2024 7:54 pm, edited 1 time in total.
User avatar
wjfox
Site Admin
Posts: 8939
Joined: Sat May 15, 2021 6:09 pm
Location: London, UK
Contact:

Re: AI alignment and ethics

Post by wjfox »

User avatar
caltrek
Posts: 6613
Joined: Mon May 17, 2021 1:17 pm

Re: AI alignment and ethics

Post by caltrek »

I have not read the book, but this review is interesting.

Experts Suggest Responsible AI Could Contribute to Global Peace
April 17 , 2024

Introduction:
(Eurekalert) Artificial intelligence (AI) could be a vital tool to promote peace, prevent violent conflict, and safeguard human rights – if used responsibly, experts say.

Much focus has been on AI’s potential for catastrophic harm from powering drone swarms for international warfare to generating deep fakes which spread misinformation and prejudice.

But authors Branka Panic and Dr Paige Arthur say AI-driven technology should also be seen as a potential force for good in conflict-torn countries to ‘wage peace’.

With the ongoing wars in Ukraine and Gaza and three decades on from the Rwandan genocide, their book AI for Peace highlights concrete ways that AI tools are being used to support peace—not war. It shows how civil society organizations, universities, tech companies, international organizations and governments are already trying to harness the positive powers of machine learning, neural networks and natural language processing.

Amnesty International, the Carter Center and Microsoft are among those using AI for peacebuilding, prevention, and protecting freedoms. Identifying conflict hotspots, combating hate speech, assisting human rights investigations and analyzing the effects of climate change on conflict are some of the main areas being explored.
Read more of the Eurekalert article here: https://www.eurekalert.org/news-releases/1041069

For a chapter by chapter abstract of the book: https://www.taylorfrancis.com/books/mo ... ge-arthur
Don't mourn, organize.

-Joe Hill
User avatar
caltrek
Posts: 6613
Joined: Mon May 17, 2021 1:17 pm

Re: AI alignment and ethics

Post by caltrek »

Fareed Zakaria is not my favorite commentator on current affairs. Yet, I do find him to be an intelligent voice to which it is worth listening, even as I sometimes disagree with his conclusions. The interview linked below is Zakaria at his best.

Will AI Mean the End of Liberal Democracy?
by
April , 2024

Introduction:
(Vox) What does it mean to say that we’re living in a revolutionary era?

Even political scientists can’t agree on the meaning of a “revolution,” but at the very least, we can agree that living through a revolution means living through extraordinary change in a relatively brief period.

By that standard, we’re definitely living in a revolutionary moment. The pace of change — both technological and cultural — in the last couple of decades has been astonishing. But is it really all that unusual in historical terms? Things are always changing. What makes the digital revolution so different? Is it about the scale or the scope of change? Or is it both?

Fareed Zakaria hosts CNN’s GPS and is a columnist at the Washington Post. His new book, Age of Revolutions: Progress and Backlash from 1600 to the Present, tries to make sense of the present by situating it in this historical pattern of revolution, starting with the Netherlands in the 16th century and ending with the digital era.

I recently invited Zakaria on The Gray Area to talk about those patterns and why he thinks this might be one of the most revolutionary ages in human history. Below is an excerpt of our conversation, edited for length and clarity.
Read more here (or listen to the podcast): https://www.vox.com/future-perfect/241 ... volution

caltrek’s comment: From the interview “Marx and Engels, they were bad economists, but they were brilliant social scientists.”

This reminded me of a professor (James O’Connor) I had at the university I attended. He had started out studying economics and switched to sociology. Although he never quite came out and explicitly labeled himself, it was pretty clear that his sympathies lie with what he called the neo-Marxists.

I think what made Marx and Engels “bad economists” was that they did not have the benefit of later understanding of economics developed by such theorists as John Maynard Keynes. What Marx and Engels did do was lay the groundwork for later breakthroughs, although Keynes insisted that he arrived at as his conclusions quite independently from Marx and Engels.
Don't mourn, organize.

-Joe Hill
Post Reply