The Singularity - Official Thread

[wjfox]

[Tadasuke]

We will know years in advance before a new type of computer is going to be mass produced. Computer chips of 2026 will be produced in fabs which are already under construction and we knew in 2020 they were going to be constructed. There is no revolutionary new computer design coming before the 2030s. It's not impossible that one day we will see computers jump 1000x in performance, but for now the trend for personal computers is nothing of the sort. Supercomputer GPUs get 2x faster every 2 years, but they also get more expensive. Desktop CPUs and GPUs get twice as fast after 4 years at constant price (GTX 1060 vs RTX 3060, Ryzen 1800X vs Ryzen 5900X, i5-8400 vs i5-12400). But overall I agree with him.

[Ozzie guy]

OpenAI hinting that they may have made an AI with consciousness.


A reddit user said "A lot of recent statements from AGI CEOs such as Altman and the recent developments makes us feel like they’re trying to break some news gently…"

I recall Sam Altman saying

and an OpenAI employee saying 5% chance of AGI in 2022



As much as I am a schizo for AI I don't want to try and read into a company dropping hints lmao.

Maybe this could be to do with proto AGI.

[Ozzie guy]

https://blogs.microsoft.com/ai-for-busi ... echnology/

A reddit users comment

""One important approach to advancing model capabilities is the training of expert models with subtasks using an ensemble method, named Mixture of Experts (MoE). The MoE architecture also preserves sublinear computation with respect to model parameters that provides a promising path to improve model quality via scaling out trillions of parameters without increasing training cost. We have also developed MoE models to our pretrained model family accelerated with DeepSpeed. (DeepSpeed details can be found below.)

Large models with billions or even trillions of parameters require a host of optimization and parallelization strategies to be trained efficiently. So, we developed a set of optimization techniques, such as the Zero Redundancy Optimizer (ZeRO), and open sourced them into a PyTorch acceleration library called DeepSpeed since 2020. DeepSpeed continues to trailblaze with an extreme focus on speed, scale, efficiency, usability and democratization of large-scale model training and inferencing.

ZeRO-Infinity is another feature in DeepSpeed. It breaks the GPU memory wall to enable training models with trillions of parameters by offloading parameters and state to the NVMe disk storage, enabling you to train large models on a single GPU or a single node with a few GPUs. For example, you can fine-tune a GPT-3-sized model on a single node thanks to ZeRO-Infinity to create the ability to train very large models on more modest hardware. Using DeepSpeed optimizations our internal production workloads have seen anywhere from 2x to 20x bigger model scale and fast training for large models.

Our commitment to sharing the key building blocks for these models as a platform via open source remains strong. We continuously innovate in DeepSpeed, ONNX Runtime and the training recipes in Azure Machine Learning to push the boundaries of efficiency to train and serve the models and increase scale of models to trillions of parameters. We’ll continue to democratize the access and ability to train or adapt ever-larger base models and deploy these models to the cloud."

This blogpost seems like a dry business report on the surface, but it outlines many aspects of Microsoft's strategy moving forward, including what based on the above quotes, looks like a multi-trillion parameter language model which will likely have multi-modal capabilities.

If scaling to trillions of parameters results in further emergent abilities, we will become aware of it soon.""

[wjfox]

Findings: No Singularity Imminent

There is no upcoming technological singularity, and complexity in our lives will likely begin decreasing “sometime in the not too distant future,” says Theodore Modis, a scientist and strategic analyst specializing in the study of growth and cycles in a variety of contexts.

Modis’s article “Links between Entropy, Complexity, and the Technological Singularity” in the journal Technological Forecasting & Social Change (March 2022) corroborates 20 years of research that has enabled him “to establish a simple mathematical relationship between entropy and complexity,” he stated in an email. “This relationship provides general guidelines on how complexity relates to entropy, for example complexity is higher when entropy grows faster,” he writes.

Limited-time access to the article is free on Elsevier’s website, or readers may download a preprint here.

Read more: http://www.aaiforesight.com/newsletter/ ... y-and-more

[funkervogt]

Findings: No Singularity Imminent

There is no upcoming technological singularity, and complexity in our lives will likely begin decreasing “sometime in the not too distant future,” says Theodore Modis, a scientist and strategic analyst specializing in the study of growth and cycles in a variety of contexts.

Modis’s article “Links between Entropy, Complexity, and the Technological Singularity” in the journal Technological Forecasting & Social Change (March 2022) corroborates 20 years of research that has enabled him “to establish a simple mathematical relationship between entropy and complexity,” he stated in an email. “This relationship provides general guidelines on how complexity relates to entropy, for example complexity is higher when entropy grows faster,” he writes.

Limited-time access to the article is free on Elsevier’s website, or readers may download a preprint here.

Read more: http://www.aaiforesight.com/newsletter/ ... y-and-more

Wow, that's scary.

In any case complexity, as determined by the 28 milestones, has reached a maximum and now begins on the declining slope of its bell-shaped pattern. It is a direct consequence of having described the accumulation of entropy by a natural-growth (logistic) pattern, which so far seems to hold as there haven’t been any ―milestones in the last 25 years. There have been many small ones but nothing like the Internet, DNA, or nuclear energy. The idea that our world’s complexity will decrease in the future may seem difficult to accept but such a unimodal pattern(namely low at the beginning and at the end but high in between, not unlike the normal—Gaussian—distribution3)is commonplace in everyday life.

Hmm. This claim could be challenged. The last of the 28 milestones is "Internet, human genome sequenced."

The internet became common in the late 90s and the human genome was first sequenced in 2001 or 2003 (depending on how you look at it). Since then, there have been other, very impactful tech milestones:
-Invention of smartphones and their rapid proliferation
-Invention of social media
-Can anyone think of more?

Additionally, we might look back on the advent of cryptocurrency as being so impactful that it deserves inclusion on the milestone list. We need more time to see how it pans out.

The rise of affordable, high-quality VR technology and of machines that can pass the Turing Test will probably happen in the next ten years, and will also probably be so impactful that they will count as milestones on the list.

[raklian]

He didn't even consider the real possibility of A.I. taking the reins from us in terms of generating breakthroughs at least on par with the Internet and other equally paradigm-shifting revolutions.

It's a flawed analysis, in my view. It's basically a modern rehashing of "going more than 45 mph will asphyxiate us" quipped by some 19th century dude.

[BaobabScion]

[Yuli Ban]

[Ozzie guy]

He said 2030ish = 50% chance of AGI
If not then maybe a few decades after.

[wjfox]

[Ozzie guy]

A popular rightwinger made a video describing and attacking transhumanism so his audience knows what it is and hates it. Concepts such as the singularity are getting more and more widespread as we get closer to it.

I think both the hardright and left will oppose the development of singularity (left doesn't want it done by capitalists)

[Tadasuke]

A popular rightwinger made a video describing and attacking transhumanism so his audience knows what it is and hates it. Concepts such as the singularity are getting more and more widespread as we get closer to it.

I think both the hardright and left will oppose the development of singularity (left doesn't want it done by capitalists)

Harmful idiots. It's best to not give them views or at least dislike their videos if you watch them. Opposing The Technological Singularity is like opposing Cambrian Explosion or the Industrial Revolution. And they don't understand the concept anyway. TS is about the acceleration of life and its tools since the beginning of the Earth. Of course it's getting more widespread, thanks to the WWW. I remember (the crazy) Alex Jones talking about it (and mentioning Kurzweil) many, many years ago. Fortunately, he was banned from YouTube. Ben Goertzel wants en egalitarian, open, crowd-sourced, bottom-up Singularity, but I think it will be corporations (and some governments) pushing the most for it. As time goes on, my estimation date for the Singularity is being pushed further and further. I used to say 2045, then 2065, now 2070, but I'm more and more thinking about pushing my prediction to 2080 or later.

[Ozzie guy]

Probably the most prominant member of r/singularity "Dr_Singularity" still seems to expect human level AGI this year.
Given his prominance in the community I at least hold on to his prediction as a less than 5% chance probability and it is a nice unlikely hope which can make 2022 more exciting.

[Yuli Ban]

A popular rightwinger made a video describing and attacking transhumanism so his audience knows what it is and hates it. Concepts such as the singularity are getting more and more widespread as we get closer to it.

I think both the hardright and left will oppose the development of singularity (left doesn't want it done by capitalists)

They've been doing this for years now. Decades even. Far-right conspiratorial types have been talking about transhumanism for almost as long as transhumanists.

It's automation and anti-automation hysteria that will interest me more. I'm aware of Mark Dice, as he was a pretty big name early on in the alt-right scene. He reminds me of my hard-right uncle, as well as a fictional character I created about three or four years back, a stereotypical American dude who values Boomer/Xer Man living of beer, grilling, football, and Sunday church. He definitely has been pretty aware of robotics. One of the videos I saw of him way back in 2017 I want to say was him trashing Pepper the Robot, so he absolutely will talk shit about automation.
I'm just waiting for the inevitable turn, the rise of the talking point "automation is being pursued by leftists to disempower the common man" and "automation is a hoax, experts all agree it's not happening anywhere near the sci-fi obsessed idiots say it is, and you ought to expect to get your hands dirty working for the next few hundred years, libtards."

[Lurking]

I'm just waiting for the inevitable turn, the rise of the talking point "automation is being pursued by leftists to disempower the common man" and "automation is a hoax, experts all agree it's not happening anywhere near the sci-fi obsessed idiots say it is, and you ought to expect to get your hands dirty working for the next few hundred years, libtards."

I'd expect a more generalized "masses vs the elite" mentality

[wjfox]

[Yuli Ban]

[Nanotechandmorefuture]

A popular rightwinger made a video describing and attacking transhumanism so his audience knows what it is and hates it. Concepts such as the singularity are getting more and more widespread as we get closer to it.

I think both the hardright and left will oppose the development of singularity (left doesn't want it done by capitalists)

I see the transgender stuff must have been been in the works a while ago then which makes it even more troublesome. I remember back in the 90's they were still showing some show from the 80's about transgenderism so I guess it was being tied into transhumanism since back then. I see why most people don't follow transhumanism when you have that going on.

You're right Set and Meet goals about the opposition. You think its bad now with those resistance movements whether government owned (usually infiltrated anyways) or not? Just wait until people start walking around with some sort of designation that they have been augmented inside their body like Neuralink for example. The whole part about religious terrorists since they would be against this sort of thing is accurate and I forget the name of the dude with the Alex Jensen Deus Ex image because the series talks about this exact danger happening when it gets in the face of more people.

Edit to add: Dude's name is Cyber_Rebel. Hell yeah lol.

[Yuli Ban]