xAI – new AI startup announced by Elon Musk

[wjfox]

Elon Musk’s AI startup seeks to raise $1bn in equity

Wed 6 Dec 2023 07.58 GMT

Elon Musk’s artificial intelligence startup, xAI, is seeking to raise $1bn (£0.8bn) as the world’s richest man tries to keep pace with rivals including OpenAI, Microsoft and Google in the race to dominate the field.

The company has already raised $135m (£107m) from investors and is seeking a total of $1bn in equity financing, according to a filing with the US Securities and Exchange Commission.

The race to develop generative AI – products that generate convincing text, image and audio from simple prompts – has intensified as Silicon Valley’s biggest companies battle for supremacy after the release of OpenAI’s ChatGPT in November last year.

After the sensational impact of that chatbot, Microsoft announced a deepening of its partnership with OpenAI in January backed by a $10bn investment.

Musk, the chief executive of Tesla and SpaceX and the owner of the X platform formerly known as Twitter, was one of OpenAI’s co-founders in 2015 but left three years later. In July, Musk launched xAI and last month the company released its first AI model, a chatbot with a “rebellious streak” called Grok.

https://www.theguardian.com/technology/ ... -in-equity

[weatheriscool]

[firestar464]

only useful for twatter users ig

[spryfusion]

[firestar464]

I feel like he has put OpenAI on the spot there.

[weatheriscool]

XAI and X Will Release Grok 2 Next Week and It is Claimed to Surpass GPT4 and Claude 3
March 29, 2024 by Brian Wang

Elon says Grok 2 should exceed current AI on all metrics. Grok 2 is in training now



https://www.nextbigfuture.com/2024/03/x ... ude-3.html

[firestar464]

Elon is trying to get the last laugh.

Well I'm not sure the public will let him have it if it's not safety-aligned.

[weatheriscool]

[weatheriscool]

[caltrek]

Elon Musk Raises $6 Billion to Challenge OpenAI
by Dan Primack and Erica Pandey
May 27, 2024

Introduction:

(Axios) Elon Musk's AI startup — xAI — announced that it has raised $6 billion in one of the largest venture capital funding rounds of all time.

Why it matters: This could help Musk begin to catch up with ChatGPT maker OpenAI, which he co-founded before leaving in a dispute that's become litigious.

The intrigue: Some of the xAI investors, such as Andreessen Horowitz and Sequoia Capital, also backed OpenAI.

Zoom in: All of the $6 billion is new money, Musk tells Axios, rather than shares "given" to investors in Musk's takeover of Twitter/X.

Conclusion:

The bottom line: xAI didn't say much about what the new money will go toward, but The Information recently reported that it plans to build a massive new supercomputer — the "Gigafactory of compute" —possibly in partnership with Oracle.

Read more here: https://www.axios.com/2024/05/27/elon- ... nvestors

[weatheriscool]

Tesla Expanding AI Data Centers to 500 Megawatts and AI Inference Will Be 1000s of Times Today by 2033
June 20, 2024 by Brian Wang

https://www.nextbigfuture.com/2024/06/t ... -2033.html
Elon Musk announced Tesla’s plans to expand its AI hardware capabilities, aiming to increase power and cooling capacity from 130MW to over 500MW within the next 18 months. The expansion will support a mix of Tesla’s own AI hardware and Nvidia/other chips, with a goal to have half of the AI compute building dedicated to each. This move is part of Tesla’s strategy to enhance its AI capabilities, including the development of the Tesla AI5 (HW5) computer, which is expected to be 10 times more powerful than the current HW4 model and is slated for release in the second half of 2025.


Tesla will create new AI builds using Dojo and then immediately validate the build on a huge data center inference cluster, feeding them stored videos and simulations to determine if the build is better. This would be a rapid fire training flywheel. Tesla will bring new build validation into the data center, speeding new build validation by 100 times.

Tesla should add 10-20 million cars in 2026 and 2027 and those will have Hardware 5 (HW5 – AI5). This will be 10-20 Gigawatts of inference compute. If the HW5 chips are comparable to Nvidia H100s or B200s then they will have about 4-20 Petaflops of compute. 10 million cars would have 40,000 Exaflops to 400,000 Exaflops of inference compute.

[weatheriscool]

XAI Grok 2 in August Could Beat GPT 4o and Claude 3.5
July 11, 2024 by Brian Wang

https://www.nextbigfuture.com/2024/07/x ... e-3-5.html

Elon Musk described how XAI used 24,000 Nvidia H100s to create Grok 2, an AI model that is better than OpenAI GPT 4. XAI Grok 2 will release in August.

Elon is pushing the rapid 100k data center build to catch up for GPT 5 or 5.5. XAI set up the 100,000 Nvidia H100 themselves to get it faster so they can catch up to OpenAI.

xAI contracted for 24k H100s from Oracle and Grok 2 trained on those. Grok 2 is going through finetuning and bug fixes. Probably ready to release next month.

xAI is building the 100k H100 system itself for fastest time to completion. Aiming to begin training later this month. It will be the most powerful training cluster in the world by a large margin.

[firestar464]

The 50.6% on the MATH benchmark is still far behind GPT-4o at 76.6%. The rest of the article is just saying "big power --> big speed"

Nothing too impressive there imo

[spryfusion]

Benchmarks:

[firestar464]

[weatheriscool]

[weatheriscool]

xAI Expanding to Over 1 Million GPUs
December 4, 2024 by Brian Wang

xAI, is expanding the Colossus supercomputer in Memphis, Tennessee from 100,000 to over 1 million GPUs. This expansion, which has already started, involves a substantial financial commitment, potentially in the tens of billions, and includes collaborations with Nvidia, Dell, and Supermicro for GPU supply and server assembly. xAI’s strategy is to lead in the AI industry by surpassing competitors like Google, OpenAI, and Anthropic. This development not only boosts xAI’s computational power but also positions Memphis as an emerging center for AI technology.

xAI should have 200k H100s and H200s this month.

xAI is buying the first 100,000 B200s in January, 2025 and will have 300,000 B200s by April.

1 Million B200s and Dojo 2 (B200 equivalents) should be ready by the end of 2025.

xAI will shift to Dojo 3 and Nvidia Rubin chips in 2026.

https://www.nextbigfuture.com/2024/12/x ... -gpus.html

[weatheriscool]

[firestar464]

Aren't they using Flux AI?

[weatheriscool]