Site Navigation
Online Users
6 members, 1765 visitors and 1 anonymous usersGoogle, Smithy, andr99, Bing, stubaby, hhh, dharma, dougie
Advertisement
OT: Moonshot AI
Moonshot AI is a Beijing-based AI startup focused on large-scale foundation models and AGI, best known for its trillion-parameter Mixture-of-Experts model Kimi K2 and the consumer chatbot Kimi.
Company basicsMoonshot AI was founded in early 2023 by three Tsinghua University alumni, including CEO Yang Zhilin, a Carnegie Mellon–trained researcher behind Transformer-XL and XLNet. The company’s Chinese name, 月之暗面 (“Dark Side of the Moon”), is a nod to Pink Floyd and symbolizes its ambition to explore uncharted territory in AI. It is headquartered in Haidian District, Beijing, in the JD Technology Building.
Funding, scale, and positioningThe startup went from inception to a multibillion-dollar valuation in under two years, raising roughly $1.27 billion and reaching around a $3.3 billion valuation according to 2025 reporting. Major investors include Chinese internet platforms such as Alibaba, Tencent, Meituan, and HongShan (formerly Sequoia China). Strategically, Yang has framed Moonshot’s ambition as combining OpenAI’s “technical idealism” with ByteDance’s commercial execution, with a long-term focus on AGI rather than narrow, short-horizon product-market fit.
Core products and modelsMoonshot’s flagship consumer product is Kimi, a ChatGPT-style assistant that became popular in China for handling extremely long inputs, reportedly up to about 2 million characters. Underneath Kimi sits Kimi K2, a foundation model with 1 trillion total parameters implemented as a Mixture-of-Experts (MoE), activating about 32 billion parameters per inference for efficiency. The architecture includes hundreds of experts, dozens of layers and attention heads, and a long context window around 128,000 tokens, reflecting a strong emphasis on “lossless long context.”
They have also released specialized models such as Kimi-Audio, an audio foundation model for tasks like speech recognition, audio understanding, and speech-to-speech conversation. For developers, they provide APIs and open-weight models, supported by a GitHub presence and a community forum for technical discussion and integration support.
Technical innovations and training approachA key technical differentiator is Moonshot’s use of the Muon optimizer and its variant MuonClip, a training method developed by external researchers and extended by Moonshot and UCLA collaborators. Muon uses matrix orthogonalization to avoid getting stuck in dominant parameter directions, improving exploration of the solution space in large models. Reported results include roughly 2x training efficiency, about 50% lower memory usage, and no training failures across 15.5 trillion tokens for a trillion-parameter model, which is notable at that scale.
Kimi K2’s performance benchmarks show strong results particularly in coding and math relative to leading Western models like GPT‑4.1 and Claude Opus, including higher scores on LiveCodeBench v6, SWE‑bench Verified, and MATH‑500 according to public evaluations. Architecturally, the stack combines long-context transformer ideas (building on Transformer‑XL heritage) with MoE routing to keep inference cost manageable while scaling up total parameters.
Philosophy, open-source stance, and economicsMoonshot’s stated research philosophy is to “think from the end,” designing architectures and training strategies around a long‑run vision of AGI and extremely long context windows. Yang has argued that if context length approached one billion tokens, many current problems would disappear because the token space itself becomes a kind of general‑purpose computer or “world model.” In that worldview, fine‑tuning may become less central over time, with instruction-following and contextual learning doing more of the work.
Economically, Moonshot has embraced an aggressive open-source and low‑cost API strategy, open‑sourcing Kimi K2 weights and pricing its API significantly below incumbents (e.g., around $0.15 per million input tokens and $2.50 per million output tokens in public materials). Their shift from closed to open source aligns with broader trends in the Chinese AI ecosystem, where players like Baidu and DeepSeek have demonstrated that open models can be competitive with proprietary ones. They have emphasized that, for them, “users are the only real leaderboard,” prioritizing adoption and practical use cases over benchmark dominance.
For someone with your background, the interesting angle is Moonshot’s combination of frontier-scale MoE models, long-context emphasis, and a cut‑rate open API model, which could impact both AI tooling economics and, downstream, the cost structures of data-heavy and quant workflows. Would you be most interested in how Moonshot’s models could plug into trading and research pipelines, or are you more focused on their broader AGI and macro‑AI implications?
36 Views · 1 Replies ( Last reply by slupert )
50 Views · 3 Replies ( Last reply by slupert )
He talked about a deep state. LOL Everybody
sees him with Jensen and all the rest of the tech Billionaires hanging out. TSMC announced blowout earnings and the stock sold off anyways, Wall Street and the Billionaires knew what was coming. Things are just great if you are in the Billionaire state, America is gone for everybody else. He iwon't go down alone he will frag America with him. (JMHO)
60 Views · 1 Replies ( Last reply by slupert )
It's official, we are a Banana Republic. God only knows
where America is headed now. (JMHO)
T A Stuff
Since early June the SPX has been putting in a symmetrical triangle on the daily chart. When a symmetrical triangle occurs
after a meaningful move to the upside it's referred to as a Bull Pennant. The top of the triangle is 7620 and the bottom is 7275.
The breakout to the upside occurred last week at 7500. The theory is that the target price is equal to the distance between the
top and the bottom. In this case 7620-7275 = 343 points. And, the theory is that the price target is the breakout point + the
difference between the top and bottom, 7500+343=7845. Unfortunately, the theory doesn't make reference to any time frame
for the target price to be met. Also, I'm not aware of any data as to how many times a fake breakout has occurred.
97 Views · 1 Replies ( Last reply by slupert )
- 940,842 Total Posts
- 3,188 Total Members
- Michael Lu Newest Member
- 64,402 Most Online
1771 users are online (in the past 60 minutes)
6 members, 1764 guests, 1 anonymous users (See full list)
Google, Smithy, andr99, Bing, stubaby, hhh, dharma, dougie













