Which startup can take the cash burning championship?

Sure, here's the HTML structure with the simplified Chinese text: ```html 私人推理与公共推理的误导性成本

私人推理与公共推理的误导性成本

``` In this structure: - `` tag contains the translated title: "私人推理与公共推理的误导性成本". - `<h1>` tag contains the translated headline: "私人推理与公共推理的误导性成本". Replace `<!-- Your content here -->` with the rest of your HTML content if needed.</h1> <p>```html </p> <p>作为开放和私人LLM的倡导者,我计算了私人和公共LLM成本的一些数据。结果让人摸不着头脑,并让我意识到AI初创公司燃烧的资金有多么惊人。在追求盈利的名义下,订阅成本会在多长时间内激增?一位同事向我提出挑战,要求比较英国私人和公共推理的成本。我进行了许多不严谨的假设,很明显这些假设不公平,但最后我惊讶地发现,这些估算甚至无关紧要。即使考虑误差范围,差异也是惊人的。如有遗漏,请随时检查我的数学。</p> ``` <figure class="om on oo op oq gz gr gs paragraph-image"><div class="gr gs ol"><picture><img alt="" class="bg he hf c" width="518" height="482" loading="lazy" role="presentation" src="/posts/0%24b9Q7GM73pfneigoC.png"></picture></div> <figcaption class="hg fe hh gr gs hi hj be b bf z dt">2xGV100 32GB is still my favorite value inference rig at ~$3,000 in the UK.</figcaption></figure><h1>Sure, here's the translation of "Private Costs" into simplified Chinese, while keeping the HTML structure intact: ```html <span lang="zh-CN">私人成本</span> ```</h1> <p>Sure, here's the translation of the text into simplified Chinese while keeping the HTML structure: ```html </p> <p>我开始估算购买硬件以运行当今顶级开源模型的资本成本。一个能够处理量化大模型的良好GPU设备可能轻松花费超过$20,000。我使用一对老旧的V100与NVlink,二手价格约为$3,000。我将计算两种极端情况的成本。像这样的一台设备的总成本可能在$4,000至$30,000之间。</p> ``` This HTML snippet contains the translated text in simplified Chinese, structured as a paragraph (`<p>` tag) for proper formatting and readability on a webpage.</p> <p>To translate the provided text into simplified Chinese while keeping the HTML structure, you can use the following: ```html </p> <p>其次,我计算了每秒30到40个标记的不间断推理能耗。在英国,电费大约是美国的3倍,属于世界上最高的之一,因此我不建议这样做。可持续能源和碳中和目标可能值得一提,但我没有考虑进去。我的设备在推理负载下,GPU大约使用2x230W,整个系统大约使用200-300W。一个计量设备显示推理负载时平均约为700W。</p> ``` In this translation: - `<p>` tags are used to maintain the structure of paragraphs in HTML. - Simplified Chinese characters are used for the translation of the text. - The translation reflects the original meaning and technical details provided in the English text.</p> <h2>Sure, here's the HTML structure with the simplified Chinese translation: ```html </h2> <p>$0.40/kWh * 0.7kW = $0.28/h</p> ``` Translated to simplified Chinese: ```html <p>$0.40/千瓦时 * 0.7千瓦 = $0.28/小时</p> ``` In this translation: - "kWh" (kilowatt-hour) is translated to "千瓦时". - "kW" (kilowatt) is translated to "千瓦". - "/h" (per hour) is translated to "/小时". <p>Certainly! Here's the translated text in simplified Chinese, keeping the HTML structure intact: ```html 这是我的每小时估算。如果我一年内持续进行推断,根据高峰/低谷费率,最多可能达到每年$2,453。加上资本投资和一年能源成本,我在一年内可以预计至少要花费的金额,不包括折旧和故障损失: ``` Feel free to use this in your HTML structure!</p> <h2>Sure, here's the translation in simplified Chinese while maintaining HTML structure: ```html $6,453/year private ``` Translated to simplified Chinese: ```html ¥6,453/年 私人 ``` In this translation: - `¥` represents the symbol for Chinese Yuan (Renminbi). - `年` means "year". - `私人` means "private".</h2> <p>To translate the given English text into simplified Chinese and preserve the HTML structure, you can use the following: ```html </p> <p>在今年,我的私人设备预计能够推断大约1,261,440,000个令牌(输入/输出),成本约为每个令牌$0.000005116。这个成本不包括任何多模式LLM(如GPT 4o)的高级批处理功能或代理,但我们可以估计它在我们的业务案例中几乎与GPT 3.5+加速版一样有用。</p> ``` This HTML snippet will display the translated text in simplified Chinese, maintaining the structure of the original English text.<p>Sure, here's the HTML structure with the simplified Chinese translation embedded: ```html </p> <p>要在云端重现所有这些,我发现在谷歌云平台(GCP)使用荷兰的现货实例可以将最低费用降低到14,460美元。如果我们计划一年的成本,预留实例可能会进一步降低这个费用,但看起来本地解决方案始终更经济实惠。尽管如此,云端自动扩展在扩展到更大群体时提供了很大的优势。</p> ``` In this HTML snippet: - `<p>` tags are used to encapsulate the paragraph for proper structure. - The simplified Chinese text is embedded directly within the `</p> <p>` tags. This structure maintains the HTML formatting while providing the translated text in simplified Chinese.</p> <h1>Sure, here's how you can write "Public Costs" in simplified Chinese within an HTML structure: ```html 公共成本 ``` This translates "Public Costs" directly into simplified Chinese characters.</h1> <p>```html </p> <p>GPT 3.5+turbo 现在不那么受欢迎了,因为 GPT 4+ 模型已经推出,并且成本与私下推测的代币有些不同。目前,GPT 3.5+turbo 的成本是每百万输入代币 3 美元,每百万输出代币 6 美元。这意味着您的提示输入(包括任何 RAG 资源)的成本只有从 LLM 输出的预测代币的一半。私密 LLM 在这里不会区分输入/输出成本,因为无论如何处理代币都需要更多的能量。私密 Llama.cpp 缓存可防止在聊天过程中重新解析先前摄取的提示。我仍然不确定在封闭的 GPT 3.5 模型中是否是这种情况,但有一个讨论似乎表明并非完全如此。</p> ``` <p>Certainly! Here's the translation of the provided text into simplified Chinese, maintaining the HTML structure: ```html </p> <p>使用聊天,我估计尽管是随意的,但随着每次完成,将有四分之三的标记作为输入。这意味着每百万标记的平均成本为$3.75。OpenAI 有并行负载平衡的额外好处,而单个私人设备一次只能处理一个完成。将其与我们私下年初的原始标记数量对比:</p> ``` This HTML snippet contains the simplified Chinese translation while preserving the original text structure.<p>Certainly! Here's the HTML structure with the translated text in simplified Chinese: ```html </p> <p> 1,261,440,000 / (1,000,000 * $3.75) = 1,261.4 * $3.75 = <span lang="zh-CN">1,261,440,000 / (1,000,000 * 3.75) = 1,261.4 * 3.75 =</span> </p> ``` In the above code: - `<p>` denotes a paragraph element. - `<span lang="zh-CN">` specifies the text inside as simplified Chinese. The translated text inside the `<span>` element is: "1,261,440,000 / (1,000,000 * 3.75) = 1,261.4 * 3.75 =".</span></span></p> <h2>Certainly! Here's how you can structure the HTML to display the translated text in simplified Chinese: ```html <span lang="zh-CN">¥4,730.25/年 公共</span> ``` This HTML snippet ensures that the text "¥4,730.25/年 公共" is displayed correctly in a browser, with "年" indicating "year" and "公共" indicating "public" in simplified Chinese.</h2> <p>```html </p> <p>这意味着,要通过更加灵活和强大的GPT3.5+turbo订阅服务,获得接近我一年的私人LLM推断,只需花费$4,730.25(公开)与$6,453(私人)。私人成本将随着后续年份的减少而降低,而无需在硬件上进行资本投资,但公开级别的GPT3.5+turbo LLN显然是更好的选择。请记住,这甚至是以低成本的推断设备来计算,而不是顶级的H100/GB100服务器。如果将其改为像GPT-4o这样的惊人模型,目前的成本大约是每年9,000美元的两倍。私下投资将需要指数级的投资和大量的私人开发,才能获得类似GPT-4o的等效功能、RAG和代理支持。</p> ```<h1>Certainly! Here's the translation of "What Gives?" into simplified Chinese, keeping the HTML structure intact: ```html </h1> <p>什么情况?</p> ``` In this translation: - `<p>` and `</p>` maintain the paragraph structure in HTML. - "什么情况?" is the simplified Chinese translation of "What Gives?"

Sure, here's how you could structure that in HTML and translate it into simplified Chinese: ```html

Translate to Chinese

我很想说我可以设计一个私有基础设施来帮助企业节省人工智能成本,但事实上,公共人工智能服务在涉及常见知识和代码完成时仍然比大多数本地模型更便宜且更好。唯一的例外可能是针对您企业需求量身定制的精细调整的专业模型。

``` In simplified Chinese: ```html 翻译成中文

我很想说我可以设计一个私有基础设施来帮助企业节省人工智能成本,但事实上,公共人工智能服务在涉及常见知识和代码完成时仍然比大多数本地模型更便宜且更好。唯一的例外可能是针对您企业需求量身定制的精细调整的专业模型。

``` This HTML structure ensures the Chinese text is displayed correctly and is properly encoded.

Sure, here is the translated text in simplified Chinese, keeping the HTML structure intact: ```html

事实是公共AI服务之所以能够提供如此巨大的价值,是因为它们几乎像没有明天一样在烧钱。也许AI的末日即将来临,对吧?OpenAI 依然在大规模地提供顶尖的AI服务,但据传闻它们每年试图在市场上投入50亿美元,而亏损惨重。

``` This HTML snippet contains the translated text in simplified Chinese within a `

` (paragraph) element, suitable for use in web content.

Sure, here is the translated text in simplified Chinese, keeping the HTML structure: ```html

关于初创公司现金燃烧速度的故事越来越多。虽然云成本极高,但云GPU的灵活性对于训练至关重要。训练需要规模化扩展,而推断需要规模化部署。争夺硬件资源的公司常常会被超大规模云服务提供商击败,因为后者在硅片刻画前就已经大量订购。

``` This translates the original English text into simplified Chinese while preserving the HTML structure for integration into a web page or document.

Sure, here's the translated text in simplified Chinese while keeping the HTML structure intact: ```html

创业公司面临资本困境的答案是什么?一旦我们上了钩,订阅成本会上涨以实现盈利性,还是会下降?我怀疑是后者。公共AI订阅服务的价格如此之低真是疯了,考虑到其价值。我预计在接下来的一年里会有多个AI初创公司倒闭,就像已经有几家倒闭了一样。那些在数据中心拥有实体设备的公司将有资产可供清算。而那些在云计算上预算过多的公司可能除了可能的知识产权和训练模型外什么都没有。

``` This HTML snippet preserves the structure of the text while providing the translation in simplified Chinese.

Certainly! Here's the translation of "Conclusion" into simplified Chinese, while keeping the HTML structure: ```html 结论 ``` In this HTML snippet, "结论" is the simplified Chinese translation of "Conclusion".

```html

作为一个习惯性的DIY倡导者,我从不喜欢使用我自己能够管理的SaaS或产品。我也与很多客户打交道,他们不能让数据泄露在云账户或外部AI服务中。话虽如此,有很多情况下,公共的LLM比私人LLM能做的更多,而且似乎在利润警察来电之前,公共AI初创公司并不遵循我们大多数人遵循的现金流规则。我喜欢看到创新,但我担心当收账人来电时会发生什么。我很想听听你的想法。

```

2024-07-31 04:12:48 AI中文站翻译自原文