Sure, here's the text translated into simplified Chinese while keeping the HTML structure: ```html 如何运作大型语言模型(LLMs:从零到英雄) ``` In this translation: - "如何运作大型语言模型" means "How Large Language Model Works". - "(LLMs: 从零到英雄)" provides the explanation or additional detail about LLMs (Large Language Models: Zero-to-Hero) in Chinese.

Sure, here's the HTML structure with the translated text in simplified Chinese: ```html

这是我“从零到英雄”系列的第二篇文章。在本文中,我们旨在提供一个易于理解的解释,说明大型语言模型(LLM)是如何运作的。

``` In this HTML snippet: - `

` denotes a paragraph tag for structuring content. - The Chinese text provided is the translation of "This is the 2nd article in my Zero-to-Hero series. In this article, we aim to provide an accessible explanation of how a large language model (LLM) operates."

Sure, here's the translation: ``` LLM的工作原理 ```

Sure, here's how you can translate "Let’s first take a look at what a document completer model works like this:" into simplified Chinese while keeping the HTML structure: ```html

让我们首先看看文档补全模型的工作原理:

```

To translate "user prompt:" into simplified Chinese while keeping the HTML structure intact, you can use the following: ```html 用户提示: ``` This HTML snippet ensures that the text "用户提示:" is displayed in simplified Chinese, while specifying the language for proper rendering and accessibility.

A banana is

Sure, here is the translation of "model response" into simplified Chinese while keeping the HTML structure: ```html 模型响应: ```

an elongated, edible fruit

Sure, here's the translation in simplified Chinese while keeping the HTML structure: ```html 然后,一个文档生成器模型的工作方式如下: ``` This HTML structure maintains the original English text while providing the Chinese translation.

To translate "user prompt:" into simplified Chinese while keeping the HTML structure, you would write: ```html 用户提示: ```

I want to buy a new car

Sure, here's the translation of "model response" into simplified Chinese, while keeping the HTML structure intact: ```html 模型响应: ```

What kind of car do you want to buy?

Certainly! Here's the simplified Chinese translation of "Note the differences between the two above" while keeping the HTML structure: ```html 注意上述两者之间的不同。 ``` This HTML will display the Chinese text in your web page.

To translate the provided English text into simplified Chinese and maintain HTML structure, you can use the following code snippet: ```html

第一个模型只是一个文档补全器,它会根据找到的最有可能成为下一个字符的内容来完成提示。这是我们在互联网数据块上训练的模型,称为基础模型。

``` In this HTML snippet: - `

` tags are used to denote a paragraph, which is semantically appropriate for the translated text. - The Chinese text provided is a direct translation of the English text you provided. Make sure your HTML document is properly structured around this snippet for it to display correctly in a web context.

在保持HTML结构的情况下,将以下英文文本翻译为简体中文: 第二个模型是一个文档生成器,它将根据提示问题生成更接近人类回复的响应。这是ChatGPT模型。

Sure, here's the translated text in simplified Chinese while maintaining the HTML structure: ```html

The ChatGPT 模型是一个推理模型,可以根据提示问题生成响应。我会说它是基础模型的99%,但经过两个额外的训练步骤:微调步骤和从人类反馈中进行强化学习的步骤。

``` This HTML snippet contains the translated text in simplified Chinese.

在保持HTML结构的情况下,将以下英文文本翻译为简体中文: 预训练:基础模型

这构成了人工智能革命的核心,也是魔力真正所在的地方。

Sure, here's the HTML structure with the translated text in simplified Chinese: ```html

培训模型是一个通过提供大量数据并让它从中学习的过程。

```

Sure, here is the HTML structure with the translated text in simplified Chinese: ```html

根据 GPT-3 论文的描述,基础模型是在大量的互联网数据上进行训练的。这对像你我这样的个人来说并不是一件容易的事情。这不仅需要获取数据,还需要大量像 GPU 和 TPU 这样的计算资源。

``` This HTML snippet contains the translated text in simplified Chinese, maintaining the basic structure for web content.

Sure, here's the text translated into simplified Chinese, while keeping the HTML structure intact: ```html

但不用担心,我们仍然可以在自己的计算机上学习如何训练一个小型的GPT模型。我会在下一个主题中向您展示如何操作。

``` This HTML code snippet includes the translated text.

Sure, here's the translated text in simplified Chinese: LLM 训练背后的创新在于引入了 Transformer 架构,该架构使模型能够从大量数据中学习,同时保持输入不同部分之间的关键上下文关系。

Sure, here's the translated text in simplified Chinese while maintaining the HTML structure: ```html 通过保持这些连接,模型可以根据提供的上下文有效地推断出新的见解,无论是单词、句子、段落还是更多内容。凭借这种能力,大语言模型的训练为自然语言处理和生成任务打开了新的机会,使得机器能够更好地理解和回应人类的交流。 ``` This HTML structure keeps the text and its translation separate, which is useful for different language versions on a website, for example.

Sure, here is the translated text in simplified Chinese, maintaining the HTML structure: ```html

用于训练基础模型的变压器架构如下所示:

```

Sure, here's the translation of the text into simplified Chinese, maintaining HTML structure: ```html 这是一个基于神经网络的模型训练,结合了一些旧和新的技术:标记化、嵌入、位置编码、前馈、归一化、softmax、线性变换,最重要的是多头注意力。 ``` In this translation: - "neural-network-based model training" is translated as "基于神经网络的模型训练". - Various techniques like "tokenization, embedding, position encoding, feed-forward, normalization, softmax, linear transformation" are listed accordingly. - "multi-head attention" is translated as "多头注意力". This maintains the original structure while translating the content into simplified Chinese.

To translate the provided English text into simplified Chinese while keeping the HTML structure, you can use the following: ```html

这部分是你和我都非常感兴趣的部分。我们希望清楚地理解架构背后的思想以及训练的具体过程。因此,从下一篇文章开始,我们将深入研究用于训练基础模型的论文、代码和数学内容。

``` In this HTML snippet: - `

` and `

` denote the beginning and end of a paragraph, respectively. - The Chinese text is enclosed within the paragraph tags, ensuring it maintains proper structure in an HTML document. Make sure to integrate this snippet appropriately into your HTML document where you need this translated text to appear.

To translate "Fine-tuning: Train the Assistant" into simplified Chinese while keeping the HTML structure, you can use the following: ```html Fine-tuning: Train the Assistant ``` This HTML structure ensures that the text "Fine-tuning: Train the Assistant" is displayed in simplified Chinese, and the `lang="zh-CN"` attribute specifies the language as simplified Chinese for correct rendering and accessibility.

Sure, here is the translated text in simplified Chinese while maintaining HTML structure: ```html

微调是一种非常聪明的实现方式。我猜它是由OpenAI首先完成的。这个想法非常简单,但运作起来非常智能:雇佣人类标注者创建大量的问答对话对(比如10万个对话)。然后将这些对话对输入模型,让模型从中学习。

```

Sure, here's the translation of the provided text into simplified Chinese, while maintaining the HTML structure: ```html 这个过程被称为微调。你知道这个模型在经过10万个样本对话的训练后会发生什么吗?模型会开始像人一样作出回应! ``` This HTML code retains the structure but encloses the translated text in the appropriate tags as needed.

Sure, here is the text translated into simplified Chinese while keeping the HTML structure: ```html 让我们来看看这些带标签的示例对话: ```

Human labeled Q&A

Q: What is your name?
A: My name is John.
Human labeled Q&A

Q: What's the capital of China?
A: China's capital is Beijing.
Human labeled Q&A

Q: Summarize the plot of the movie Titanic.
A: The movie Titanic is about a ship that sinks in the ocean.

Sure, here is the translated text in simplified Chinese, while maintaining HTML structure: ```html

哇,这些示例问答在嘲笑我们彼此交流的方式。

```

Sure, here is the simplified Chinese translation of the text while keeping the HTML structure intact: ```html 通过教授模型这些响应样式,相关上下文响应的概率会变得很高,并成为对用户提示的响应。通过训练模型使用各种会话样式,我们增加了其提供相关和上下文适当响应的可能性。 ``` This HTML structure ensures the content remains correctly formatted for integration into a webpage or document.

这就是语言模型能够显得如此智能和类人的方式:通过学习模仿真实对话的节奏和模式,它们可以逼真地模拟与用户的来回对话。

Sure, here's the text translated into simplified Chinese while maintaining the HTML structure: ```html 在这一步,我们可以说我们获得了一个助手模型。 ```

Sure, here's how you could structure the HTML while including the Chinese translation: ```html

Below is a diagram of showing some highlights from pre-training the Base Model to the Fine-tuning the Assistant Model:

下面是一个图表,展示了从基础模型预训练到助理模型微调的一些重点:

``` In this HTML snippet: - `

` tags are used to wrap each paragraph of text for proper structure and styling. - The English text is followed by its corresponding simplified Chinese translation, separated into distinct `

` elements to maintain clarity and organization in the HTML document.

(from Andrej Karpathy’s build a GPT model from scratch))

RLHF: 从人类反馈中进行强化学习

To translate the given English text into simplified Chinese while maintaining HTML structure, you can use the following: ```html

2022年1月,OpenAI发布了关于使语言模型能够遵循指令的工作。在他们的博客文章中,他们描述了如何进一步通过人类反馈来优化这个模型:

``` This HTML snippet will display the translated Chinese text within a paragraph (`

`) tag, ensuring it maintains the structure suitable for web content.

```html

这个有点复杂。想法是让模型从人类反馈中学习。不是提供大约100,000个标记的问答对,而是收集用户的提示和模型的回应,然后让人类对它们进行排名。将排名过的对话作为最理想的问答样本,再次输入模型让其从中学习,以提高整体性能。

```

在其博客上,OpenAI介绍了这个过程。

Sure, here's how you could structure the HTML while translating the text into simplified Chinese: ```html

为了使我们的模型更安全、更有帮助和更加符合需求,我们使用一种称为人类反馈强化学习(RLHF)的现有技术。在客户提交给 API 的提示中,我们的标注员展示所期望的模型行为,并对我们模型的几个输出进行排名。然后,我们利用这些数据来对 GPT-3 进行微调。

``` In the above HTML snippet: - `

` tags are used for paragraphs, enclosing the translated text. - The text has been translated to simplified Chinese while maintaining the structure of the original English text.

这里是基础模型与微调/RLHF 响应的比较:

Sure, here is the translation in simplified Chinese, keeping the HTML structure: ```html

你可以看到,没有微调和RLHF,这个模型只是一个文档补全器。

```

Sure, the simplified Chinese translation of "Prompt Engineering" while keeping the HTML structure intact would be: ```html

即时工程

```

Sure, here is the translation in simplified Chinese, keeping the HTML structure: ```html 即使经过了微调和RLHF,模型仍然需要一些帮助来获得期望的响应。这就是提示工程发挥作用的地方。 ``` This HTML structure ensures the Chinese text is correctly displayed and formatted if used in an HTML document.

Sure, here's the HTML structure with the translated text in simplified Chinese: ```html

简单来说,我们可以精心设计提示,从模型中获得期望的响应(有时甚至无需进行精细调整)。

``` In this HTML snippet, the translated text "简单来说,我们可以精心设计提示,从模型中获得期望的响应(有时甚至无需进行精细调整)。" corresponds to "In simple words, we can carefully design the prompt to get the desired response from the model (sometimes even without fine-tuning)."

Sure, here is the translated text in simplified Chinese while maintaining the HTML structure: ```html

如果你不打算深入研究数学和代码,那么提示工程就是更好的关注方式,因为它可以通过输入更好的提示简单地发挥LLM模型的最佳性能。

```

现在让我们来看一个例子:

Certainly! Here's the HTML structure with the translated text in simplified Chinese: ```html

提示:

``` The translated text "prompt" in simplified Chinese is "提示".
The sky is

Sure, here is the translation in simplified Chinese while keeping the HTML structure: ```html

输出:

``` This HTML snippet includes a paragraph `

` tag with the text "输出:" which translates to "output:" in English.

blue.

To translate "Let’s try to improve it a bit:" into simplified Chinese while keeping HTML structure, you can use the following: ```html 让我们试着稍微改进一下: ``` This HTML code ensures that the translated Chinese text is properly marked with the language attribute (`lang="zh-CN"`) for clarity and accessibility purposes.

Certainly! Here's the prompt translated into simplified Chinese while maintaining HTML structure: ```html

提示:

```
Complete the sentence:
The sky is

To provide an accurate translation, I'll need to see the English text you'd like to have translated into simplified Chinese. Could you provide the text you'd like me to translate?

blue during the day and dark at night.

在提示中包含一些指示,模型就会知道该做什么和如何回应。

Sure, here is the translated text in simplified Chinese while keeping the HTML structure: ```html 让我们看另一个有趣的例子: ```

Sure, here's the translated text in simplified Chinese, keeping the HTML structure: ```html

提示:

```
When I was 6 my sister was half my age. Now
I’m 70 how old is my sister?

To translate "output:" into simplified Chinese while keeping the HTML structure, you would write: ```html 输出: ``` This maintains the structure of the HTML and provides the translation of "output:" into Chinese.

35

Sure, here is the simplified Chinese translation of the text while keeping the HTML structure intact: ```html

答案是错误的。正确答案应该是67。看起来模型理解了问题,但是参考的是数学计算而不是逻辑推断。

```

Sure, here is the HTML structure with the translated text in simplified Chinese: ```html

没有微调和RLHF,我们只需向提示添加更多示例指令就可以得到正确答案:

``` In this structure: - `

` represents a paragraph tag in HTML. - The Chinese text inside `

` is the translated version of "Without fine-tuning and RLHF, we can get the correct answer solely by adding more example instructions to the prompt:".

To translate "prompt:" into simplified Chinese while keeping the HTML structure intact, you can use the following: ```html

提示:

``` This HTML code will display "提示:" in simplified Chinese, with the colon included, as requested.
Q: There are 15 trees in the grove. Grove workers will plant trees in the grove today. After they are done,
there will be 21 trees. How many trees did the grove workers plant today?
A: We start with 15 trees. Later we have 21 trees. The difference must be the number of trees they planted.
So, they must have planted 21 - 15 = 6 trees. The answer is 6.
Q: If there are 3 cars in the parking lot and 2 more cars arrive, how many cars are in the parking lot?
A: There are 3 cars in the parking lot already. 2 more arrive. Now there are 3 + 2 = 5 cars. The answer is 5.
Q: Leah had 32 chocolates and her sister had 42. If they ate 35, how many pieces do they have left in total?
A: Leah had 32 chocolates and Leah’s sister had 42. That means there were originally 32 + 42 = 74
chocolates. 35 have been eaten. So in total they still have 74 - 35 = 39 chocolates. The answer is 39.
Q: Jason had 20 lollipops. He gave Denny some lollipops. Now Jason has 12 lollipops. How many lollipops
did Jason give to Denny?
A: Jason had 20 lollipops. Since he only has 12 now, he must have given the rest to Denny. The number of
lollipops he has given to Denny must have been 20 - 12 = 8 lollipops. The answer is 8.
Q: Shawn has five toys. For Christmas, he got two toys each from his mom and dad. How many toys does
he have now?
A: He has 5 toys. He got 2 from mom, so after that he has 5 + 2 = 7 toys. Then he got 2 more from dad, so
in total he has 7 + 2 = 9 toys. The answer is 9.
Q: There were nine computers in the server room. Five more computers were installed each day, from
monday to thursday. How many computers are now in the server room?
A: There are 4 days from monday to thursday. 5 computers were added each day. That means in total 4 * 5 =
20 computers were added. There were 9 computers in the beginning, so now there are 9 + 20 = 29 computers.
The answer is 29.
Q: Michael had 58 golf balls. On tuesday, he lost 23 golf balls. On wednesday, he lost 2 more. How many
golf balls did he have at the end of wednesday?
A: Michael initially had 58 balls. He lost 23 on Tuesday, so after that he has 58 - 23 = 35 balls. On
Wednesday he lost 2 more so now he has 35 - 2 = 33 balls. The answer is 33.
Q: Olivia has $23. She bought five bagels for $3 each. How much money does she have left?
A: She bought 5 bagels for $3 each. This means she spent $15. She has $8 left.
Q: When I was 6 my sister was half my age. Now I’m 70 how old is my sister?
A:

To translate "output:" into simplified Chinese and keep the HTML structure intact, you can use the following: ```html 输出: ``` This will display "输出:" in the browser, where "输出" means "output" in Chinese.

When I was 6 my sister was half my age, so she was 3. Now I am 70, so she is 70 - 3 = 67. The answer is 67.

Sure, here is the translation in simplified Chinese, keeping the HTML structure intact: ```html 输出 2: ``` In simplified Chinese: ```html 输出 2: ```

When the narrator was 6, his sister was half his age, which is 3. Now that the narrator is 70, his sister would be 70 - 3 = 67 years old. The answer is 67.

Here is the translated text in simplified Chinese while keeping the HTML structure: ```html

两个答案都是正确的!我们只是在提示中添加了一些例子作为逻辑解释,然后再次问同样的问题。现在模型可以理解问题并正确回答。

```

Sure, here is the simplified Chinese translation of the given English text, while keeping the HTML structure intact: ```html

上述示例由王等人(2022年)介绍,计算最终答案涉及几个步骤。

``` This HTML snippet translates to: "The above example was introduced by Wang et al. (2022) that computing for the final answer involves a few steps."

Certainly! Here's the HTML structure with the translated text in simplified Chinese: ```html

强大的提示可以用来引导模型执行复杂任务,例如解决数学问题或总结文本。因此,提示工程在LLM生态系统中也扮演着非常重要的角色。

``` In this HTML snippet, the translated text "强大的提示可以用来引导模型执行复杂任务,例如解决数学问题或总结文本。因此,提示工程在LLM生态系统中也扮演着非常重要的角色。" is wrapped in a paragraph (`

`) with the phrase "强大的提示" (strong prompts) emphasized using `` tags.

To translate "For more about prompt engineering, here is a good prompting guide tutorial." into simplified Chinese while keeping the HTML structure intact, you would use the following: ```html 关于提示工程的更多信息,请参阅良好的提示指南教程。 ``` This HTML snippet maintains the structure and specifies that the enclosed text is in simplified Chinese (`...`).

Sure, here's the translation of "Summary" in simplified Chinese, keeping the HTML structure: ```html 总结 ```

To translate the English text "You have been reading down here, I’m sure it took a while to digest all the information, especially for those who are new to the LLM world" into simplified Chinese while keeping the HTML structure, you can use the following: ```html 你已经读到这里了,我相信消化所有信息肯定花了一些时间,尤其是对于那些对LLM世界还很新的人来说。 ``` In HTML format, it would look like: ```html 你已经读到这里了,我相信消化所有信息肯定花了一些时间,尤其是对于那些对LLM世界还很新的人来说。 ``` This ensures the text is correctly interpreted and displayed as simplified Chinese, maintaining the integrity of any surrounding HTML structure.

Sure, here's the HTML structure for the translated text in simplified Chinese: ```html

现在我相信我们在基本概念和背景信息方面已经涵盖了足够的内容。是时候开始准备建造我们自己的大型语言模型了。理论已经够了,让我们继续前进,探讨下一篇文章中 Transformers 架构的关键组成部分。

``` This HTML structure maintains the content while applying the necessary translation into simplified Chinese.

2024-06-21 05:10:31 AI中文站翻译自原文