AI glossary

Temperature is a parameter in LLMs, such as GPT-4. Usually, the option is given to choose a value between 0 and 1, which determines the degree of randomness in the output. At a relatively low temperature, the model is likely to produce predictable, but coherent, text and give very similar answers if you repeat your question. At a higher temperature, the model tends to produce text that is less predictable and may contain more errors. At very high temperatures, an LLM often produces nonsense. For tools like ChatGPT, the temperature setting is usually set by default around 0.7: high enough to give unpredictable answers, but low enough not to generate nonsense.

A token is the basic unit of text processed by a large language model (LLM). Often it is a complete word, but it can also be a part of a word or a punctuation mark. LLMs produce text by repeatedly predicting which token should come next based on patterns they have learned from the training data. For example, it is very

The training data of an AI system are the data (e.g., text, images) used to train the system. In machine learning (ML), the system is usually trained on a large amount of data to recognize patterns and learn to produce desired responses. Conversations with users in tools like ChatGPT can be used as training data for future models.

The Turing Test, also known as the imitation game, was invented by computer scientist Alan Turing in 1950. It is designed to test whether a machine is capable of exhibiting seemingly human intelligence.