This parameter sets the maximum number of tokens to generate in the response from ChatGPT.
ChatGPT's answer is limited to a maximum of 30 tokens, e.g. “To bake a cake, you need flour, sugar, eggs, butter and baking powder. Mix the ingredients and…”
Finally use ChatGPT parameters correctly (instructions) 2
temperature
Temperature affects the “creativity” of the AI. answers, while russia number dataset a lower value produces more conservative and accurate answers.
ChatGPT's answer is very conservative and not very creative: "To bake a cake, you need flour, sugar, eggs, butter and baking powder. Mix the ingredients and bake the dough."
ChatGPT gets extremely creative, but possibly incoherent or imprecise: "To bake an intergalactic cake, you must combine moon dust, star sparks, eggs from cosmic birds, butter from a parallel universe, and the secret of the universe. Let the ingredients merge in a black hole and..."
Top-k sampling
Top-k sampling is a method to diversify AI responses. ChatGPT selects its responses from the k most likely tokens. A higher value results in more diverse responses, while a lower value limits the selection.
ChatGPT will choose from the 20 most likely tokens, resulting in a slightly more diverse answer: “To make a delicious cake, take flour, sugar, eggs, butter and a smile. Mix everything well and…”
ChatGPT gets a little more creative with the answer: “To bake a delicious cake, you need to combine flour, sugar, eggs, butter and a little magic. Mix everything well and…”
ChatGPT always chooses the most likely token, which leads to very predictable and not very diverse answers: “To bake a cake, you need flour, sugar, eggs, butter and baking powder. Mix the ingredients and bake the dough.”