The prompt to generate from
OptionalsystemSystem prompt (optional)
OptionalmaxMaximum tokens to generate
OptionaltemperatureTemperature for sampling (0.0 - 2.0)
OptionaltopTop-p sampling
OptionaltopTop-k sampling
OptionalrepeatRepetition penalty
OptionalstopStop sequences
Options for text generation