OptionsBuilder |
OptionsBuilder.setMirostat(int value) |
Enable Mirostat sampling for controlling perplexity.
|
OptionsBuilder |
OptionsBuilder.setMirostatEta(float value) |
Influences how quickly the algorithm responds to feedback from the generated text.
|
OptionsBuilder |
OptionsBuilder.setMirostatTau(float value) |
Controls the balance between coherence and diversity of the output.
|
OptionsBuilder |
OptionsBuilder.setNumCtx(int value) |
Sets the size of the context window used to generate the next token.
|
OptionsBuilder |
OptionsBuilder.setNumGpu(int value) |
The number of layers to send to the GPU(s).
|
OptionsBuilder |
OptionsBuilder.setNumGqa(int value) |
The number of GQA groups in the transformer layer.
|
OptionsBuilder |
OptionsBuilder.setNumPredict(int value) |
Maximum number of tokens to predict when generating text.
|
OptionsBuilder |
OptionsBuilder.setNumThread(int value) |
Sets the number of threads to use during computation.
|
OptionsBuilder |
OptionsBuilder.setRepeatLastN(int value) |
Sets how far back for the model to look back to prevent repetition.
|
OptionsBuilder |
OptionsBuilder.setRepeatPenalty(float value) |
Sets how strongly to penalize repetitions.
|
OptionsBuilder |
OptionsBuilder.setSeed(int value) |
Sets the random number seed to use for generation.
|
OptionsBuilder |
OptionsBuilder.setStop(String value) |
Sets the stop sequences to use.
|
OptionsBuilder |
OptionsBuilder.setTemperature(float value) |
The temperature of the model.
|
OptionsBuilder |
OptionsBuilder.setTfsZ(float value) |
Tail free sampling is used to reduce the impact of less probable tokens from the output.
|
OptionsBuilder |
OptionsBuilder.setTopK(int value) |
Reduces the probability of generating nonsense.
|
OptionsBuilder |
OptionsBuilder.setTopP(float value) |
Works together with top-k.
|