LLM Manager

The LLM Manager in NiCE CXone GenAI Prompts lets you view the language models available to your tenant.

Launch GenAI Prompts

  1. Click the app selector icon of app selector .

  2. Under General, select AI Studio.

  3. In the AI Studio left navigation, select GenAI Prompts.

View LLM Details in GenAI Prompts

  1. Click the settings gear icon in the GenAI Prompts header to open the LLM Manager. The LLM Manager opens to the Language Models window, scoped to your tenant.

  2. The following table describes the columns in the Language Models window. Use this reference when you review the language models available in the LLM Manager.

    Column Name

    Description
    Name The display name of the model and a label indicating its tier — Out of the Box, Premium, or Custom LLM.
    Model Type The model identifier string used to call the model, for example amazon.nova-lite-v1:0.
    Model Provider The company that hosts the model, for example Bedrock, Anthropic, or Mistral AI.
    Status The current availability of the model — Active, Default, Deprecated, or End of Life. NiCE CXone displays a countdown tooltip, for example, "Ends in 8 days," for models with Deprecated status.
    Configured Fallback The model NiCE CXone uses in place of this model if it becomes unavailable.
    Actions Opens a menu where you can edit the model, delete it, or set it as the default model for the tenant.