My Orchestrator is up and running. I can run the root endpoint and it returns,
{"message": "DSML LLM Orchestrator - REST API"}
I've reviewed the OrchestratorRequest Schema in the Swagger API documentation but it's still not clear which parameters are required and which are optional.
When the inputs are (String | null) is null an acceptable value. I'm doubtful of that for parameters like index_name.
Is retriever_type required? What are valid values? What is the appropriate value for a setup a milvus vector database with only spotfire docs loaded?
For llm_mode what is the best default, 'chat' or 'completions'?
Here is my current query (request body payload)
{
"request_tag": "MyOrchRequest",
"temperature": 0,
"index_name": "spotfiredocs",
"index_score_threshold": 0,
"index_topk": 5,
"llm_name": "gpt-3.5-turbo-1106",
"llm_mode": "completions",
"system_prompt": "Your are an AI assistant. Answer the question based on the context below. Keep the answer short and concise.",
"user_intent": "QueryIntent",
"history": null,
"client_data": null,
"prompt": "How to create a bar chart?"
}
It results in a error, KeyError: 'QueryIntent', see attached container log.
If I set user_intent to null, the error changes to KeyError: 'SpotfireHelp'.
Finally, if I try and use the Spotfire Copilot panel in Spotfire Analyst e.g. 'Ask Sample HowTo Question', I get the following single line error in the container log
POST / HTTP/1.1" 405 Method Not Allowed
Orchestrator Container Error QueryIntent.txt
Orchestrator Container Error SpotfireHelp.txt