You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Currently the LLM evaluator prompts for a given metric are not exposed by the class that calculates the metric. Make it so that these prompts are explicitly accessible from the metric class.
This change will improve the tonic_validate integration in llama_index, as the evaluators in llama_index have methods that return these prompts. Once this change is made, a subsequent PR to llama_index should be made to add this functionality into the tonic_validate integration there.
Currently the LLM evaluator prompts for a given metric are not exposed by the class that calculates the metric. Make it so that these prompts are explicitly accessible from the metric class.
This change will improve the
tonic_validate
integration inllama_index
, as the evaluators inllama_index
have methods that return these prompts. Once this change is made, a subsequent PR tollama_index
should be made to add this functionality into thetonic_validate
integration there.Reference: run-llama/llama_index#10000 (comment)
The text was updated successfully, but these errors were encountered: