1.0.504
and above.0.0.509
and above.0.0.503
and above.{"type":"function", "function": ...}
anymoremetadata.variables
Score
value in Logs > Runs tableStep
to a Dataset
Score
label in Rule logsThread
details, LLM steps rely on given passed name if:
Toxicity
, Factuality
and Sentiment
to out-of-the-box Scorer
’sPrompt
in the PlaygroundExperiment
details now show Output/Expected Output diffCannot query field "label" on type "PromptVersion".
Scorers
page to manage ways to score on Online Evals and ExperimentsOnline Evals
page to manage automatic monitoringDataset
itemsDatasets
table, we now have links to experiments on each datasetScore
Schemas: categories, descriptions, etc.Experiment
Thread
tree view: allow expand/collapse nested steps on tree nodesPrompt
version tags editsExperiment
item detailsPrompt
example to rely on json_schema
with oneOf
descriptionsScore
label instead of value on experiment scoresDataset
Thread
to 100Tag
management actions: add, filter and delete.Thread
details display children Step
’s incrementally — improves page load times for long threads.Run
/ Generation
to a Dataset
: layout, JSON/YAML editing and format validation.Last engaged at
information.Thread
table filter on Step
name: filter speed improved by a 15x factor.BUCKET_NAME
environment variable is no longer mandatory. Trying to store objects will log errors but not disrupt the rest of the operationsUsers
and individual Thread
pagesuserId
expectedOutput
to output
. In a Dataset, in the field Indermediary Steps
, the field expectedOutput
is renamed to just output
, because this is the actual output of the LLM. This breaks backward compatibility for users relying on DatasetItem.intermediarySteps.expectedOutput
, DatasetItem.expectedOutput
remains unchanged.intermediarySteps
when adding a step with children stepsThread
or Dataset
page there, the location is now shown as breadcrumb. This prevents getting lost in sheets and improves navigation.Settings
menu in the UI into sub-menus for General
, LLM
and Team
.Created by
column on Prompt Version table, which improves the table display.comparison
mode, parameters are made more explicit. In addition, the charts inversed, which is now fixed.is null
and not in
filters on tags edge cases are added. This fixes the tags filters in the table, as they were not working as intended before.Tags
are now visible in the UI when a Thread
, Step
or Generation
page is refreshed. Tags are now refetched on page refresh.Tags
can now be added on generations being created.