Skip to main content

Create an annotation queue

You can access your queues on the Annotation Queues page, and create one by clicking the + button in the top right corner of the table.
Create annotation queue
This will open a modal form, that you can fill with a name to identify the annotation queue and a description to convey the queue meaning.
Each new project comes with a “Default” annotation queue.

Populate a queue from logs

Once you have created a queue, you can start adding data to it. You can add runs/generations at once from the logs page.
You can also add a single item to the queue from a thread/run/generation detail page.

Efficiently review queue items

On the Annotation Queues page, a reviewer can open a specific queue and start reviewing added items.
The annotation item page
A reviewer can:
  • Score the item
  • Tag the item
  • Add to Dataset the item
Finally, once the review is done, they can mark the item as Reviewed.

Check progress

Admins can monitor the progress of the queues on the Annotation Queues page by clicking on the Admin View button.
In this view, the Admin can switch between the Pending and Reviewed tabs to see how many items are left to review and how many have been reviewed.