> ## Documentation Index
> Fetch the complete documentation index at: https://docs.literalai.com/llms.txt
> Use this file to discover all available pages before exploring further.

# Annotation Queues

> Annotation Queues help you organise and streamline the human evaluation process. You can easily set-up queues, add data for review and provide an accessible and efficient ui for domain experts to score, tag and add to datasets crucial insights.

## Create an annotation queue

You can access your queues on the `Annotation Queues` page, and create one by clicking the `+` button in the top right corner of the table.

![Create annotation queue](https://mintcdn.com/chainlit-5/SattO4WPsa_7pLDy/images/create-queue.gif?s=c5133afc0b4d2963f27528ead37824be)

Annotation Queues Page

This will open a modal form, that you can fill with a **name** to identify the annotation queue and a **description** to convey the queue meaning.

> [!NOTE]
>
> Each new project comes with a "Default" annotation queue.

## Populate a queue from logs

Once you have created a queue, you can start adding data to it. You can add runs/generations at once from the logs page.

<video autoPlay muted loop playsInline src="https://mintcdn.com/chainlit-5/SattO4WPsa_7pLDy/images/add-multiple-to-queue.mp4?fit=max&auto=format&n=SattO4WPsa_7pLDy&q=85&s=c74a4621a9b511d65a567d47f16f305f" />

Add Multiple Items to the Annotation Queue

You can also add a single item to the queue from a thread/run/generation detail page.

<video autoPlay muted loop playsInline src="https://mintcdn.com/chainlit-5/SattO4WPsa_7pLDy/images/add-one-to-queue.mp4?fit=max&auto=format&n=SattO4WPsa_7pLDy&q=85&s=41375cfd35c3d824d8ce11705281d7ab" />

Add a Single Item to the Annotation Queue

## Efficiently review queue items

On the `Annotation Queues` page, a reviewer can open a specific queue and start reviewing added items.

![The annotation item page](https://mintcdn.com/chainlit-5/SattO4WPsa_7pLDy/images/annotation-queue.png?fit=max\&auto=format\&n=SattO4WPsa_7pLDy\&q=85\&s=71b16891355ca6b612c96438987b734b)

Annotation Queue Item Page

A reviewer can:

* **Score** the item
* **Tag** the item
* **Add to Dataset** the item

Finally, once the review is done, they can mark the item as Reviewed.

## Check progress

Admins can monitor the progress of the queues on the `Annotation Queues` page by clicking on the `Admin View` button.

<video autoPlay muted loop playsInline src="https://mintcdn.com/chainlit-5/SattO4WPsa_7pLDy/images/annotation-queue-admin-view.mp4?fit=max&auto=format&n=SattO4WPsa_7pLDy&q=85&s=c2bf1a404e319eaca0822fc97a180b43" />

Annotation Queue Items List Page

In this view, the Admin can switch between the `Pending` and `Reviewed` tabs to see how many items are left to review and how many have been reviewed.


This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.