> ## Documentation Index
> Fetch the complete documentation index at: https://docs.literalai.com/llms.txt
> Use this file to discover all available pages before exploring further.

# Annotation Queues

> Annotation Queues help you organise and streamline the human evaluation process. You can easily set-up queues, add data for review and provide an accessible and efficient ui for domain experts to score, tag and add to datasets crucial insights.

## Create an annotation queue

You can access your queues on the `Annotation Queues` page, and create one by clicking the `+` button in the top right corner of the table.

<Frame caption="Annotation Queues Page">
  <img src="https://mintcdn.com/chainlit-5/SattO4WPsa_7pLDy/images/create-queue.gif?s=c5133afc0b4d2963f27528ead37824be" alt="Create annotation queue" width="1752" height="1080" data-path="images/create-queue.gif" />
</Frame>

This will open a modal form, that you can fill with a **name** to identify the annotation queue and a **description** to convey the queue meaning.

<Note>Each new project comes with a "Default" annotation queue.</Note>

## Populate a queue from logs

Once you have created a queue, you can start adding data to it. You can add runs/generations at once from the logs page.

<Frame caption="Add Multiple Items to the Annotation Queue">
  <video autoPlay muted loop playsInline src="https://mintcdn.com/chainlit-5/SattO4WPsa_7pLDy/images/add-multiple-to-queue.mp4?fit=max&auto=format&n=SattO4WPsa_7pLDy&q=85&s=c74a4621a9b511d65a567d47f16f305f" data-path="images/add-multiple-to-queue.mp4" />
</Frame>

You can also add a single item to the queue from a thread/run/generation detail page.

<Frame caption="Add a Single Item to the Annotation Queue">
  <video autoPlay muted loop playsInline src="https://mintcdn.com/chainlit-5/SattO4WPsa_7pLDy/images/add-one-to-queue.mp4?fit=max&auto=format&n=SattO4WPsa_7pLDy&q=85&s=41375cfd35c3d824d8ce11705281d7ab" data-path="images/add-one-to-queue.mp4" />
</Frame>

## Efficiently review queue items

On the `Annotation Queues` page, a reviewer can open a specific queue and start reviewing added items.

<Frame caption="Annotation Queue Item Page">
  <img src="https://mintcdn.com/chainlit-5/SattO4WPsa_7pLDy/images/annotation-queue.png?fit=max&auto=format&n=SattO4WPsa_7pLDy&q=85&s=71b16891355ca6b612c96438987b734b" alt="The annotation item page" width="2582" height="1584" data-path="images/annotation-queue.png" />
</Frame>

A reviewer can:

* **Score** the item
* **Tag** the item
* **Add to Dataset** the item

Finally, once the review is done, they can mark the item as Reviewed.

## Check progress

Admins can monitor the progress of the queues on the `Annotation Queues` page by clicking on the `Admin View` button.

<Frame caption="Annotation Queue Items List Page">
  <video autoPlay muted loop playsInline src="https://mintcdn.com/chainlit-5/SattO4WPsa_7pLDy/images/annotation-queue-admin-view.mp4?fit=max&auto=format&n=SattO4WPsa_7pLDy&q=85&s=c2bf1a404e319eaca0822fc97a180b43" data-path="images/annotation-queue-admin-view.mp4" />
</Frame>

In this view, the Admin can switch between the `Pending` and `Reviewed` tabs to see how many items are left to review and how many have been reviewed.
