Annotation projects bring together all the resources required to label data for a machine learning project. This page will explain how to create and manage a project. Before you read this guide, make sure that you have invited all the users you need to your workspace, that you have imported into SAVANT the videos that you want to annotate and that you have created an annotation profile for your project.
Project creation
To create a new annotations project, navigate to the “Projects” tab in the left-hand navigation and click on “Add Project” and give the project a unique name. You should now see your project in the list.
When you click into the project, you will see the main project management screen. When you create a new project, it will be empty. You will learn how to create annotation jobs for this project in a later guide. After you have created annotation jobs, the view should be as the one depicted below, where you should be able to access:
Batch filters to decide which batches to show in the list.
Number of batches completed. Clicking into this button will show only the completed batches.
Number of batches with date not set. Clicking into this button will show only the batches for which a due date hasn’t been set.
View processing batches Clicking into this button will take you to the interface to view the manage the frame batch creation process (see guide on frame batch creation).
Project settings. Opens a screen where you can manage several aspects of the project. View the section below to learn more.
Configurations. Opens a screen you to manage your frame batch creation configurations. See guide on frame batch creation to learn more.
Create batches. Starts the annotation job creation process (see guides on video and frame batch creation).
List of batches in the project. Where you can consult completion statistics about the batches of annotation jobs.
§
Project settings
The project settings page is where you will find all the functionality needed to do general management of the project. There are currently two pages that you can consult.
General settings
Here you can change the name and description of the project. You can also add a profile which will be the default one applied to all the batches created in this project; you can still change the profile used in each batch. Finally, in this page you will also find a button to archive this project; to learn more about archiving, read our guide on archiving resources.
Member settings
In this page you can control who and to what level users have access to this project. Within the members settings page you will see the following functionality:
Give access to users to this project with the Add Members button. To give someone access you will need to select which role they will have in the project (see our role-based access guide) and which actions they can perform in the project (see “Status Access” below).
If you have configured teams in your workspace (see the guide on managing users and teams) you can add members to the project in bulk by using the Add Team functionality.
In the table showing all the members you will see who has access to this project and some important details about their level of access:
The user’s name as set up in the SAVANT app
The project role that has been assigned to them.
If they were assigned to the project as part of a team and which organisation in the workspace this team belongs to.
The status access that they have in the project. This access defines which actions a user can perform within the annotation jobs of a project.
An edit button which you can use to change a user’s role, which statuses they have access to or to remove the user from the project.
Annotation jobs management
Once you have created video or frame annotation job batches, they will appear in the main project screen. If you click on any of them, you will be taken to the batch’s management page. In this page you will find the following functionality:
Filters to select which annotation jobs from the batch you want to observe in the list.
Summary of the status of all the jobs in the batch.
Batch settings button, where you can manage general and access settings for this batch – see below.
Download button, which will download a JSON file with all the annotation data contained in this batch. See our guide on how to download data using our API.
Button to group jobs by video ID. This functionality will work both in video and frame batches, but it’s only really useful for frame annotation batches to see all the jobs that relate to the same video (e.g. if you want to assign all of them to the same annotator).
Button to show/hide sequence level tags. This functionality will only appear if there are any sequence-level tags assigned in the batch.
A list of all annotation jobs in this batch. In each of them you can see:
A count of AutoQA errors and warnings in the annotation job. This will appear only if there are any in this batch.
The current status of this sequence.
Signifiers for who is assigned to each status in the annotation job and functionality to change the person assigned. Note that “To fix” and “To review” can only be assigned after a sequence has been QA’d.
Number of frames to be annotated in the sequence/annotation job. This will be zero for video annotation jobs.
Actions button where you can:
Add more videos to the batch. Only available for video annotation batches.
Download the annotation guidelines for the batch.
If annotation jobs have been selected:
Assign a status of the selected sequence(s) to a given user.
Remove assignments from the sequences.
Move the sequences between different statuses. Note that this functionality should be used sparingly and, instead, we recommend that you move sequences only via the annotation interface (see guides on video and frame annotation interfaces).
Archive sequence to move the sequences to the project archive. See our guide on archiving resources.
Annotation batch settings
When you click on the batch settings you will be taken to a page with two tabs.
General batch settings
Where you can change the batch description, assign a due date for the batch and a due date for when fixes should be made, consult the profile that is used to annotate this batch, enable or disable the video preview (only applicable for frame batches) and archive this batch (see the guide on archiving resources).
Batch member settings
In the members tab you can see which members of the project have been assigned to the current batch. Only members assigned to the batch can perform annotation actions. This means that you will need to add people to annotate in each batch that you create. As with the project members, you can add users individually or by team; note that you can only add members of the project to the batches contained in it. Finally, you can remove users from the batch using the signifier to the right of each user; note that you can’t remove project admins and managers from batches.
What next
Once you have set up the project and all the required permissions, you should create batches of annotation jobs. The next guides will show you how to create batches of jobs for time and frame annotations.