LogoLogo
RedBrick AIGuides
  • Quick Start
    • Walkthrough Guides
    • Get Started with a Project
    • Get Started with Workspace
      • Cohort Creation
      • Datapoint Classification
      • Configuring Metadata Schema
    • Creating a RedBrick AI Account
  • Organizations
    • Organization and Project Roles
    • Inviting Your Team
      • Single Sign-on
  • Dashboard
    • Account Settings
    • User Preferences
    • Worklist
    • Preview Tool
    • Integrations
    • Taxonomies
    • Boost
      • Auto Annotator
    • Home
      • Sections
  • Importing Data
    • Uploading Data to RedBrick
    • Import Cloud Data
      • Configuring AWS s3
      • Configuring Azure Blob
      • Configuring GCS
      • Configuring AltaDB
      • Creating an Items List
    • Troubleshooting
  • Projects
    • Tasks & Assignment
    • Comments & Raise Issue
    • Reference Standards
    • Project & Task Analytics
    • Labeler Evaluation
  • Project Pages
    • Data Page
    • Settings Page
      • Custom Label Validation
      • Custom Hanging Protocol
      • Webhooks
    • Multiple Labeling
      • Consensus
        • Agreement calculation
      • Task duplication
  • Annotation & viewer
    • Viewer Basics
      • Document Viewer
      • Multiple Modalities
      • Intellisync
      • Annotation Mirroring
    • Creating, Editing and Deleting Annotations
    • Visualization and Masking
    • Segmentation
      • Segmentation Tools
      • Instance vs. Semantic
      • Overlapping Segmentations
    • Heat maps
  • Python SDK & CLI
    • Full documentation
    • Installation & API Keys
    • SDK Overview
      • Importing Data & Annotations
      • Programmatic Label & Review
      • Assigning & Querying Tasks
      • Exporting Annotations
    • CLI Overview
      • Creating & Cloning Projects
      • Import Data & Annotations
      • Exporting Annotations
    • Importing Annotations Guide
    • Formats
      • Full Format Reference
      • Export Structure
  • Useful Links
    • Privacy Policy
Powered by GitBook
On this page
  • Creating a Project: Step by Step
  • Step 1: Specify a Unique Project Name
  • Step 2: Select the Taxonomy for your Project
  • Step 3: Define your Project Workflow
  • Pre-review and Pre-Label stage
  • Basic Project Setup
  • Adding Labelers to your Project
  • Uploading Data
  • Assigning Tasks

Was this helpful?

  1. Quick Start

Get Started with a Project

PreviousWalkthrough GuidesNextGet Started with Workspace

Last updated 8 months ago

Was this helpful?

Please see the following micro-tutorial for a visual walkthrough of how to create a Project in RedBrick AI.

Creating a Project: Step by Step

To create a new Project, press the Create Project button on the Projects page;

Step 1: Specify a Unique Project Name

Each Project has a unique name that can be changed at any time within Project Settings;

Step 2: Select the Taxonomy for your Project

Taxonomies are stored at the Organization level, which allows you to reuse a single labeling Taxonomy across Projects.

To preview the Taxonomy during project creation, simply click on Taxonomy in the top left corner of the center card.

Step 3: Define your Project Workflow

Project workflows allow you to explicitly define a series of annotation and review stages in your project.

You can also configure the number of review stages and the review percentage (i.e. randomly select a subset of data for pseudo-random review) in your workflow.

Once your data has successfully passed through all stages of your workflow, it will reach the Ground Truth Stage.

A common workflow included a single Label Stage followed by two Review Stages where different sets of reviewers validate the annotations performed.

When a reviewer rejects a Task in a Review Stage, it is sent back to the Label Stage and automatically assigned to the same Labeler who annotated it the first time.

The number of Review Stages cannot be modified after a workflow has been created. You can, however, disable a Review Stage by setting its Review Percentage to 0% in your Project Settings.

Pre-review and Pre-Label stage

Pre-review stage

The Pre-review stage enables you to examine tasks for quality control or other purposes before they proceed to the labeling stage.

To enable the pre-review stage for your project, follow these steps:

  • Begin by creating a new project.

  • Turn on the pre-review stage by clicking the toggle button.

  • Once activated, the pre-review stage will be added to the workflow.

  • After all the stages are added, click the "Create Project" button.

  • Navigate to the "Data" tab, and begin reviewing tasks. You can then either accept or reject them as needed.

Pre-Label stage

The pre-label stage enables you to label and classify tasks before they are moved to the labeling stage. This stage simplifies the process, especially for complex projects.

To enable the pre-label stage for your project, follow these steps:

  • Begin by creating a new project.

  • Turn on the pre-label stage by clicking the toggle button.

  • Once activated, the pre-label stage will be added to the workflow.

  • After all the stages are added, click the "Create Project" button.

  • Navigate to the "Data" tab, and begin labelling the tasks.

Basic Project Setup

Once you have successfully created a Project, you will most likely want to perform the following actions to add collaborators and data and modify Project settings.

Adding Labelers to your Project

By default, all Org Admins have comprehensive access to all Projects. As with any elevated role, we recommend taking care when designating fellow team members as Org Admins.

Generally speaking, it's advisable to add Labelers and Reviewers to your Organization as Org Members. This grants them access to your Organization on the RedBrick AI Web Application, but limits their access and permissions.

Org Admins have granular control over the Project-level access of all Org Members.

In order to add Labelers or Reviews to individual Projects, we recommend the following:

  1. On the Team Page, invite the Labeler/Reviewer as an Org Member (MEMBER).

  2. After the Labeler/Reviewer accepts their invitation and creates an account, navigate to the Project you'd like to add them to and open the Workforce Tab. From there, you can invite the Labeler/Reviewer to the Project as either a Project Admin or Project Member. Please note that if your Labeler/Reviewer is a Project Admin, they will have access to all Stages of a Project, as well as the Project Settings.

  3. If your Labeler/Reviewer is a Project Member, you can regulate their access to various Stages limited based on your workflow's needs or regulatory requirements.

For a more in-depth breakdown of the permissions and access privileges associated with each role, please consult the documentation below.

Uploading Data

If you'd like to upload annotation files alongside your images and/or volumes, you must use our CLI/SDK.

Assigning Tasks

Once you have uploaded data to your Project, RedBrick AI will begin automatically assigning Tasks to the users in your Project. You can learn more about the specifics of task assignment by referencing the documentation below.

Selecting a Taxonomy for a Project is a permanent choice that cannot be undone. However, you can after using it in a Project.

You can upload data to a Project either through the UI or CLI/SDK. Most teams tend to and host their own data, however, you can also .

Organization and Project Roles
integrate external storage
directly upload data to RedBrick AI servers
Importing Data & Annotations
Tasks & Assignment
edit your Taxonomy
Create project page
Previewing a Taxonomy during project creation