Work processes in annotation

work processes in annotation

RequestCreate your annotation requests in the Airtable form:

Annotation The team leaders notify you the start of proces in the channel "soavalue_annotation" on Salck and we ask questions during the annotation.

NotificationThe team leaders notify the end of the project in the Slack channel "soavalue_annotation"

Explanation Explain your annotation instructions on the field "Requirements".

AuditVerification of Audit results, if necessary relaunch a 2nd Audit(Machine dataset review).

VerificationDataset manager checks the annotation quality of ongoing projects every day.

OrganizationWe receive your request in real time, then discute with 2 leaders Malagasy to distribute the projects to the specialized annotators.

Global verificationDataset manager still checks datasets manually after Audit, if errors the annotators restart a check

Discussion/ UnderstandingDiscuss on difficult images between dataset manager and team leader to see if the instructions have been respected.

UnderstandingDataset manager and team leaders take time to understand the instructions by asking questions in the various with you.

DiscussionDataset manager discusses with you on problematic images

Monitoring-reportingVarious calculations for ongoing projects until the end of processing. Follow here

TestIf the datasets are complicated or new, we annotate a small sample.

Lorem Ipsum

FeedbackDataset manager notifies you the end of processing, asking for feedback on annotation's quality(score 1-10). Dataset manager also gives a feedback.

ValidationYou verify and validate this annotation