Our Platform:
The SamaHub
Technology
Samasource uses a proprietary web application, the SamaHub, to securely distribute microwork tasks to our global delivery centers. The SamaHub manages the collection, review, and delivery of judgments, and monitors associated performance and quality metrics. The platform is built on Rails 3 and deployed to the cloud with a PostgreSQL backend and Redis for task management.
Click on areas of the architecture diagram to learn about each feature.
Known Agents
We are a closed, “private crowd” system that selects and trains agents for specific tasks on the basis of their performance on a variety of qualification tests. Our San Francisco-based team oversees local supervisors and agents, trained directly by Samasource staff, to ensure clear communication with no hassle for our clients.
Real Time Human QA
The SamaHub supports manual review of worker judgments. Team leads on-site are able to review a subset of completed work. Using automatic statistical analysis of correct judgments, we’re able to quickly provide a confidence interval of the true accuracy, even for a very large number of tasks.
Plurality
We can indicate how many workers we want to complete each task, and the number of identical judgements required to identify the task as accurate.
Gold Tasks
We can add known answers, or gold tasks, into project workflows. By comparing known answers to submitted work we can statistically evaluate a workers’ accuracy over time.
Worker Qualification
Our known workforce is qualified for projects by historical evaluation of similar skills and by passing training tasks crafted for your project.
Flexible Task Design
The SamaHub provides a project setup interface that allows our team to design tasks for a wide variety of projects, while displaying them in a uniform manner for our workers.
Reporting
We track each judgment at the worker level for accuracy, quality and speed in real time so local managers and Samasource staff can monitor throughput. This approach combines the benefits of local management within a controlled delivery environment and the worker-level analytics and transparency of crowdsourcing.
Simple API
The Samahub can integrate seamlessly with client systems through a private RESTful JSON API.