default image for post
Pilot Project Summary: Creating jobs using mobile phones in an African township
January 5, 2010  |  by Mark  |  Features, Homepage, Pilot Project  |  , , , ,
For two weeks, from November 20th to December 4th 2009, we conducted a pilot project in the Valley of a Thousand Hills in South Africa. We hope that this project will lead to a revolutionary new service that will create a new type of job for thousands of underprivileged people.

About Mobenzi

Mobenzi is a software service that empowers people to be rewarded for completing simple tasks on their mobile phones. These tasks involve certain types of problems that are difficult for a computer to solve without assistance from a real person – even someone without expert knowledge of the problem.

Find out more about how Mobenzi works

Purpose of the pilot project

For two weeks we equipped pilot participants with the Mobenzi software application installed on standard mobile phones to assess whether they could effectively complete simple business tasks using only their phones.

These were some of the guiding questions we were attempting to answer during the pilot.

  • Is the concept easy to understand?
  • Is the technology easy to use?
  • What types of tasks are feasible?
  • What types of people are most suitable for doing Mobenzi tasks?
  • What is the best way to present a given task to an agent?
  • How long does it take to complete different types of tasks?
  • What quality should be expected in the results of completed tasks?
  • What issues are involved that may affect attrition rates (fatigue, boredom etc)?
  • Could the service grow through viral expansion (Can participants teach each other)?
  • Based on other findings, what are the financial implications with regard to agent remuneration and the cost of the service to organisations?

Project location and venue

A view of The Valley of a Thousand Hillslight_providers_community_centreView from Light Providers

We ran the pilot project from the Light Providers community centre in KwaNyuswa. The area lies on the outskirts of urban development, west of the Inanda Dam, about 40 minutes outside of Durban in KwaZulu Natal, South Africa. It is one of the largest of the various tribal authorities that make up the Valley of a Thousand Hills.

Due to the gross unemployment rates in the region, and our close proximity to the area (Only 14km from our office), we selected KwaNyuswa as the location for our pilot project.

Format of the pilot

We started the first week of the pilot with 5 participants who would later act as mentors when 20 new recruits joined them for the second week. We spent the first week testing out various types of human intelligence tasks and discussing issues surrounding understanding the use of the mobile application as well as the various types of tasks themselves.

During the second week we had more participants to help work through large sets of tasks. We assigned participants various types of tasks and recorded completion times and responses for all participants so that we could crunch the data to assess what factors affect quality and efficiency.

We focused on text-based human intelligence tasks

We decided to focus on “Text to Form” tasks for the pilot project. These types of tasks involve extracting structured data from free-text.

Some examples of this type of task include:

A simple task to assist in sorting sms survey responses.
An example of a simple task to assist in sorting sms survey responses.

For all of these tasks, we displayed a short instruction for the task, followed by the content (such as an SMS or a tweet) and then a series of questions about the content (Such as whether the SMS included a person’s name). The participant worked through each task one step at a time.

Find out about other types of human intelligence tasks

Results of the first phase of our pilot project

One of the critical factors affecting the feasibility of Mobenzi is whether or not the mobile application is easy to use for people who have had little exposure to the internet and other software applications. A quote from the summary of the first day of the pilot shows how easily the participants understood both the concept of doing work on their phones as well as how to use the application itself:

Without any instruction, most of the participants had the application open and simply started completing tasks. Although I had high expectations, I still thought there would be many questions and a fairly slow start. But within half an hour of me arriving at the venue, the participants had their heads down and were completing tasks. A few questions popped up during the day, but none that the other participants couldn’t answer themselves.

Using the software to complete tasks came very naturally and required almost zero training. From the participant comments, it is also clear that there would be a huge demand for Mobenzi tasks. I believe we could easily find thousands of Mobenzi agents who already own compatible phones within just half an hour’s drive of our offices in Hillcrest, let alone the rest of South Africa and the world.

We have not yet done much analysis on the quality or efficiency of the completed tasks, but initial assessments are very positive. Over the next few weeks we will be crunching the data to help answer some more of the questions we outlined at the start of the pilot.

The results so far have exceeded our expectations and at this stage I would guess that our biggest challenge in moving forward will be to generate a sufficient supply of tasks to keep Mobenzi agents busy.

Scaling up the pilot in April 2010

This pilot was a short 2 week project to get an early feel for what to expect. In April next year we will scale our efforts up and take on a much larger group of participants to pilot the concept further. Until then we will be tweaking the software and preparing the systems to handle the logistics of a much larger project.

We are very open to suggestions if you have any ideas for types of tasks or even real world data that we could get Mobenzi agents to process during our pilot later this year.


14 Comments


  1. Congratulations on your initiative!

    It has a lot of promise and is very convergent with what we have been working on at Openworld.com.

    In support of the project, Openworld may be able to offer microstipends in the $US20-30 range for Mobenzi workers who create and upload short Youtube clips (ideally created with cameraphones) on their Mobenzi experience.

    Let us know if you may be interested in such a project, or others relating to the “Seeds of Change” initiative described http://j.mp/q9IZn .

    In addition, we would be interested in possibly working with Mobenzi on a small pilot in one of the two following areas:

    1. Engaging Mobenzi teleworkers to tag Tweets that include a request to act

    Although many Tweets are simply sharing opinions or personal updates, others include calls to action. Examples of actions requests include asking followers to donate to a good cause, to fill in an online survey, or to stop purchasing from companies that causing harm to local or global communities.

    A”RTa” or #R2A hashtag might be added to the Tweet in such cases. Such tags could help firms and nonprofit organizations quickly scan the feed from influential Twitterers, and spot emerging trends that can lead to actions.

    Another very useful service might be to help Twitter users organize their archived Tweets (see BackupmyTweets.com) into visual “mindmaps” (see Mindmeister.com).

    A client such as Openworld, in this case, could send Mobenzi a list of the preferred #hashtags that relate to the main topics in their web-based Mindmaps.

    Then, the Mobenzi teams would go through the archived Tweets and add these preferred hashtags to the (untagged) Tweets.

    Once the archived Tweets were updated with these hashtags, the archive could be exported into the web-based mindmap. The tagged archive would then auto-fill the Tweets into the corresponding topics in the Mindmap.

    This Tweet->Mindmap service would let organizations like ours quickly show potential followers the range and depth of topics we cover.

    Look forward to any thoughts on followup!

    Best,

    Mark Frazier
    Openworld.com
    @openworld @buildership (Twitter)

Trackbacks

  1. links for 2010-01-27 « Design in Africa