My company, Trilogy Software, recently decided to crowdsource the development of icons and a splash screen for a new product we call Doxcycle. All the cool software startups are either using crowdsourcing as a key component of their offerings, or they are using crowdsourcing to reduce staffing levels and the cost of delivering their service. We felt that we needed to experiment with it, so we'd have a few more options when we have small, tactical projects that need to be completed quickly.
For our project, we used crowdSPRING.com. There are other sites that provide this service as well, with 99designs.com being the most commonly known.
Sign Up
At crowdSPRING, the sign up process is very simple. Creating an account requires a user name, an email address, a password and an indication of whether you are primarily a buyer or a designer. I did this in 30 seconds.

Budget
Before creating a project, I calculated what it would cost. Listing a project on the crowdSPRING site costs $129. The advance promotion plan makes your project a "featured" project and provides an invitation to top creatives for $99. And keeping your gallery of design entries private is another $49. My receipt also shows a project fee of $90, which is 15% of my “award” amount (more on that later). For my project I paid the listing fee of $129, the project fee of $90, the top promotion plan of $99, and the privacy charge of $49. My total was $367 before allowing for an "award", which is the fee the successful designer will get.
I spent time browsing other projects to get a sense of how other companies are using crowdSPRING. For about half of the projects, the creative brief and all the submissions can be viewed publicly. I found a similar project to ours, and used their brief for inspiration. They had a healthy number of submissions, so I copied their award amount of $600 as well.
Awards can be "guaranteed", which is basically a confirmation that at least one design will be selected, and at least one designer will get paid for their submission. I guaranteed my award, because I believe crowdSPRING’s promise that guaranteed projects will attract more designers, and because I think it's fair that designers should get paid.
In total, my project fees were $967. I may have been able to use a smaller award or cut some of the extra fees. However, I doubt you could get anything of quality done for much less than $500 in total. Maybe I'll try the cheaper version another time.
The Brief
Writing the brief is probably the most difficult part of the project (for me, anyways). Normally, we use a full service agency so I don't have to do this part. With the agency model, the guys from Watermark (www.wtrmrk.com) drop by our office. We chat, and Charles transcribes my rambling stream of consciousness into a comprehensive brief that effectively captures what I want.
Unfortunately, in the crowdsource model, I have to do this myself. Here's the brief that I wrote for our project.
What do you do?
We are a software company that designs tools for small to medium size accounting firms, and seasonal tax professionals
What is your industry?
Accounting and Tax Preparation
Describe the target audience for your icon design
Our target audience is small to medium accounting firms.
What 3 things would you like to communicate to your audience through your icon design?
1. We simplify the gathering, organizing and archiving of your source tax documents (W2 slips (in the US), T4 slips (in Canada), business expense receipts and so on)
2. We have a professional solution. (Our app looks like Microsoft Office 2010)
3. We’re hip and have a friendly, professional attitude.
How many different icons do you need designed?
1. An icon that will appear on a Windows Desktop (optimize for Windows 7)
2. A splash screen that will appear when DoxCycle starts up. The splash screen needs to include the word DoxCycle, and the resolution should be about 300x200. The splash screen does not need to be rectangular, and should have some transparency. The corporate green (see attached files) should be incorporated.
Do you have specific size requirements for the icons?
We need an icon that works in a few specific resolutions: 16x16, 24x24, 32x32, 64x64, 128x128 and 256x256
For the splash screen, only one resolution plus the adobe illustrator file is required.
What icon design styles do you like?
DropBox, Angry Birds
What colors do you want to see in your icon design?
See attached Trilogy_Logos.pdf for our corporate palette and font details.
(This file shows our logo)
The DoxCycle logo does not have to include the Trilogy logo colors, but we need to create a family feeling.
What colors do you NOT want to see in your icon design?
no murky or dirty colors
What adjectives should best describe your icon design?
Friendly, Professional
Do you have additional requirements or links you'd like to share?
Internally we've been experimenting with using a paper clip as the focal point of our icon. We like the simplicity of this image, but haven't been able to create clear and compelling icons at all the required sizes.
We're willing to have a simpler version of the icon that works at the 16x16 and 24x24 (for example, a stylized "D" for DoxCycle)
I spent about an hour writing the project brief. I wanted to make it as clear and concise as possible. Someone who writes briefs regularly could probably do it in much less time than it took me.
After I finished the brief I uploaded the details of our logo, including font choice and pantone colours. And, I uploaded a PowerPoint presentation from a recent sales call to provide some context of what our product does. crowdSPRING calls all the uploaded files "Supporting Materials".
Inviting Designers
The next step is to invite designers to participate in the project. I did this by browsing through the public projects on crowdSPRING. Leave your mouse cursor on any submission you like, and you'll get a popup menu, with one of the options being "invite to project". I did this five or six times before I noticed that I could just "invite all top Creatives ". This option shows on my "Details" screen, and is available because I choose to pay the extra $99 for the "advanced promotion" package. I haven't decided if the "advanced promotion" is worth $99 yet.
Crowdsourcing vs. Outsourcing
I have to admit that when I imagined crowdsourcing, I imagined graphic designers in turtlenecks working away on their MacBook Airs in local coffee shops. While that may be the case for some designers, the majority of crowdsourcing is really micro-outsourcing. Most of the designers on my project are working in Asian time zones. And typically, they seem to submit their work before or after they go to their day job.
We wanted rapid and frequent iteration of concepts, so I needed to take time to provide feedback just before I go to bed, and again first thing after I get up. Some submissions are done during my workday, but most seem to happen overnight or in the evening. This is not a problem for me, but it is something for which you may want to allow.
The other implication of outsourcing is that the brief needs to be clear and understandable by someone from another culture. Our product is used to organize Canadian tax source documents, and my brief made reference to T4, T5 and W2 slips. While these documents are familiar to most Canadians/Americans, I'm pretty sure that none of crowdSPRING designers had ever seen them, so I uploaded a few samples to the "Supporting Materials" folder.
Feedback
The first few submissions were discouraging. They all seemed to be different graphic treatments of our logo. I'm not sure if this is because my brief was unclear, or because the designers didn't read it fully. In any event, I added a few clarifying notes to the brief and the problem seemed to go away.
The crowdSPRING feedback system is fairly straight forward. Submissions are rated from 1 star (not close) through to five stars (love it!). There is also a "No Thanks" button which basically declines the submission. I used this button a couple of times when the designer clearly did not read the brief. Typically the designer then withdraws their submission and makes it unavailable for further review.
In addition to the rating system, there is a spot to provide private feedback for the designer. I used this system to provide some encouragement, and to micro manage the design process. I made requests like change the font, merge in a concept from another submission, move this element one pixel to the left, etc. Generally I don't like to make these kinds of requests of skilled designers, but in this case it seemed necessary.

Revising the brief
In addition to providing private feedback to the designers, you can also "revise your brief". You can't make any changes to the information you provided, but you can add to it. For instance, last night I added this not to my brief:
To help with voting, it would be great to see the splash screen on top of a cluttered Windows 7 desktop and the corresponding icon showing in the Windows 7 taskbar.
If anyone has questions about this request, let me know.
This was probably the most impressive part of the process. Within 30 minutes of updating my brief, two of my five designers provided updated submissions.
Project Stats
One of my favorite things about crowdSPRING is the project stats. crowdSPRING rates buyer participation on projects as "Low", "Average", "High" and "Amazing". This allegedly helps designers decide which projects to participate in. As a competitive guy, I took it upon myself to get the best possible rating. Fortunately, it's not that hard to do. Just rate every submission in a timely fashion, and provide a few lines of feedback. A summary of the Project stats is prominently displayed on the gallery page, which looks like this

crowdSPRING also provides details of the average number of submissions, average number of designers and average number of comments. My project scored highly on almost every metric except for number of designers. crowdSPRING claims the number of designers participating in an average project is 12. My project has only 5 designers participating.
The Focus Group
The final stage of the process is the "Voting" or the "focus group". crowdSPRING will guide you through selecting finalists, providing a message for voters, and final review. Once you've published your "Voting" page, crowdSPRING provides a quick way to share the link through both Facebook and Twitter.
Support
I sent notes to crowdSPRING support on two occasions. Both times my requests were resolved promptly and professionally.
Quirks
The crowdSPRING website has a few quirks that are annoying, but surmountable.
First, the submission images are too small. I’d like to see more detail. I assume this is to prevent me from using images without selecting and paying a designer.
Second, crowdSPRING wants me to rate my submissions as soon as I open my project. It brings the first unrated submission to the foreground and forces me to close the window to get an overview of the new submissions before I start to rate them. This could be improved.
Summary
Here's how crowdSPRING stacks up against an agency, in my view.
| | crowdSPRING | Agency |
| Cost |
$967 |
about $3000 |
| Brief |
Write it myself |
Agency does this |
| Vision |
All me |
Someone talented does this |
| Time |
8 to 10 hours + evenings |
2 to 3 hours |
| Iterations |
hourly |
daily |
| Submissions |
82 |
5 to 20 |
| Quality |
variable |
high |
Of course, your mileage may vary.
Conclusion
In addition to the $967 in project fees, I've spent an hour writing the brief, and another 7 hours reviewing submissions, providing comments and supplementing the materials, for a total of eight hours. For an equivalent project at a full service agency, I would expect to pay about three times that in fees, but I'd only spend a quarter of the time providing direction and feedback.
There is a place for both crowdsourcing and a high quality agency. When we need strategic concepts like "build an ad campaign to reach small accounting offices" or "create messages that will resonate seasonal tax preparers", we'll definitely stick with Watermark. For work that sets the direction of our brand, the full service agency wins again. For tactical graphical elements, like icons, or creating print materials when good branding is already in place, we'll consider crowdsourcing.
Watch this blog later in the week to see the winning design.