An ecommerce discovery call scorecard is a scoring sheet you fill in after each first call with a developer, agency or freelancer, so that the provider who listened best wins over the provider who talked best. Discovery call here means the first 30 to 45 minute conversation, held after the provider has read your ecommerce brief and before anyone writes a quote.

Memory is a poor judge of three calls held across one week. The last call feels freshest, the friendliest person feels most competent, and by Friday the details of Monday’s call have blurred. A sheet with fixed criteria and written evidence fixes that. Below you get the criteria and weights, the scoring guide, a worked example with three invented providers, tie-break rules and what to do with the numbers.

Which criteria go on the scorecard, and what does each weigh?

The weights reflect where small ecommerce projects go wrong. Misunderstood scope and unnamed risks cost the most money later, so they carry the most points.

Criterion Weight Why it carries that weight
1. Understanding of the job 20 A provider who misreads the job quotes the wrong project.
2. Questions about your business 15 Good questions are the cheapest proof that they have built similar shops.
3. Approach and named risks 15 Projects fail on the risks nobody mentioned in the first call.
4. Relevant proof 15 Live shops they can explain, close to your size and problem.
5. Who does the work, and when 10 The person on the call is not always the person doing the build.
6. Ownership and access 10 Accounts in the wrong name are expensive to recover.
7. Price clarity 10 You need to know what moves the price before you ask for a quote.
8. Communication fit 5 Plain language and kept promises, such as a follow-up email on the day they said.
Total 100

You can move weights around for your situation (see the FAQ), as long as the total stays at 100 and you set the weights before the first call. Changing them after you have a favorite turns the sheet into a justification.

What does a 1, a 3 and a 5 look like?

Score each criterion from 1 to 5. The descriptions below anchor the three main points; a 2 or a 4 sits between them.

Criterion 1 3 5
Understanding of the job Describes a different project, or pitches a package. Restates the job correctly when asked. Restates it unprompted and spots a gap in your brief.
Questions about your business No questions, or only about budget. Sensible general questions (products, orders, platform). Questions about specific scope lines, peak weeks, staff routines.
Approach and named risks “No problem, we do this all the time.” Outlines steps, names one obvious risk. Names the risks particular to your job and how they would test for each.
Relevant proof Mockups only, or shops they cannot explain. Live shops of similar size, explained in broad terms. Live shops with a similar problem, and they say exactly what they built.
Who does the work, and when Will not say. Names a team, start date vague. Names the people, their hours on your job and a start date.
Ownership and access Wants your owner login, or plans to register accounts themselves. Agrees accounts stay with you when asked. Raises it first and explains how staff or collaborator access works.
Price clarity No idea of range, or a firm price before hearing the job. A rough range. A range plus the two or three things that would move it.
Communication fit Jargon without explanation, late or missed follow-up. Clear enough, follow-up arrives. Explains terms in your words, follow-up on the day promised.

A 1 on ownership and access is serious enough to override the total; the knockout rules further down cover it.

How do you run the call so the scores mean something?

Scores only compare well when every provider gets the same call. Use the same order and the same eight questions, and keep to 45 minutes:

  1. “In two sentences, what do you think the job is?” (criterion 1)
  2. “What else do you need to know about how we work?” Then stay quiet for a moment. (criterion 2)
  3. “How would you go about it, and what could go wrong?” (criterion 3)
  4. “Show me one live shop close to ours and tell me what you built on it.” (criterion 4)
  5. “Who would do the work, how many hours a week, from when?” (criterion 5)
  6. “Whose name will be on the store, the domain and the analytics accounts?” (criterion 6)
  7. “What range would you expect, and what would push it up or down?” (criterion 7)
  8. “What happens next, and when will I hear from you?” (criterion 8, scored on what they then do)

Take notes in two columns: what they said and the score. Write the score within 30 minutes of hanging up, before the next call, and before you talk it over with anyone. If a partner joins the calls, both of you score separately and compare afterwards; differences of 2 points or more on a criterion are worth discussing, because one of you heard something the other missed.

How do you turn scores into points?

Each criterion earns weight × score ÷ 5 points. A 5 earns the full weight, a 3 earns 60% of it, a 1 earns 20%. Add the eight results for a total out of 100.

Worked line: understanding of the job has a weight of 20. A score of 4 earns 20 × 4 ÷ 5 = 16 points. Questions about your business has a weight of 15. A score of 3 earns 15 × 3 ÷ 5 = 9 points.

Then read the total against three bands:

Total What it means Next step
75 to 100 Strong fit on the evidence from the call. Invite to quote.
60 to 74 Workable, with gaps. Invite to quote only if fewer than two providers scored 75 or more, and send them the gaps first.
Below 60 Weak fit for this job. Thank them and stop.

The bands are MarketPulse’s suggested cut-offs, set so that a provider scoring an average 3 everywhere (60 points) only just stays in the running.

What does a scored example with three providers look like?

Example only. A bike shop with one store and about 300 products sends the same brief to three invented providers: Provider A (a ten-person agency), Provider B (a freelance developer) and Provider C (a three-person studio). The scores below are made up to show the arithmetic.

Criterion (weight) A score A points B score B points C score C points
Understanding (20) 4 16 5 20 4 16
Questions (15) 3 9 5 15 4 12
Approach and risks (15) 4 12 3 9 5 15
Proof (15) 5 15 3 9 4 12
Who and when (10) 2 4 5 10 4 8
Ownership (10) 3 6 5 10 4 8
Price clarity (10) 3 6 4 8 4 8
Communication (5) 4 4 4 4 3 3
Total 72 85 82

Provider A had the most impressive portfolio and still finished last, because the agency would not say who would build the shop and only agreed to keep accounts in the owner’s name when pushed. That is the point of the sheet: a strong portfolio earned A 15 points, and vague staffing plus a soft answer on ownership cost A 10 points against B.

B and C sit 3 points apart, which the next section treats as a tie.

How do you break a tie between two providers?

Treat any gap of less than 5 points as a tie. Scores of 85 and 82 come from judgement calls on a 1 to 5 scale, and one point more or less on a single criterion would swap them. Break ties in this order:

  1. Weakest score. Compare each provider’s lowest single score. A project breaks at its weakest point, so the provider whose worst score is higher goes ahead. In the example both have a lowest score of 3, so move on.
  2. The job-specific criteria. Add the points for understanding (criterion 1) and approach and risks (criterion 3). B has 20 + 9 = 29, C has 16 + 15 = 31. C goes ahead on this step.
  3. A written follow-up. If it is still close, send both the same question from the call that they answered least well, and give them two working days. B would get: “Which risks do you see in syncing counter sales with online stock, and how would you test it?” Score the answer from 1 to 5 using the approach row.

A tie also means both providers deserve a quote. Tie-breaking decides who goes first if you can only afford the time for one detailed quote.

Which answers knock a provider out whatever the total?

Some answers cost so much later that no total makes up for them. Score them, and also mark the provider as out:

  • A 1 on ownership and access. They want your owner password, or they plan to register the store or domain in their own name.
  • A promise of guaranteed rankings or guaranteed sales.
  • Refusal to name who does the work after you ask twice.
  • A firm price before they have heard the job.

The full list of warning signs, with what to ask when you hear one, sits on the ecommerce agency red flags page.

What do you do with the scores afterwards?

The scorecard keeps working after the calls:

  • Invite the top two to quote, using the same brief plus any updates from the calls.
  • Send each provider their gaps in neutral words: “We would like the quote to name the people doing the work and their weekly hours.” Gaps you point out now come back answered in the quote.
  • Carry the low scores into the quote check. If price clarity scored 2, read that provider’s assumptions and exclusions twice. The quote comparison guide shows how to line them up.
  • Keep the sheet. When you sign, the notes column records what was promised on the call, such as named people and a start date, and you can ask for those points in the statement of work.
  • Tell the others politely. A short “thank you, we have chosen another provider for this job” keeps the door open for later work.

FAQ

Should I tell providers I am using a scorecard?

You can, and it does no harm. Share the criteria names if you like, but keep the 1, 3 and 5 descriptions to yourself, so answers come from experience rather than from your sheet.

Can I change the weights?

Yes, before the first call. A shop moving off an old platform could raise approach and risks to 20 and lower communication to 0. Keep the total at 100, write the new weights down, and use them for every provider.

How many providers should I call?

Three to four. Fewer gives you nothing to compare, and more than four calls in a week blurs together even with notes. If more than four replied well to your brief, pick on the quality of the written replies.

What if nobody scores above 60?

Look at which criterion everyone scored low on. If all three misunderstood the job, the brief is probably unclear, so rewrite part 2 and the scope lines and send it again. If they understood it but none could show proof, widen the search.

Do I score a freelancer and an agency on the same sheet?

Yes. The criteria measure fit for your job, and both can score well. The agency vs freelancer guide covers the structural differences, such as cover during holidays, that the call alone will not show.

Is a paid discovery workshop the same as a discovery call?

No. A paid workshop is a short piece of work in its own right, sometimes several hours, that ends with a written plan. You can still use this sheet on the free first call that comes before it, and decide from the score whether the workshop is worth paying for.

What if I liked a provider who scored low?

Look at the notes column and find the criterion where your feeling and the score disagree. If the evidence was thin, ask a written follow-up question. If the evidence was clear, trust the sheet: it records what they said before you got attached.

Where do you go from here?

Print the two tables, set your weights, and score your first call within 30 minutes of hanging up. Once two providers are above the cut-off, ask them for quotes and line those up with the quote comparison method.

If you are unsure how to weigh a call you have already had, describe it through the MarketPulse contact form and we will help you read your notes.