How to Build a Supplier Shortlist (and Score It)

The cheapest quote is not the best supplier. The best supplier is the one with the strongest total profile across the factors that decide whether your order arrives on time, matches the sample you approved, and lands at a cost your business can defend. A supplier shortlist template gives you exactly that: a scoring matrix that turns vague impressions into comparable numbers.

This guide walks you through building one for your own China sourcing. You will define seven scoring criteria with weights, collect the same data from every candidate, and narrow the field over four to six weeks from eight or ten prospects to one primary supplier and one backup. If you would rather have someone run this process for you, a sourcing agent like CN Ally does supplier shortlisting and verification as part of its daily work.

What a supplier shortlist actually is

A shortlist is a small set of suppliers, usually three to five, that survived your first round of screening and are worth the time and money it takes to get quotes and samples. The template is the document that holds them: one table where each supplier gets scored on the same criteria, with the same weights, so the comparison is fair.

Most buyers skip this step and pay for it later. They talk to a dozen suppliers on Alibaba, keep the three that replied fastest, and pick the one with the lowest unit price. Price is one of seven things that matter. It gets about a quarter of the weight in a serious matrix, not all of it. The suppliers who look cheap at the quoting stage are often the ones whose samples fail, whose lead times stretch by a month, or whose payment terms put all the risk on you.

A shortlist template fixes three problems. It forces you to decide what matters before you fall in love with a price. It makes suppliers comparable, because you collect identical information from each one instead of whatever each happened to tell you. And it leaves a record. Six months later, when your primary supplier raises prices or goes quiet, you know exactly who came second and why.

The seven criteria worth scoring, and their weights

Not every factor matters equally. A matrix with equal weights pretends that payment terms matter as much as landed cost, which they do not. Start with the weights below, then adjust them to your situation. If you are importing a regulated product like electronics or children's toys, give quality and certification signals more weight. If you are testing a new product with a small order, push MOQ flexibility up.

Criterion · Weight · What you are judging

• Landed cost fit: 25% · Unit price on the same Incoterm, plus packaging, samples, and amortized tooling
• Quality and QC signals: 15% · Certifications, QC process, defect policy, willingness to accept third-party inspection
• Lead time and reliability: 15% · Quoted production time, how specific it is, evidence the factory can hit it
• MOQ flexibility: 15% · Whether your first order size works; flexibility on mixed SKUs and variants
• Communication quality: 10% · Response speed, clarity, whether answers are real or copy-paste templates
• Factory capability fit: 10% · Verified manufacturer whose product range and export history match your item
• Payment terms: 10% · Balance of risk: 30/70 scores better than 100% upfront by wire

A note on what is missing. Sample quality does not appear here because at the shortlisting stage you have no samples yet. It enters in week three or four, when samples arrive, and it can override the matrix. A supplier with a great score whose sample fails still gets cut. Think of the matrix as the filter that decides who earns a sample order, and the sample as the test that decides who earns the production order.

How to score each criterion from one to five

Vague scores make a vague matrix. Before you score anyone, write down what each number means for each criterion. A 1-to-5 rubric is enough; a 10-point scale creates false precision, and everyone scores 7s.

Use these definitions as your starting point:

• 1 — Poor. Below industry standard, or a dealbreaker on its own. Example: demands 100% payment upfront by wire transfer to a personal account.
• 2 — Weak. Acceptable only if everything else is excellent. Example: replies take three days and answers ignore half your questions.
• 3 — Standard. What a competent average supplier offers. Example: 30/70 payment terms, 25-day lead time stated in writing.
• 4 — Strong. Clearly better than most. Example: sends production-line photos unprompted, offers 20/80 terms after a first order.
• 5 — Exceptional. The kind of thing you did not expect. Example: holds ISO 9001 certification relevant to your product and invites a video walkthrough of the factory floor.

Score from evidence, not from charm. A friendly sales rep who answers in minutes is pleasant, but communication quality is scored on whether answers are complete and consistent across messages, not on friendliness. Keep the quote emails, the spec sheets, and your notes. When two suppliers finish close, the notes break the tie. If you are new to reading Chinese supplier quotes, our guide to getting accurate quotes shows what a complete quotation should contain.

Run the shortlist over four to six weeks

Rushing this process is how buyers end up with the wrong factory. Four to six weeks sounds slow, but most of it is waiting: waiting for quotes, waiting for samples, waiting for answers. Your active work is a few hours per stage. Here is the sequence.

Week 1: Cast wide, screen fast

Start with eight to ten candidates from your supplier search. Do not score them yet. This stage is a desk screen: check the business license registration scope, confirm the product range actually includes what you want, look at how many years they have been exporting, and send one identical introductory message. Anyone who does not reply within five working days, or replies with an obvious template that ignores your questions, drops out now. You should be left with five or six. Read our guide to finding reliable suppliers if you need help building the initial list.

Weeks 2 to 3: The identical RFQ round

Send the same request for quotation to all five or six survivors. Same product specs, same quantities, same packaging, same Incoterm, same delivery expectations. This is the single most important discipline in the whole process: if each supplier quotes different terms, you cannot compare them. Fill in the first four criteria of your matrix from the quotes: landed cost fit, lead time, MOQ flexibility, payment terms. The rest comes from how they handled the RFQ itself. Cut to three or four suppliers. Anyone whose quote arrives weeks late, or who cannot answer basic spec questions, is telling you how the production run will go.

Weeks 3 to 5: Samples and the real test

Order paid samples from three or four suppliers. Follow a proper sampling process, which we cover in detail in our sample sourcing guide, and test each sample against the same checklist: dimensions, materials, finish, function, packaging. Record the results in your matrix as a separate sample verdict. One failed sample can end a supplier that scored 80 on paper. That is the system working as designed. Cut to two suppliers.

Weeks 5 to 6: Final verification and the decision

For your final two, verify what the paperwork claims. Confirm the business license, check that the factory address is real, and consider a factory audit or verification visit before you commit to production volumes. Negotiate final terms with both, then pick your primary and name the other your backup. Never tell the backup they lost. Tell them they are approved as a second source and you will send them orders as volume grows. This is true, and it keeps them warm.

Red flags that end a supplier's chances immediately

Some signals are not worth scoring around. Any one of these removes a supplier from the shortlist on the spot, no matter how attractive the price:

• Refuses to send samples, or quotes a sample price so high it is clearly a refusal in disguise.
• Demands full payment upfront by wire transfer, especially to an account in a different name or country than the company.
• The business license registration scope does not match what they sell. A "trading" company posing as the factory is not automatically a problem, but lying about it is.
• Cannot provide a real factory address, or refuses a visit or video walkthrough.
• Goes silent for a week or more during quoting, then reappears with no explanation. Communication during courtship is the best it will ever be.
• Quotes 15% or more below every other supplier with no plausible explanation. That discount comes out of your product somewhere: thinner materials, skipped QC, or a specification change you will discover too late. JingSourcing's Alibaba buying guide makes the same point: treat extreme low quotes as a quality warning, not a bargain.
• Every answer is a template. If they cannot answer a specific question about your product now, they cannot solve a specific problem during production.

One caution: a single red flag in isolation can occasionally be a misunderstanding, especially across a language barrier. Two red flags, or one flag plus evasive answers when you ask about it, is a pattern. Trust the pattern.

A worked example: three suppliers, one winner

The table below shows how the matrix works in practice. The figures are illustrative, but the math is the real method: multiply each score by its weight, add them up, divide by five.

Criterion (weight) · Supplier A · Supplier B · Supplier C

• Landed cost fit (25%): 4 → 100 · 5 → 125 · 3 → 75
• Quality and QC signals (15%): 4 → 60 · 3 → 45 · 4 → 60
• Lead time and reliability (15%): 4 → 60 · 3 → 45 · 5 → 75
• MOQ flexibility (15%): 3 → 45 · 4 → 60 · 5 → 75
• Communication (10%): 5 → 50 · 3 → 30 · 2 → 20
• Factory capability fit (10%): 4 → 40 · 3 → 30 · 2 → 20
• Payment terms (10%): 3 → 30 · 2 → 20 · 4 → 40
• **Total (out of 500): 385 · 355 · 365**
• **Final score: 77 · 71 · 73**

Supplier B has the best price and still loses. Its communication is mediocre and its payment terms put all the risk on the buyer, which the weights punish honestly. Supplier C is flexible and fast but scores badly on communication and factory fit: a trader, most likely, reselling someone else's capacity. Supplier A wins without being the best at anything except communication. That is usually what a good supplier looks like. Solid across the board, excellent at the things that predict a smooth production run.

Run your own numbers the same way. If the winner surprises you, check whether your weights reflect your real priorities, then trust the result.

Ties happen, especially between your second and third candidates. Break them with the sample verdict first: the better sample wins, because paper scores predict process and samples predict product. If samples are also close, break the tie on communication quality. Over a year of production, the supplier who answers precisely and quickly will cost you less in delays and misunderstandings than the one who scored a point higher on landed cost.

Keep a backup supplier on file

The most expensive sentence in sourcing is "our supplier stopped responding and we have nobody else." Your backup supplier is insurance, and like all insurance it is cheap when you buy it early.

Keeping a backup warm costs almost nothing: a quarterly message, an occasional small order, sharing your forecasts so they can plan capacity. A practical cadence is one short check-in email every three months, plus a trial order of a few hundred units once or twice a year to confirm their quality and lead times have not drifted. When your primary supplier has a full production line, raises prices, or has a quality dispute with you, the backup is already vetted, already has your specs, and already passed your sample test. Buyers who skip this step discover that re-running a six-week selection process during a stockout is far more expensive than the backup ever was.

A professional shortlist document, like the sample shortlist format published by EDVIA Global, always ends with a recommendation plus next steps rather than a single winner. Adopt that habit. Your shortlist should conclude: primary supplier, backup supplier, and the open items each one still needs to resolve before production.

Frequently asked questions

How many suppliers should I shortlist?

Start with eight to ten candidates, narrow to five or six for the RFQ round, three or four for samples, and finish with one primary plus one backup. Fewer than three at the sample stage leaves you no leverage and no fallback. More than five at any stage after week one spreads your attention too thin to evaluate anyone properly.

What is the most important criterion when choosing a supplier?

Landed cost fit carries the most weight at 25%, but no single criterion decides alone. In practice, the criteria that predict trouble are communication quality and QC signals: suppliers who answer precisely and run a visible quality process rarely produce nasty surprises, while cheap suppliers who communicate vaguely produce them regularly.

Should I always pick the cheapest supplier?

No. The worked example above shows why: the cheapest quote scored lowest overall once payment terms, communication, and lead time were weighted honestly. A quote 15% or more below the pack is itself a red flag. Pick the supplier with the best total score, then negotiate the price with them from a position of knowledge.

How long does supplier selection take?

Four to six weeks for a first order: one week to screen candidates, one to two weeks for the RFQ round, two weeks for samples including express shipping, and one week for final verification. Repeat orders with an established supplier take days. Trying to compress the first selection into one week is how buyers skip sampling, which is the step that catches most problems.

Do I really need a backup supplier?

Yes. Suppliers get overloaded, raise prices, change ownership, or simply deprioritize small buyers. A vetted backup with your specs on file turns a crisis into a phone call. Keep the relationship warm with quarterly check-ins and the occasional small order.

What is a supplier scorecard?

A supplier scorecard is the scoring half of the shortlist template: the weighted matrix of criteria, the 1-to-5 rubric, and each candidate's scores. Some buyers use "scorecard" for ongoing supplier performance reviews after production starts. The method is the same; only the timing differs.

Your next move

Build the matrix before you contact anyone. Copy the seven criteria and weights into a spreadsheet, write your 1-to-5 definitions, and decide your must-have thresholds: for example, no supplier scoring below 3 on quality signals advances to the sample stage. Then send the identical RFQ to five or six candidates and let the numbers do the arguing.

If the process sounds like a lot of work for your first order, that is exactly the situation where outside help pays for itself. Supplier shortlisting, verification, and sample management are core product sourcing services, and running them well is what separates a smooth first import from an expensive lesson. Contact us or email hi@cnally.com, and bring your product specs: the shortlist starts from there.