The short answer
Do not decide on the average star rating. Split the evidence by time, check it against samples you order yourself, and write down in advance what result would make you stay, test further or leave. A provider that was excellent two years ago and a provider that is excellent this quarter can have the same average.
1. Separate recent from old
An all-time rating blends years of orders. Copy the reviews you can find on app listings, forums and community groups into two groups: the last three to six months, and everything older. Compare the share of complaints in each. If the recent group is clearly worse, the trend matters more than the average.
Look for a single event that could explain a change, such as a new facility, a new print method or a price change, and check whether complaints began around that date.
2. Read complaints by product, not in general
Quality problems are usually specific: one garment style, one print method, one size range. Sort complaints by the products you plan to sell. A provider with problems on mugs may still be fine for posters. A vague review such as “bad quality” is weak evidence; a review that names the product, the defect and the date is strong evidence.
3. Order samples like a customer
Order the exact products you plan to sell, in the sizes and colors that matter, using the same address type your customers use. Record the order date, the delivery date, the condition on arrival and the cost. Take clear photos in daylight next to a ruler or tape. One sample proves little; three orders of the same product over a few weeks show consistency.
4. Check the numbers around quality
Quality is also a cost question. For each candidate, write down the base cost, the shipping cost to your main markets and the stated production time. Shopify’s documentation says that a fulfillment method is chosen per product, which means you can test a provider on one product without moving your whole catalog.
5. Set decision rules before you look
Decide in advance how many defects in a batch of samples are acceptable, how many days late is too late, and what the provider must do if something goes wrong. Writing the rules first stops you from rationalizing a mediocre result because the price is attractive.
Red flags worth acting on
- Recent reviews mention the same defect on the same product more than once.
- Delivery times in recent reviews are longer than the estimate on the provider’s own page.
- The provider cannot say where your product will be produced.
- Support replies are slow or generic when you ask a specific question about a defect.
- A sample arrives well but the second order of the same product looks different.
One red flag is a prompt to look closer. Several together are a reason to test a second provider before you grow volume.
Questions to ask the provider before you commit
- Where will my products be printed, and can that change without notice?
- What is your process when an order arrives damaged or misprinted, and how long does it take?
- Do you tell merchants when the blank item or print method changes?
- What are your current production and shipping times, by destination?
- How do you handle reprints: who pays for shipping, and what evidence do you need?
Write the answers down with the date. If the answers change later, you will know what was promised.
A simple worked pattern
Imagine you compare two providers for the same mug. Provider A has the better average rating, but most of its recent reviews are three stars. Provider B has a slightly lower average, but its recent reviews are steady. You order three samples from each over a month. If the samples match the reviews, you choose B for the pilot and keep A as a backup. The numbers in this example are illustrative; the habit is what matters: trend first, samples second, decision rules last.
6. Re-check on a schedule
A vetting result expires. Put a recurring date in your calendar to repeat the sample orders and re-read recent reviews. The monitoring workflow turns this into a simple routine, and the workspace page shows how to reuse your answers across prompts.
What the book adds
The first category in the book page contains ten prompts that walk through review filtering, trend reading and decision rules, with your provider, products and deadlines filled in as variables. Read why quality drifts after launch to understand the mechanism behind what you are checking.
Sources and verification
Rules, fees, screens and plans change. This page reflects what Shopify published when it was last checked (12 October 2026); check the current Shopify Help Center pages before you act. The Prompt Powerhouse is not affiliated with or endorsed by Shopify.
Educational guide only. Not legal, tax or financial advice. The Prompt Powerhouse is independent of Shopify and print-on-demand providers; no result is guaranteed.