I ran the test in my own Shopify store, and the results weren't what I expected
I manage customer support for a small candle shop in Austin. We do about 300 orders a month, mostly through Shopify, with a handful from Etsy and Instagram. Most emails are fine—tracking questions, reorder requests—but refunds and complaints take real time. I wanted to know if Claude or Gemini could handle them without sounding like a bot or making promises I couldn't keep.
So I took 200 real refund requests from the past six months—angry customers, polite customers, people who bought the wrong scent, people whose packages never arrived—and fed them to Claude Sonnet 4.5 and Gemini Pro. Same prompt for each. I read every reply, scored them on tone and accuracy, and used the good ones as templates. Here's what I learned.
1. Claude writes more empathetic apologies, but Gemini gets to the point faster
Claude's replies felt human. When someone wrote "I've been waiting three weeks and no one has responded," Claude opened with "I'm really sorry we dropped the ball here—that's not the experience we want for you." Gemini opened with "We apologize for the delay. Here's what we can do." Both are fine, but Claude's version made me feel less like I was reading a script.
The trade-off: Claude's replies ran 20–30% longer. If you're answering 50 emails a day, that adds up. Gemini's shorter replies still covered the refund steps, but they skipped the warmth. For high-volume stores, Gemini saves time. For small shops where every customer matters, Claude's tone is worth the extra seconds.
Prompt I used for both: "You're writing a customer support email for a small Shopify candle store. The customer is upset about [issue]. Write a reply that apologizes, explains what happened, offers a refund or replacement, and ends on a positive note. Keep it under 150 words. Use a warm, professional tone."
2. Gemini handles policy edge cases better—Claude sometimes overpromises
I tested both models on tricky scenarios: a customer who wanted a refund after burning half the candle, someone who claimed their package was stolen, a wholesale buyer asking for a discount on a future order. Gemini stuck to the facts. When the policy didn't allow something, it said so clearly and offered an alternative. Claude was more generous—sometimes too generous.
Example: A customer bought a candle as a gift, didn't like the scent, and wanted a full refund three weeks later. Our policy is 14 days, unopened. Claude's reply offered a refund "as a one-time exception" without checking if I'd actually approved that. Gemini said, "Our standard policy is 14 days, but I'd like to send you a discount code for your next order instead." That's the reply I would've written.
If you're a solo founder who can afford to bend the rules, Claude's instinct to over-deliver might work. But if you're training a VA or building a support team, Gemini's discipline is safer. You don't want your AI making promises you can't keep.
3. Claude is better at de-escalating angry customers
I fed both models the meanest emails I could find—people threatening chargebacks, people calling us scammers, people who wrote in all caps. Claude's replies acknowledged the anger without getting defensive. "I can see how frustrating this must be, and I'd be upset too" showed up in almost every response. Gemini's replies were polite but flat: "We understand your concern."
One email started with "This is the worst customer service I've ever experienced." Claude replied, "You're absolutely right to be frustrated—we should've responded sooner, and I'm sorry we didn't." Gemini replied, "We apologize for any inconvenience." The Claude version defused the situation. The Gemini version felt like a form letter.
I sent the Claude replies to ten of the angriest customers. Eight replied with some version of "Thanks for getting back to me." Two still weren't happy, but they stopped threatening chargebacks. That's a win.
4. Gemini is faster when you're processing refunds in bulk
Black Friday and Cyber Monday generate a flood of support tickets. Last year I had 80 refund requests in four days—wrong sizes, duplicate orders, people who changed their minds. I needed replies that were accurate and fast, not necessarily warm.
I tested both models on 40 of those requests. Gemini's replies were shorter, followed a consistent structure (apologize, confirm refund, offer a discount code), and took about 10 seconds each to review and send. Claude's replies varied more—some were chatty, some included extra details the customer didn't ask for—and I spent 20–30 seconds editing each one to match our tone.
For high-volume periods, Gemini's consistency is an advantage. You can batch-process replies without worrying that one will go off-script. For normal weeks when you have time to personalize, Claude's flexibility is better.
Prompt for bulk refunds: "Customer requested a refund for [reason]. Confirm the refund will be processed within 5–7 business days to their original payment method. Offer a 15% discount code for their next order. Keep it under 100 words."
5. Claude handles shipping complaints better when the answer isn't clear
A lot of refund requests are actually shipping problems. The package is late, the tracking says delivered but the customer didn't receive it, USPS marked it as undeliverable. These need empathy and a clear next step, but you don't always know what went wrong.
Claude's replies acknowledged the uncertainty: "I checked with our shipping partner, and it looks like the package was marked as delivered to your mailbox on Tuesday. If you didn't receive it, it's possible it was left with a neighbor or taken by mistake—I'd like to send a replacement right away." Gemini's version was more mechanical: "According to tracking, the package was delivered. Please check with your local post office."
The Claude reply made the customer feel heard. The Gemini reply put the work back on them. I used Claude's replies for every shipping complaint where the tracking showed "delivered" but the customer said otherwise. Three out of five thanked me and said they'd check with neighbors. The other two accepted the replacement.
6. Gemini is better for international customers who want simple English
We ship to Canada and the UK occasionally, and those customers sometimes struggle with idioms or long explanations. Gemini's replies used shorter sentences, fewer contractions, and simpler vocabulary. Claude's replies were chattier and included phrases like "we dropped the ball" that don't translate well.
I tested both on ten emails from non-US customers. Gemini's replies were clearer in eight out of ten. One customer in Ontario replied, "Thank you, that makes sense." A customer in London replied to the Claude version asking what "dropped the ball" meant.
If most of your customers are in the US, this doesn't matter. But if you sell internationally or serve customers whose first language isn't English, Gemini's plain style is safer.
7. You can combine both models in Kryotta's compare mode and pick the best reply
I didn't have to choose one model for everything. Kryotta lets you run the same prompt through Claude and Gemini side by side, read both replies, and send whichever one fits. I did this for about 50 of the 200 requests—usually the ones where tone mattered more than speed.
For a customer who wrote a long, emotional email about a candle that reminded her of her late mother and arrived broken, I ran the prompt through both. Claude's reply was perfect: warm, specific, offered a replacement and a handwritten note. Gemini's reply was fine but generic. I sent the Claude version, and the customer replied with a thank-you that made me tear up a little.
For a bulk refund request from someone who ordered five candles and wanted to return three, Gemini's reply was cleaner and faster. I sent that one.
Compare mode takes an extra 15 seconds per email, but it's worth it when you're not sure which tone to use. You're not locked into one model's style.
8. Neither model should send emails without a human review (yet)
I edited every single reply before sending it. Claude occasionally invented details—"I've already processed your refund" when I hadn't—and Gemini sometimes missed context, like a customer mentioning they were a repeat buyer. Both models are good at drafting, not at replacing you.
The workflow that works: paste the customer's email into Kryotta, run the prompt, read the reply, fix anything that's wrong or too generic, and send. It cuts my response time from 10 minutes per email to about 2 minutes. That's enough to handle 30 refund requests in an hour instead of six.
If you're a 1099 freelancer managing support for multiple Shopify stores, this workflow scales. You can handle more clients without hiring help. If you're a solo founder, it buys you time to work on the business instead of answering emails.
The model I use depends on the situation, not loyalty to one brand
I don't use Claude for everything or Gemini for everything. I use Claude when the customer is angry, when the situation is ambiguous, or when I want the reply to sound like me. I use Gemini when I'm processing refunds in bulk, when the answer is straightforward, or when I need a reply in under 100 words.
Both models cost the same in Kryotta—you're not paying per message or per model. I ran all 200 test emails in one afternoon for less than the cost of ChatGPT Plus for a month, and I still had access to Llama, Mistral, and the image models when I needed product mockups.
The real advantage isn't that one model is better. It's that you can switch between them depending on what the email needs, and you're not locked into one company's style or pricing.
Questions people ask
Can I automate refund emails completely with Claude or Gemini?
Not yet. Both models are good at drafting replies, but they occasionally miss context or invent details. You still need to review each email before sending. The time savings come from editing a solid draft instead of writing from scratch.
Which model is better for angry customers?
Claude. Its replies sound more empathetic and acknowledge the customer's frustration without getting defensive. Gemini's replies are polite but can feel robotic when someone is upset.
Does Gemini work better for bulk refunds during Black Friday?
Yes. Gemini's replies are shorter and more consistent, which makes them easier to review and send quickly. Claude's replies vary more in tone and length, which slows you down when you're processing 50 emails in a row.
Can I use both models in the same support workflow?
Absolutely. Kryotta's compare mode lets you run the same prompt through Claude and Gemini side by side, then pick whichever reply fits the situation. I do this for tricky emails where tone matters more than speed.
I'm not saying you need AI to answer refund emails. But if you're spending two hours a day on support and you'd rather spend that time on product development or marketing, Claude and Gemini both cut the work in half. Try them on ten real emails and see which replies you'd actually send. You can test both models in Kryotta without paying per message or picking one company's ecosystem.
