2/3/2026
By Andy Stacey

When Research Gets Hard

The best insights teams don’t outsource everything. They right-source: handle the mainstream work in-house and bring in a specialist when the work becomes complex, technical, or high-stakes.

A Practical Guide: When to Run It In-House vs. When to Call PROOF

Self-serve research tools have changed the game for brand teams and client-side researchers.

If you’re running quick UX and CX surveys in platforms like Qualtrics, you’re doing what modern insights teams are built to do: move fast, answer straightforward questions, and keep the organization close to the customer.

And for many needs, that’s exactly the right call.

But when you have a research objective that needs to be projectable to a broad audience, the risk gets higher, and the cost of getting it wrong goes way up. The best insights teams don’t outsource everything. They right-source: handle the mainstream work in-house and bring in a specialist when the work becomes complex, technical, or high-stakes.

Here’s a simple framework to help you decide.

The 3-level “right-source” framework

Level 1: Self-serve is perfect when…

Use your platform when the need is:

  • A quick pulse check (directional learnings)

  • Simple customer feedback (clear audience, clear objective)

  • Basic tracking questions that don’t require advanced analytics

  • Internal reads where “good enough fast” beats “perfect later”

If you can confidently say:

  • We know the audience

  • We know the question

  • We’re okay with directional
    …then DIY can be exactly right.

Level 2: Bring support when execution gets tricky

This is the middle ground where many teams get stuck: the survey isn’t “rocket science,” but it’s not trivial either. Common examples:

  • You field among customers and discover sample skews you need to correct, such as when your sample groups don’t align with your known population proportions

  • You need to merge data sources or reconcile tracking waves

  • You want a second set of eyes on wording, logic, quotas, or data integrity

In these moments, an external partner can save you from the two most expensive outcomes:

  1. Re-fielding, and

  2. Explaining questionable results to leadership.

Level 3: Call a specialist when the stakes or complexity jumps

This is PROOF’s sweet spot: projects where method choice and technical execution matter as much as the questionnaire.

Here are a few real-world “hard stuff” scenarios we see all the time:

Scenario 1: “We should run a Conjoint… right?”

Conjoint (and related approaches like ACBC) can be incredibly powerful, when the design is right. But it’s also easy to derail with the requisite experience:

  • The attribute list gets bloated

  • Levels aren’t realistic or balanced

  • The experimental design doesn’t support the decisions you need

  • The survey programming introduces subtle errors that contaminate results

  • The analysis is treated like a black box instead of a decision tool

If Conjoint will influence pricing, packaging, feature roadmap, or go-to-market strategy, this is not the moment to “hope we did everything right.” It’s the moment to bring in a partner that designs these studies regularly and can defend the tradeoffs to stakeholders.

Scenario 2: “We have customers… but we need the opinions of prospects, too.”

Customer lists are gold, until you need to compare them to the broader market.

The moment you add third-party sample (panels), a new set of challenges shows up:

  • Fraudulent responses (bots, speeders, straight-liners)

  • Panel bias and professional respondents

  • Quota balancing issues

  • Inconsistent data quality across suppliers

If you’re going to use panel data to make real decisions, the real work isn’t just “getting completes.” It’s building a quality plan so your final dataset is something you can trust.

Scenario 3: “Our results look off. Do we need weighting?”

Skews happen, especially when you’re surveying customers, niche audiences, or any group where response propensity varies.

That’s where techniques like RIM weighting come in. Done well, weighting can make your results more representative and defensible. Done poorly, it can introduce instability (or create a story that isn’t true).

A great use of a partner here is surgical: you keep ownership of your survey and your platform, then hand off the dataset for expert weighting and documentation you can share internally with confidence.

A quick checklist: should we DIY or partner?

If you answer “yes” to any of these, it may be time to bring in PROOF:

  • Are we considering advanced methodologies (Conjoint, segmentation, MaxDiff, modeling)?

  • Are we using panel sample and worried about fraud or bias?

  • Do we need weighting or complex data adjustments?

  • Do we need banner cuts of key groups in an easy-to-read format?

  • Is this tied to a high-visibility decision (pricing, segment strategy, positioning)?

The point of view we’ll stand behind

Self-serve isn’t the enemy. It’s the new baseline.

The most efficient client-side teams build a hybrid model:

  • DIY for speed and tracking

  • Partner for confidence

  • Use specialists for advanced methods, data quality, and decision-ready storytelling

That’s exactly how PROOF Insights is built: to be the team you call when research gets hard, so you can keep moving fast without gambling on the outcome.

If you want a sounding board, we’re happy to help you pick the right approach, even if you ultimately run it in-house.