“We built a personalisation engine—why isn’t it working?” Lessons from CTOs and CDOs
Equal_Experts_logo

Equal Experts

Data

February 7, 2025

“We built a personalisation engine—why isn’t it working?” Lessons from CTOs and CDOs

Many e-commerce companies invest heavily in personalisation engines, expecting AI-driven recommendations, dynamic content, and tailored experiences to drive higher conversion rates. But often, after months (or even years) of development, the results are underwhelming—engagement remains stagnant, revenue uplift is marginal, and customer frustration grows.

So, what’s going wrong?

We spoke to CTOs, CDOs, and Heads of Engineering who have been through this journey. Their insights reveal common pitfalls and critical lessons for turning struggling personalisation initiatives into real business impact.

1. The problem isn’t your AI—it’s your data

 

Many organisations blame their recommendation engines when personalisation falls flat. The reality? Bad data is the real bottleneck.
Common issues we’ve seen are:

  • Data silos – Customer data is scattered across platforms, preventing a unified personalisation strategy
  • Duplicate and inconsistent records – A customer might be treated as multiple different users across touchpoints
  • Lack of real-time data – Personalisation models rely on outdated batch-processed insights, leading to irrelevant recommendations.

Lesson: Personalisation is only as good as the data behind it.

2. The tech is built, but the business can’t use it

 

One CTO shared how their engineering team built a personalisation engine, but marketing and product teams couldn’t easily access or test recommendations. The result? Underutilisation and minimal impact.

Common missteps are:

  • No business-friendly interface – Marketing teams need low-code/no-code tools to adjust personalisation strategies without engineering dependencies.
  • No A/B testing framework – Without proper experimentation, it’s hard to measure whether personalisation is actually working.
  • No clear ownership – Is personalisation owned by engineering, data, marketing, or product teams? Often, it’s unclear.

Lesson: Personalisation needs cross-functional collaboration, not just a strong tech stack.

John Lewis

 

3. The infrastructure can’t handle scale

 

A CDO at a leading e-commerce retailer described how their personalisation model performed well in a test environment but crashed under real-world traffic. The culprit? Bottlenecks in the data pipeline and inefficient query execution.

Common scalability pitfalls are:

  • Recommendation engines querying live databases instead of using precomputed embeddings
  • Inefficient data pipelines causing latency in real-time personalisation
  • Infrastructure not optimised for high-traffic events (e.g., Black Friday).

Lesson: A system that works in a pilot phase can still fail in production if scalability isn’t considered.

4. Lack of flexibility stifles innovation

 

Several CTOs we spoke to described how early technology choices limited their ability to innovate later. Many personalisation platforms were designed with specific use cases in mind but couldn’t adapt as customer expectations evolved.

Signs of an inflexible system:

  • Personalisation logic is hardcoded into the platform, making it difficult to test new models.
  • Scaling personalisation globally requires expensive rewrites due to tightly coupled architectures.
  • Integrating new AI models or third-party data sources is slow and complex.

Lesson: Rigid architectures and legacy data systems slow down personalisation efforts.

4. ROI expectations are misaligned

 

Many CDOs highlighted a disconnect between leadership expectations and real-world personalisation ROI timelines. Executives expect immediate revenue lift, but in reality:

  • Personalisation takes time to optimise—data models need continuous tuning
  • Success metrics must be realistic—personalisation might improve customer lifetime value (CLV) more than immediate conversions

Long-term investment is key—AI-driven personalisation isn’t just about quick wins but creating sustained differentiation.

Lesson: Personalisation is not a one-time implementation—it requires ongoing optimisation.

John Lewis

 

Final takeaways for CDOs and CTOs

 

If your personalisation engine isn’t delivering results, the problem isn’t the algorithm—it’s the data, infrastructure, and operational alignment.

  • Fix your data first—invest in real-time, high-quality, unified customer data
  • Make personalisation accessible—give marketing and product teams the tools to optimise and measure results
  • Design for scale—ensure your infrastructure can handle real-world e-commerce demands
  • Future-proof your architecture—adopt a modular, flexible data infrastructure that allows personalisation strategies to evolve without costly rework
  • Align ROI expectations—personalisation is a long-term investment, not a quick win.

By applying these lessons, e-commerce leaders can turn underperforming personalisation into a true competitive advantage.

Want to accelerate your data readiness for personalisation? See how we can help.

 

You may also like

Case Study

Creating a personalised customer experience

Blog

‘But I’ve already paid for the data!’ Talking to your finance director about continuing investment in data

How bad data hinders good personalisation

Blog

How bad data hinders good personalisation

Get in touch

Solving a complex business problem? You need experts by your side.

All business models have their pros and cons. But, when you consider the type of problems we help our clients to solve at Equal Experts, it’s worth thinking about the level of experience and the best consultancy approach to solve them.

 

If you’d like to find out more about working with us – get in touch. We’d love to hear from you.