A Case Study on Collaboration with UX and Data Science
Introduction
This post is related to two previous ones that may be of interest. The first is a framework – Building AI-enabled Solutions – Why a Human-Centered Lens is Key and the second is a case study about a product which at the time was provisionally called Personalized Analytics. Just a year or two later a related product opportunity presented itself. While it was a great idea, it didn’t make sense as a standalone solution. It was eventually integrated into Personalized Analytics, in an effort to avoid further proliferation of sales-enabling tools, and provide a comprehensive set of insights and recommendations in one place.
In reference to my earlier framework, this post will focus mainly on Context and Algorithm Refinement.
Context of Use
Before I joined ZS, the company had invested in building a solution to assist sales reps in traversing through their territory more effectively. In principle, it sounded like a great idea. However at the time, the product organization was comprised exclusively of engineers; no user research or usability testing was conducted. The product was fully designed and built before anyone realized it was an expensive mistake.
As I mentioned in my previous post, the average age of pharma sales reps is 47, and as a result of their years of experience (and often long tenure in the same territory) they are deeply familiar with their territory and the physicians they call on. They keep notebooks to organize and track their activities, and they have driven their weekly routes many times. So the idea that a software provider would come in and offer a routing solution that completely disrupts how they’re working is … misdirected at best.
The routing solution was eventually sunset without ever being piloted or sold. But, as a result of the work on Personalized Analytics, discussions resurfaced about enabling reps to move through their territories more effectively. And this time we did conduct user research.
We knew a lot going into this new product:
- A primary care rep might be expected to call on 8 to 12 doctors a day
- Reps have an established route that they follow for that particular week of the month
- With the right tools, they’ve done a little preparation for those physician interactions
As we dug deeper, however, we learned more about the challenges rep faced in achieving their call planning goals. As the day gets underway a doctor might cancel, or be at a different location, or unexpectedly be in surgery. Suddenly, what was initially an eight-call day turns into a five-call day, and the rep is now scrambling to find contacts in their territory that can allow them to meet their expectations in terms of productivity and ultimately revenue.

We realized the solution was not to tell them what to do, but to deeply understand their context and how they were navigating their day, and augment that. This provided a little lift that we eventually called Dynamic Targeting, a solution that would help them achieve their goals consistently rather than attempting to override their wealth of knowledge about their territory and the physicians in it.
Through dialogue with reps at a pilot customer, we learned how different it is to traverse an urban territory like Brooklyn compared to a rural territory like East Texas. We realized we would need input from the reps to understand how they move through their territory so we could augment it. The reps’ willingness to provide insights into their patterns of movement enabled us to envision, design, and build a solution to support them effectively.
Algorithm Refinement
Some of the most exciting work of my career so far was the work that the product User Experience team did with our data scientists. There were two major things that we worked on with the data scientists: (1) changing the timing and frequency of presenting new data into the solution, and (2) creating differentiated logic to serve up insights for urban and rural territories.
Data Ingestion
Pharmaceutical sales data is released five times a month. Weekly sales data is more timely but not as accurate, and the monthly data lags but is more complete. In the interest of ensuring the system remained engaging with fresh insights, our solution used the weekly data. At the outset, the solution received all of the data, generated insights for the week, and dumped them into the interface.

That resulted in exactly the behaviors you’d expect – reps would log in on Monday to review new insights, and then maybe log in on Tuesday to catch something they missed or needed to review. Insights for Friday clients were missed or forgotten because reps didn’t look at the solution again for the rest of the week.

We had a solution that was being used, but it wasn’t really integrated into their daily work. So the first big change we made was to introduce insights in relevant waves aligned with their schedules, so that the rep was encouraged to visit the solution every day.
Differentiated Logic for Urban and Rural Territories
The algorithm had a concept called the geographic center, and it made recommendations for where the rep should focus based on that geographic center. But that concept of “the center” didn’t take into account the differences between urban and rural territories or variations in movement through the territory by day of the week.

At the outset, all the recommendations for a rep in East Texas were geographically proximate to the center of East Texas, which might not be where the rep was going to spend their day. The rep might receive recommendations about physicians to visit, but they were not useful because the algorithm hadn’t taken the rep’s route for the day into account.
We needed to enable the rep to document how they moved through their territory so that the recommendations could in turn be more relevant for where they were on any given day. Rather than creating additional data entry requirements, integration with their existing calendar proved to be the easiest way to do that.

Together, we determined that the geographic center needed to be about the geographic center of the reps route instead – making it route- and user-centered rather than territory-centered. We began to explore the idea of an optimized center of value, which changed in accordance with the reps’ travel plans.
In Closing
By changing how data was ingested and presented and how recommendations were made, we were able to launch a significantly more successful solution, and ultimately an impactful pilot. The success of ZAIDYN Field Insights could not have been achieved if data science and UX hadn’t worked hand-in-hand.

Furthermore, our insights from user research, testing, and iteration were extraordinarily powerful when it came time to tell the story to pilot customers and ultimately in product marketing; we were able to tell compelling stories that we would not have been able to tell otherwise.
Finally, while each of the dimensions of my framework may not be critical for every single project, you can see the benefit of thinking through each of these dimensions as an area of potential collaboration to make solutions stronger through interdisciplinary collaboration.































You must be logged in to post a comment.