eCommerce Analytics

While working on a proposal the other day for a prospective customer, I decided that I’d go the extra length for him in an attempt to demonstrate where exactly the company could make up some ground in its effort to realize a bit more bang for its buck in its email marketing program. That is, the company wanted to make more money from its existing customer base. When I looked at the company’s email marketing statistics, I was surprised to find that their clickthroughs per purchase was much higher than any company I’d seen.

Read Clickthroughs Per Purchase is the Gold Standard for Targeted Email »

Just finished getting through the backlog of my Don Dodge RSS feed today and I’m happy to report that venture capitalists seems to think that businesses like Istobe are about to break out. Let me qualify that. Venture capitalists seem to think that using data to improve e-commerce is an industry that clearly needs some maturing and that maturing time is nigh. Istobe represents that maturing, combining hundreds of models and data integration routines into a package that lets you target the right customer with the right product at the right time.

Investors believe that the maturation in this industry will occur in the next five years. Well, so does Istobe. We believe that it’s time to put your data to use. If you don’t use it, data is no more than the new shelfware: that software you just had to have before you realized you lacked the in-house talent to unlock its value. Istobe is your outsourced in-house data analysis talent that lets you ask simple questions and get answers without analysis, questions like: I need to sell this overstock of shirts, to whom should I market them? In reply, Istobe gives you a list of your customers that are most likely to buy your shirts and the probability that they will buy. This is the new paradigm in predictive modeling that Gartner calls the data mining packaged application. Let’s just take a quick look at the moment in time at which we are poised.

Data collection methods are clearly refined

Nowadays, everyone is sitting on a pile of customer data that they don’t know what to do with. As Rob Hayes, partner at First Round Capital, says in the Stefanie Olsen article from which Dodge draws his inspiration, “Everyone talks about all the data that’s being created and how valuable it is, but the way you make it available is by doing something actionable with it.” The glut of data is due, in part, to years of CRM implementations and the current CRM zeitgeist. You can’t turn around without being inundated by a flood of marketing for “next generation” CRM systems. In fact, I used to be one of those marketers at a not-too-small company that builds Dynamics CRM.

Of course, online everything has made data more prevalent as well. Returning some kind - any kind - of functionality in exchange for your profile is no longer new hat. Every widget and social network known to man requires you to divulge information before you start using it. And then it collects your clickstream as you use the app. Heck, I’ve got at least 50 different login/pass pairs that I need to remember now.

Purchases, as well, fall into this category. With online shopping increasing at a terrifying clip, all of your purchases are more seamlessly collected and tied to your profile and your clickstream, meaning that now, more than ever; pre-purchase behavior and purchaser characteristics - on a large scale - are at a marketer’s fingertips.

Data analysis tools have matured but haven’t turned the corner

So there are various types of data out there right now that need tying together and, ultimately, analysis. But have the tools to merge and make sense of that data improved? Not appreciably. Really, when you get right down to it, the tools used to perform data analysis are still catch-all tools that can build any model you want or merge any type of data you want. But they can’t help you with specific business problems. In other words, the tools exist for database experts (data integration) and PhD statisticians (statistical modeling tools).

For years, these tools have gotten easier for experts to use but haven’t gotten any easier for business users. This means that your $300K worth of in-house data integrators and PhD statisticians have become slightly more productive over time but translating their language into the language of business is as difficult as ever. And turning the data they spit out into a meaningful business strategy is just as tough.

I noticed that the RRW Consulting blog alluded to an article on Friday that I have been promoting to my peers: a research report by the Aberdeen Group (abstract here) that discusses the importance of email personalization. The one-to-one marketing emphasis in the article is precisely the kind of email targeting that we espouse here at Istobe. Today, I want to expand on one aspect of the Aberdeen report that we spend extra time on at Istobe: the importance of the buying cycle in determining what kind of email message to send your customers.

In the Aberdeen article, Ian Michiels mentions that web analytics provide great clues to assessing where customers are in the buying cycle. For example, if a customer invests a vast amount of time clicking about a product group, that customer is likely doing research and is in the market to buy a product in that area. A discount offer, Michiels says, would likely get this customer - who is now highly qualified and advanced in the buying cycle - to act on their desire and make a purchase.

I totally agree with this sentiment. But as Chris mentioned in detailing his experience with GPS systems at Amazon, there is another way to do this. Customers can clue you into what they want via their clickstream. But even if you don’t have clickstream data, transaction histories, once supercrunched, can give you a leg up on finding customers who will likely buy next. In other words, this supercrunching can help you locate the customers that will likely buy before they locate you.

How does this work? Well, other customers have come before them and laid out patterns that aren’t perceptible to you and I but are very perceptible to Istobe’s predictive models. Istobe’s models throw out those customers that are not likely to buy again and then work with those who are. From there, Istobe’s models assign the products that are likely to be purchased by these likely buyers.

I won’t argue that this method is more statistically powerful than clickstream data, which is a solid indicator of future behavior. But I will argue that clickstream data takes vast amounts of resources to capture and use, a difficult proposition for online retailers who are just dipping their toes into analytics. And using transactional data to predict who will buy next is a more proactive approach. So what do you get from that proactivity? Probably a two- to three-month head start on your competition. You can focus on targeting your “most likely” customers with act-now offers while your competition waits for these customers to visit their web site.

We talk a lot about the nuts and bolts of predictive analytics on this blog - how we build customer analytics models, how we interpret them, and how we establish whether or not they’re working in production. However, one item we have yet to tackle - and a very important item at that - is how to integrate data mining and/or predictive models into your organization and your company’s routines. Indeed, the black box in the middle should be the necessary data integration (getting the data into the right format for the models) and running a bevy of models against the data to see which one projects as the most effective. But it’s the before and after this black box that really make or break any attempt to incorporate predictive models into a company’s processes: data collection and incorporating data mining results into your processes.

Do you need to collect more data than you already have?
The main problem that companies run into is the need to collect more data in order to build the necessary predictive models. For example, if a company wants a model that tells them which of their products a specific customer might buy next, does it already collect the data necessary to support a model that does that? Ultimately, the question is: Is it worth the time and cost needed to invest in collecting more data that may not yield any better results when supercrunched? New collection methods take months to set up and sour clients on predictive models before the fun has even begun.

We believe that it’s important to try to work first with the data that our clients have and add new sources of data over time. This is a handy tip for business users who really want data mining to work in their organization: start small by using the data you have and get more sophisticated as you go. I know it may be tempting to put in that clickstream collection database right now so that you can use online behavior to segment and market to your customers. But trust me, get the buy-in from your organization first by proving that predictive customer analytics work. Then ask for the stars.

Are you ready to completely change the way that you do direct marketing?
Some companies would have you subscribe to a whole new way of doing business in order to use their models. Customer-centricity is my favorite new business philosophy. Though I firmly agree with the need for firms to be customer-centric, is it realistic to expect companies that use offers, coupons, and holidays to draw new and existing customers to their websites - and have for years - to change their direct marketing approach to accommodate a new set of tools? Not really. Company culture and routines are slow-developing and even slower-changing.

So the question at the end is really: What are you going to do with all this newfound predictive power? How are you going to fit in customer-centric model results - We’re 99% sure that Brad Pitt will buy two Baby Bjorns with lumbar support - to your next email blast that has a summer theme and features hats and sunscreen? And what about the extra creative necessary to relay that customer-centric message? You’re going to have to make a new email blast featuring the Baby Bjorn with lumbar support, in addition to the summer-themed email.

Well, I’m pretty sure that the summer themed email blast was probably going to draw some business but I’m also positive that luring customers with what they want when they want it is a lucrative way to market. The best practice is to initially skim the cream off of the predictions, to take those that have the highest probabilities of succeeding, and run with them. Collect a group of customers that has the highest probability of buying the Baby Bjord - Mr. Pitt among them - and send an intermittent email to just that group. Now watch your open rates and clickthroughs soar.

The knock on B2B data mining has always been that there isn’t B2C-like data available. Instead of multiple transactions that give us customer behavior patterns, we have company demographic information (industry, company size, revenue), some information about the person from the company who we’ll deal with (position/title), and where that person came from (lead source). It’s not behavioral data, which we know to be inherently better as a predictor than demographic data. But some data is better than none, right?

And we can certainly create transactional data that gives us some behavior pattern. If we throw in the contact schedule - the touches - from your company’s representatives, don’t you have a transactional pattern of both buying and non-buying customers? Coupled with the demographic data, you can drum up a model that predicts how many touches a lead might need to become a client and maybe a best guess at the path that should be pursued with a new lead.

More to the point of this post, this is the great thing about click-through data: it has a transactional quality. In fact, it just might be the transactional data for B2B companies. (Aside: This is also one of the reasons why companies like Omniture are becoming so notable: they provide some behavioral patterns, however small.) If we can combine click-through patterns from the person representing the prospect company with the company’s demographic information, then we might have a real interesting model that determines just how serious a lead is about buying from you and their company’s relative experience level with your product area.

Let me close out this post by refuting two of the main complaints about B2B data and its unsuitability for data mining-based models.

There’s Not Enough Data

Everybody loves data mining when it comes to consumer-focused companies. The vast amounts of transactional data are transfixing. The thinking goes something like this: “I’ve got hundreds of thousands of transactions here so whatever our predictive model spits out must be right.” Well, this may be true. And it mayn’t. But that doesn’t make a model built with less data any less compelling. It just means that one model has more data points. Don’t feel inadequate for the difference. Just make sure that you have data that’s important to the business problem you’re trying to solve. For example, if you want to know the next-best product for newly-minted customers, then you’d better have a solid set of second-time customers who bought a bunch of different products. Do you need thousands of these second-time customers? C’mon.

Missing and Bad Data

Isn’t this a reality everywhere? Even consumer-focused companies (with hundreds of thousands of transactions) have this issue. Oh, and I have a suggestion on what to do with that missing and bad data. Throw it out. Chances are, it will have absolutely no effect on the predictive models, unless of course all of the missing or bad data has a common characteristic that isn’t found in the rest of the data. For example, let’s say you’re building a model that predicts the next software product that a first-time customer might want from your company. Well, if everybody that bought a specific product as their first purchase is missing a zip code, then you can’t very well throw all of those records out. It would skew the model irreparably. But as long as the missing data is evenly distributed throughout the records, don’t be afraid to trash ‘em.