
With both large real and hidden opportunity costs associated with evaluating, implementing, and learning the quirks of a new analytics tool, it only makes sense to ensure that the tool one chooses will be able to keep pace with one´s future requirements. So in order to evaluate tools correctly people need to be aware of the changes that are occurring in the online world as this will influence what data will be important to collect and leverage in the future. In this article I wanted to outline some of the top trends that are impacting the online marketing world so that when someone makes an analytics tool evaluation they are creating a framework for the future.
Part 1 Setting the Scene: Data Trumps Everything
We can even take a step back before this evaluation process to ask on a high level whether the benefits in general of implementing an analytics solution outweigh the costs. The answer becomes evident if we look at the events that have happened in the last year; in 2009 more people than ever agreed that data driven organizations are much more effective than those based on HiPPO (Highest Paid Person´s Opinion) or other strategies.
A March 2009 Accenture Survey of executives working at U.S. companies with annual revenues of $500 million or more found that high performance businesses are five times more likely to use analytics than lower performers. Additionally, 70 percent of high performers identify analytics as a significant decision support tool.
The overarching example is Google: Marissa Mayer, EVP, has said that "we let the math and data govern how things look and feel" and this policy has made them extremely successful. The extent to which this is true can be seen by an article on the front page of the business section of the New York Times on May 9, 2009, that quotes employee Douglass Brown saying that he could not even decide whether a line on a web page should be 3, 4, or 5 pixels wide until he had tested all 3 versions. In the end, Brown left Google since the engineering culture was "not friendly to designers" since all of his decisions were asked to be backed up with data. This was only newsworthy because Brown argues against what has become acceptable practice at Google as well as other high performing businesses: data trumps everything.
In fact, in the last few years, data driven decision making has been validated for all size organizations. For a larger organization with significant amounts of traffic, making even the smallest changes can have quite a large positive impact on revenue. "More is different" due to the large volumes of traffic involved. Therefore, it is important for a high traffic site to find an analytics tool that can handle billions of transactions while presenting granular data in order to make decisions and analysis based on more detailed reporting. For example, it might be interesting to have more detailed knowledge of all of the marketing initiatives that contributed to a sale besides what happened during the last click in the last session before a purchase. Or it might be interesting to know exactly which customers put which items into their shopping carts and then abandoned them, in order to send follow up email marketing campaigns.
On the other hand, a small, start up organization can also use an analytics tool with equal effectiveness. One way would be for the product manager to measure how much additional traffic is gained by adding different features and later doing some comparative testing to understand which feature sets are optimal. Then as one works to grow traffic, the marketing manager might also use analytics for tracking the effectiveness of email campaigns and ad inventory. In fact, Andrew Chen (a former Entrepreneur-in-Residence at Mohr Davidow Ventures) recommends viewing analytics as a necessary tool to be used during your start up product development process, no matter how small your company might be, in order to confirm or deny assumptions you have made on why people stay engaged on your site. He asks, "in reality, is it better to build 10 features where you do not know what worked and what did not, or is it better to build LESS features but have a clear sense of why it worked?"
This is Part 1: Data Trumps Everything of a Five Part Series; See also Part 2: the Real Time Web Reality, Part 3: Data Filtering and Visualization Capabilities Matter, Part 4: Data Privacy Demands more Diligence, and Part 5: Free Redefines the Market.
Part 2 of Framing the Future: the Real Time Web Reality
The most important trend this year is the advance of the "real-time" web, because this concept has changed the products and strategies of almost every major Internet company in 2009. In fact, it has become a core part of many Internet products this year: Twitter, FriendFeed (now Facebook), Facebook itself, Google, Delicious, Wordpress, and many more.
However, the "real-time" web in 2009 is a bit of a misnomer, because real time implies both real time immediacy as well as the social graph associated with it. Real time is immediate in terms of "what are you doing right now?" updates, but the social graph portion makes it also a great indicator of the trends, interests, topics, and intentions that will ultimately lead to additional revenue streams as companies learn to react.
Think of the rapid changes that create additional revenue streams in e-commerce, travel, news, and retail sites today. Now think of the flood of additional real time feeds and applications that may impact your ability to sell or disseminate PR now or in the near future. Even if you do not have a real time web oriented business, your current and potential customers are using "real-time" communication devices to talk about your product or services. Ideally an analytics tool should also be able to scan social media for positive and negative sentiments and then incorporate this data into your analytics dashboard. So it makes sense to find a tool that also has the functionality to track and present social graph data in order to position your company to be able to respond appropriately.
As for the benefits of immediacy, the time when management used to fear expensive mistakes is over because when resources are cheap and digital you can take more risks and fail fast. So even though some may argue that real time data might be messier, the pivoting ability for your company and your marketing channels can be made much faster. You will be able to tweak features, ads, and marketing campaigns in a faster time frame. In other words, if each person can monitor in real time how certain segments are reacting and then make the appropriate adjustments the repercussions can be more beneficial than doing the same adjustments in a lagged time frame.
Thus, as the internet eco-system changes around us, the real time web combined with social media will become increasingly important. So one should evaluate an analytics tool on whether or not it can enable (now or in the future) your employees to have access to real time data so that they then can at least have the possibility to create more revenue-enhancing responses.
Part 3 of Framing the Future: Data Filtering and Visualization Capabilities Matter
As we are increasingly becoming more accustomed to the ease of use and nice visual displays offered by iPhones and Google Maps, we will definitely start to demand that these same types of interfaces be available from our analytics applications.
Therefore, if an analytics tool is able to present data in a visually intuitive, easy to understand format, the end users of that data are much more likely to be able to take action on the information. A good example of data visualization from an analytics tools would be the use of heatmaps, which are overlays on any webpage that can visually display where people clicked and where they did not - even in areas that are not hyperlinked. This gives any web designer immediate, clear feedback about what is attracting clicks and/or what the visitors think should be clickable. Ideally, a heatmap should also be configurable to display any variety of different groups´ behavior - i.e. where purchasers vs. non-purchasers clicked, where two different marketing campaigns visitors´ clicked, or where people clicked that came from different cities or different search engines.
In addition, a nice analytics tool visualization is the website overlay view, which can also show how many clicks happened on each link and then should have the capability to drill down on these clicks to see much more detailed views (what campaign, what search word, what geography these clicks came from, etc. ) Or an analytics tool could visually show the path that the visitor took through each page before converting into a buyer, or which marketing channels the visitor clicked on before the sale. Any graph that makes the data easy to understand and interpret will add value by enabling the analyst to find useful insights.
Equally important to the visual display is the filtering capability offered by your analytics tool. Since typical tools tend to aggregate and integrate information, tools that offer the ability to filter the data first and then transform it into easy to use bits of information with nice visual displays will outperform the others.
As Greg Boutin says, "just like Google became the doorman to the web because it filtered things better than others. Filtering, not aggregating, is where the money is. Not more [information]..just smarter."
As we generate and collect more data, the filtering and visual display of it enables the end user to make sense of it and leverage both the aggregate trends as well as the appropriate detailed views in order to take appropriate actions. Of course, the intuitiveness of the reports is in the end just aiding the analysts to do the job that they still need to do: interpret and analyze the data that is being collected.
Therefore making sure your analytics tool has the ability to convey a message with useful visual display of the data should definitely be on the list of factors to consider.
Part 4 of Framing the Future: Data Privacy Demands more Diligence
As personalization becomes more the norm, a lot of focus is also going to be given to the trade-off between personalization and data privacy in the near future. As each step in bringing together the open standard web creates easier opportunities for organizations to link together (and perhaps abuse) personal information, there might be more incidents like the one that happened to Google Document users last March 7th. On that day Google inadvertently shared spreadsheet information with peoples´ contacts who were never granted permission to see them. Google admitted that "we've identified and fixed a bug which may have caused you to share some of your documents without your knowledge," but these types of bugs could have serious repercussions for the people affected and for legal compliance rules.
In fact, the data privacy laws are also changing in response to the technology. In Germany, there has been a lot of discussion lately on whether or not using Google analytics is even legal since tracking and storing an IP address is considered holding onto personally identifiable information, which is not allowed by German law. Google´s terms of service do state that "Google will not associate your IP address with any other data held by Google." However, according to paragraph 15 "Modifications of the rules" "Google reserves the right to change the terms and conditions of this agreement at any time [...] [...] [...assuming that the changes taken into account [by Google] are reasonable for you." In sum, Google is sitting on a treasure trove of linked data that they could potentially use in the future in ways that might violate data privacy laws. A German lawyer has even said that it is possible that the "penalties could amount up to €50,000 (about $75,000) per website that uses Google Analytics to keep track of its visitors' usage patterns."
So it will be quite interesting to see how this will play out in the next couple of years.
The expectation for Germany is that more conservative companies may start to require that their analytics providers have a TüV certificate, which is similar to a data privacy seal of approval. This will require that the company uses only anonymous IP addresses, that they are also offering an opt-out cookie capability, and that they only use servers that are based in Germany. At the minimum, more companies may also start to require that they are the rightful owners to their own analytics data, so that they are mitigating the risk involved with passing the data through a 3rd party tool and can at any point get all of their data returned upon request. Thus, any company should probably include in their analytics evaluation process both the question of who owns their data and how compliant their current tool is with the changing legal landscape.
Part 5 of Framing the Future: Free Redefines the Market
And last but not least, we would be amiss if we did not address one of the biggest trends impacting the online analytics landscape in the last few years: the introduction of a free tool into the mix. Google is definitely re-defining the market and we will see a new role emerge for paid tools in the era of abundance of free analytics applications. Free enables value to migrate to the next highest level.
Companies will now look to the paid tools to address more complex issues and demand that their quality overcomes the price hurdle. But free does not diminish the paid tools; rather it can be seen as a complement to existing paid tools as it opens the doors to new prospects that would otherwise never hear of or try out analytics. In fact, free tools should be embraced by the paid tools providers as it enables education, awareness, enlargement, and validation of online analytics. People will always pay to save time or mitigate risk, so the paid tools can address this with better set up and service and ongoing, guaranteed privacy or data ownership, which can make the total cost of ownership of a paid tool even less than a free tool in the long run. (i.e If you are using a free tool but then need to invest heavily in consulting for customization or exporting of the data, your total cost could be higher than a paid tool that has intuitive capabilities or includes data exporting; additionally, if you are using a free tool but are then sued for not adhering to government required standards of privacy, then again the free tool might also cost quite a bit more than the paid tool in the long run.)
It is the responsibility of the paid tool providers now to make sure that their tool offers more value, or data privacy guarantees, or customizable service, or less risk, or more real time capabilities. In sum, there will now be a real difference between entry-level versus an enterprise level tool. The paid tools will now be required to be highly configurable and flexible in order to meet the educated demands of future users that are more aware than ever of what they should/or should not be paying for in an analytics solution.
Thus, anyone considering a new analytics provider in 2010 should be aware of the preceding trends and incorporate them into their decision making when evaluating an analytics solution.
About Cecily Robyn Lough
Cecily Robyn Lough is currently Director of International Sales at Webtrekk GmbH in Berlin, Germany. She has over 15 years experience in pulling actionable insights from online marketing data.
Please contact her for more information via Webtrekk at info@webtrekk.de and LinkedIN.