Google Analytics Internal Site Search Reporting

If you were one of the lucky few who asked Google to include you in the internal search reporting beta then you’ll be happy to know that they’ve now added the functionality to those profiles! How do I know? If you’re as addicted to looking at your Google Analytics profile as I am then you’ll have noticed that sometime around 11:00 PM EST (GMT -5), a funny looking button under your content tab appeared labeled “Site Search”.

What do you mean by “site search”?
Oops! Look what’s shown up in Google Analytics!

Let me do a quick segment on why, if your site has an internal search engine, you owe it to yourself to configure this reporting right away.

Why should I care?

Unless you’re using a free or open source tool out there (i.e. Google’s Internal Search Engine), you’re very likely spending an awful lot on a search engine like Endeca. Knowing wether or not your internal search engine is actually bringing value or not is a critical question to have answered.

Here are the questions I’m currently asking about internal search and here’s how Google Analytics can now provide the answers:

  • Are people even using search? – Google Analytics reports the number of visits that included a search (=number of visits that used your site‘s search function at least once). Divide this into total visits and you have what I’m calling a Search Usage Rate, the definitive metric to answer “Is anyone even using this thing!?”
  • Is search helping people find things? Are people just getting lost? – Google offers about three metrics that help to answer this question:
    Results Pageviews / Search (=Pageviews of search result pages / Total Unique Searches) – also known as the number of results pages that users are flipping through. Clearly an indicator of your search engine’s ability to deliver relevant results people want, is how many pages of results they need to look through before they find what they need. In my humble opinion, you should strive to have this metric be 1.5 results pageviews / search or lower.
    Search Exits
    (=number of searches a visitor made immediately before leaving the site) – to borrow a quote from Avinash, this metric measures the effect of “I came, I searched, I puked, I left”. Clearly if your engine is delivering relevant results then people shouldn’t be exiting your site from search results! Thus I’ll go on record saying this is the most important metric to measure the relevancy of search results.
    Search Refinements (=number of times a visitor searched again immediately after performing a search) - a bit of a tricky metric, the number of refinements that a visitor to your site performs in their search for content / products / services is definitely still an indicator of relevancy, but I wouldn’t worry about this one as much. Very often I refine search terms in my head as I’m looking for something as I realize the original thing really wasn’t what I was looking for. This doesn’t mean the search engine’s results weren’t relevant to my terms, they usually are! But more often the search engine actually guides me to think, “Oh yeah…that isn’t really what I was interested in…let me try that.” Clearly if your search engine automatically suggests other terms (i.e. auto corrects spelling mistakes), this will also help out!
  • Is the search engine truly helping people on my site and making me more money? – Although I’m sure I’ll get some arguments on this, Google Analytics now answers this with two metrics (both of which need to be taken with a grain of salt):
    Time after Search (= average amount of time visitors spend on your site after performing a search) and
    Search Depth (= average number of pages visitors viewed after performing a search)
    - on a content-based site, if search did its job, it helped users find the content that they wanted and that results in a great and more engaged experience. An engaged experience means longer time on site and longer pageviews per visit.
    Segmentation Kicks Butt!
    Using Google’s new Site Search segmentation report, you can even get a answer to the question, “Are visitors that use search more engaged or higher value than visitors who don’t use search?” That to me is just amazing! Now you have hard and fast numbers to use to either invest heavily in that heavy-duty search engine or say, “You know what guys? It really isn’t worth our time.”Google Analytics - Site Search Segmentation
    On an e-commerce / lead generation site, you’ll need to establish a threshold of what a comfortable range of time after search and search depth are for your site. High values for either of these metrics could imply that visitors didn’t find what they needed from search and just got fed up with it afterwards. On the other hand, using the segmentation abilities that Google now has for Site Search (shown above) you can get an answer to the most important question for any e-commerce site, “Did this site search thing I spent $x make a significant return?”

So what’s the “Big Picture” for Search?

From a bit of previous experience with this kind of thing I tend to say you can look at three big categories (from my previous posts, you’ll know I’m big on this kind of thing) of metrics that I find help to map the strategy of what search is supposed to accomplish: Usage, Satisfaction and Value.

Usage

Are people even using your search engine? Maybe the search box isn’t prominent or maybe your categories are too confusing. These metrics help you answer if there’s a problem and provide a means to monitor your optimizaiton efforts.

  • Visits with search
  • Total unique searches

Satisfaction

Are visitors satisfied with what they get from their search results? Finding a search box is one thing, but getting the right results is another! Luckily there are a host of metrics here that truly tell you if your search engine is doing its job. If these metrics start to slip you may need to look at how your search engine is indexing content, the categories available for people to search on (taxonomy) and automatic corrections available in your search engine (i.e. correcting spelling / grammar mistakes).

  • Results pageviews / search
  • Search Exits
  • Search Refinements
  • Time After Search
  • Search Depth

Value

Otherwise known as Return on Investment, if you’re spending a lot of money on your internal search engine wouldn’t it be nice to know that it’s making money for you?

ROI: Content-based Sites

Believe it or not, calculating the straight revenue your search engine is technically responsible for is easy!Calculating the “return” portion of search for content-based sites
Once you’ve got this amount you’ve got your benefits, subtract the costs of the search engine and divide this into those costs and voila! Return on your search investment.

ROI: E-commerce Sites

For once, you guys have it easy! :) Using Google’s search segmentation report you can see exactly how much revenue visits that included search were responsible for. Giving you not only a way to calculate internal search ROI but also determine revenue contribution of your internal search engine.

ROI: Other site types

It gets a bit more fuzzy for additional site types, but using Google’s segmentation reports and assigning value to goals within Google Analytics, you could theoretically calculate exactly how much value your internal search engine provides, which is the first step towards calculating ROI.

Wrapping Up…

Of course the new functionality offers even more reporting, but analysis has to start with a big picture view, or else you’ll get bogged down with ‘analysis paralysis’. I think the tips above provide that “top-down” view that can help focus your analysis of internal search before getting lost in an expanded set of reports.Please feel free to leave some comments! I’d love to know what everyone thinks!

Posted in analytics vendors, google analytics, news | 2 Comments

WebTrends CEO let go

Can’t say this isn’t an industry full of change…

In another surprise announcement from the web analytics industry, Greg Drew former CEO of WebTrends has been let go. See the full article here and see the interim WebTrends management team here.

Oddly enough, Greg gave the keynote speech for WebTrends Score at this year’s eMetrics summit in Washington D.C. and I don’t believe at that time he was aware of any news.

A number of former WebTrends employees apparently believe that a quick sell of the company is imminent. Something I find interesting considering given the recent announcement of Omniture’s purchase of Visual Sciences.

Don’t let anyone tell you differently, web analytics is a fast and dynamic (don’t you hate that word) industry right now!

Posted in analytics vendors, news, webtrends, webtrends sdc | 1 Comment

eMetrics Summit: Day 2 of 3 – New Version of Google Analytics!

Inside the eMetrics SummitI know I know, I’m a bit late on delivering the posts for the second and third day of the summit but I’ll be honest, after day 3 I was actually feeling pretty beat and being my first time in Washington D.C., I wanted to enjoy my stay a little too! Day 2 of the summit was another complete success and aroused some really interesting debate and discussion with colleagues and practitioners.

Google Analytics NEW Version!
down arrow

Keynote Address: Counting on Customers

Presented by Rachel Scotto, Executive Director at Sony Pictures Entertainment, this was a keynote that spoke right to my heart! A frustration I’ve lamented for a long time now is that the web analytics industry is seriously lacking a solid group of people who understand and know media inside and out.Rachel’s speech was great and really gave people an idea of practical examples of things that matter to a major media organization like Sony. Working for one of Canada’s largest media organizations it was obviously great for me to hear. Some interesting points of out Rachel’s presentation that I’ll try to summarize:

  • Integrate your Various Marketing Metrics: it’s a common theme of what’s being called Web Analytics 2.0 but it makes sense. Rachel’s suggestions are to look at ways to include: Web Analytics, Primary and Secondary Market Research to get a 360 degree view of your media landscape.Primary Market Research – Online Surveys (check out Foresee Results and iPerceptions), Usability Testing, Focus GroupsSecondary Market Research – subscribe to analyst resarch services like Jupiter Research, Forrester and eMarketer as well as augmenting your competitive intelligence with Neilsen NetRatings, comScore and HitwiseTools that she’s used to achieve this view in the past have been: Hitlist (excellent competitive intelligence tool, but unfortunately no Canadian data yet), Accrue, WebTrends, SiteClarity by Cheetahmail
  • Carefully Consider Analytics Vendors: make sure during your Request for Proposal (RFP) process to look at the level of customization that your web analytics vendor provides as well as the ease of being able to transfer knowledge to a new group of people. If your development department is showing some high turnover, this point becomes even more crucial
  • Analyzing for Buzz!Use Search to Measure Buzz – as Sony releases a ton of great movies, it’s important for them to get a feel for which are going to be a hit or a flop at the box office. How do they do that? They check out the performance of movie title search terms in the weeks / months prior to the movie’s release.Mike’s Recommendation: Create a “buzz” index by measuring not just these search terms, but the amount of direct traffic coming into as direct traffic = brand awareness!
  • Create a Secondary Research Library: if you really get into secondary research then get organized! With a tool like Microsoft Sharepoint or something similar, create a content grouping structure like the one below and any time you or your group find something interesting, drop it in!

Categorize your secondary research!

  • Create and USE Report Formatting Guidelines: spend a single day with your team and work out what the conventions will be for all reports that anyone generates. Get descriptive and include things like allowed colour palletes, fonts, layout and suggestions of where to use visual displays to support analysis.
  • Blown Away By Tagging With Web Analytics? Use A Phased Approach: Don’t try to get everything when you first tag your site, sometimes it’s completely acceptable to go with a phased approach.Phase 1 – Get the basics: Get the analytics tracking code on all pages of your site. Even if your site is completely Flash based (see my post on tracking Flash-based sites), isn’t it better to have some data rather than nothing to make decisions? After all, putting just that basic tag on would still accurately report on unique visitors and visits, data you can use to make some informed decisions with!Phase 2 – Get Advanced: try to track your Flash content, message boards and podcastsPhase 3 – Get REALLY Advanced: tracking some of the more complex features on your site like AJAX applications

NEW Version of Google Analytics to be Released!

That’s right! A new version of Google Analytics is on its way (see their official announcement) and with it you can expect:

Internal Site Search Reporting

I should note before going on that Avinash has a great post on this.

Google Analytics - Internal Site Search Google Analytics - Internal Site Search Reports Google Analytics - Internal Site Search Reports
What do you mean “Internal Site Search”? “Internal Site Search” Report Example 1 “Internal Site Search” Report Example 2

The new version of Google Analytics will offer a full report suite for optimizing internal site search. From the pictures above (sorry for the quality), you can see that with this new version of Google you’ll be able to get metrics like: Visits with Search, Total Unique Searches, Results Pageviews per Search, Search Exit Rate, Search Refinements, Time After Search, Search Depth and more! Although all of these metrics are really useful, I’m probably most excited about “Time After Search” – I see this metric as one of the most important for answering that question as to whether or not site search is really providing your visitors with value. Now granted, the argument can always be made that higher time on site could actually mean that internal search has only sent your visitors lost and searching (ha…ha…ha….).I’ve contacted Google and signed up for the beta release of the new version so with any luck, I’ll have some great screenshots up shortly and more information around this.

Web 2.0 Event Tracking

Google is (I think) the first vendor to really think Web 2.0 tracking out (or at least give it a first stab). With a lot of foresight, Google’s seen that in this Web 2.0 world, measuring everything against a fundamental unit like the “page view” just doesn’t make any sense. So instead in Google’s model we’ll measure: Objects, Actions and Labels.

Google Analytcs - Event Tracking Google Analytcs - Event Tracking Google Analytcs - Event Tracking
What will I use this Web 2.0 tracking for? The Google Web 2.0 Tracking Hierarchy What does Google mean by Objects, Actions and Labels?
Google Analytcs - Event Tracking Google Analytcs - Event Tracking Reports Google Analytcs - Event Tracking Reports
A look at the code… Web 2.0 Reports Example 1 Web 2.0 Reports Example 2
Google Analytcs - Event Tracking Reports  
Web 2.0 Reports Example 3

With a few additional JavaScript calls in your Web 2.0 objects (be they AJAX, Flash or whatever), you’ll be able to measure these objects with much greater precision than before without incrementing your page view numbers!On any site this is incredibly important as with most analytics vendors right now any Web 2.0 tracking could end up in a greatly overly inflating your page view counts. Well when you go from 3.00 page views per visit to 10 page views per visit, how much of that activity is really true organic page views?!I really do commend Google on this one for at least taking a stab at this hierarchy and being the first vendor (that I’m aware of) to propose a complete Web 2.0 tracking model.

Outbound Link Tracking Without Tags

A feature that I’ve actually built into my Google Analytics Tag Generator tool (to be released shortly), the new version of Google analytics will offer the ability to track outbound links without adding to page view counts! A few other vendors have already implemented this type of thing but I’m really glad to see that Google has decided to do the same thing.And of course, on top of just tracking these outbound clicks differently, Google will provide a new report section around these activities.

Google Analytcs - Outbound Link Tracking Google Analytcs - Outbound Link Tracking Reporting
What do you mean “Outbound Links”? Outbound Link Reporting

New Optional JavaScript “ga.js” File

Google Analytcs - New Optional ga.js FileOf course the ability to track all of these wonderful new features requires an upgrade to the core JavaScript file that Google Analytics makes use of. So instead of updating the file that we all use (urchin.js), Google has opted to create their own JavaScript file (ga.js) which needs to be included in order to track the new features mentioned above: Outbound Links, Web 2.0 and Internal Search.If you choose not to upgrade your script, you will still be tracking your traffic, you just won’t have access to the new features. Also included with

Free Site Scans from Epic One

Free Tag Validation from EpikOneIn a previous post, I provided a link to a tool developed by a young man that checks to ensure your site is properly tagged with Google Analytics. Google has now announced that with its new version, EpikOne will be providing a free tool that will validate your site for Google Analytics tags.The tool will crawl your entire site and search every single page looking for the Google Analytics tags in the source. At the end of the day you get a report that lets you know which pages aren’t tagged. Your site doesn’t use Google Analytics? No worries! The folks at Maxamine have a similar tool that does the trick of validating analytics tags and much, much more (it’ll validate your ad tags too!). Mike’s Suggestion: Make this tool a part of your process by including it in your QA process for every single site update. After all, what good is launching a single thing on your site if you can’t measure and assess its success?

Urchin Software From Google Now In Beta

Google Analytics - Urchin Software from GoogleGoogle has also announced that they’ll be offering Urchin Software from Google. An announcement that as I understand it many people have been waiting to hear from Google. Just a few points to summarize about the release:

  • Software will be offered at $2,995 USD (sorry everyone, not free)
  • Urchin Software will be provided free if you bought “advanced support”
  • If you’ve paid for Urchin 5, every dollar that you’ve spent there can be applied to the new Urchin 6 offering
  • The new offering will be sold and supported by Google Analytics Authorized Consultants

That’s it for now

There was a lot else that happened on day 2, but I’m going to break that down into separate posts over time…this one has taken a lot out of me!

Posted in news | Leave a comment

Omniture to Acquire Visual Sciences

In a move that was a little surprising (but I suppose not overly surprising considering the consolidation seen with WebSideStory and Visual Sciences), Omniture has announced that they’ll be acquiring Visual Sciences for approx. $394 million.

See the full press release here http://www.omniture.com/press/417 or here

http://www.visualsciences.com/press/20071025/1/

More News on the Merger

Biggest news on the conference call I’ve heard:

  1. Omniture will immediately convert licensing structure of Visual Sciences from perpetual licenses to term licenses (similar to that of WebTrends) - licenses will not be converted for existing customers
  2. Two products Visual Site and Discover will continue on as Discover and Discover onSite but will look more alike over time – meaning they’ll throw in some parts of Visual Site, but over time, it’ll be only one offering for advanced segmentation
  3. HBX is essentially going away eventually (after the close sometime in 2008) and new customers will be offered SiteCatalyst while current HBX customers will continue to be supported – for the time being however, HBX is still being sold to customers
  4. Pending Government and shareholder approval, deal will be closed in the first half of 2008

More interesting news on the merger – Omniture estimates that the web analytics industry is a $3-4 billion dollar industry with only 50% penetration. The proposed strategy for the merger is expected to bring the following benefits to customers (and shareholders):

  • Increased market opportunity – obviously there are some instant revenue advantages to inheriting all the customers that currently belong to Visual Sciences
  • Increased efficiency – in Omniture CEO Josh James’ words, Omniture plans to “rationalize expenses” between the two companies specifically expenses as they relate to “duplicated resources”. Obviously this is going to be the case with almost every merger, but it’s never great to hear about the possibility of people loosing jobs
  • Increased scale – the additional revenue grab that Omniture gets will (apparently mean) additional investment in research and development, marketing and sales – get ready for Omniture commercials! :P

Opinions on the Merger

My personal feelings on this merger are a bit mixed actually. They’re both tools with great features and with that you think, “Hey! Imagine all the cool stuff they’ll be able to throw together!” But on the other hand, in market where there are only 4 big enterprise players to begin with, cutting things down to 3 means oligopoly and oligopolies mean collusion and collusion can mean a lack of price competition.

I’ll hold off on making too much of a judgment call on this just yet, but I have my worries.

Survey Time!

What should Omniture and Visual Sciences call the new company?

OmniSci

OmniSciences

Visuture

Visiture

Webniside

Webnisci

Webniture

View results

Free poll

Posted in analytics tools, news, omniture, visual sciences | 3 Comments

eMetrics Summit: Day 1 of 3

The White House - in Washington D.C.!Greetings everyone from Washington D.C.!

I’m very pleased to comment that the first day of the eMetrics summit has been a complete success (at least for myself). The day started off with a quick update on the Web Analytics Association presented by Richard Foley. Not a whole lot new here, just an update showcasing that the association is starting to grow into its own and that 2007 has been a year for a pretty dramatic increase in membership. A great metric to me demonstrating that web analytics is definitely starting to be a substantial interest in many organizations and one that they are willing to invest heavily in.

Before I move onto another huge point I’d like to draw attention to is…(and I really want to stress this):

eMetrics Is Coming To TORONTO, ONTARIO, CANADA!

eMetrics is Coming to Canada!

You heard me correctly! After I’m sure many Canadians in the online industry trying to convince others of a thriving audience for an eMetrics summit, Jim Sterne has apparently heard us! The conference will be held in early April (1-3) in Toronto and will be composed of:

  • 1 day Web Analytics Base Camp led by the Web Analytics Association – a great resource for all of you out there who still feel uncomfortable with the “big picture” of web analytics or even the terminology used by many of the tools
  • 2 day eMetrics summit – I know I know, why do the other locations get three days? Well I guess I have to give it to them in that we have a smaller audience but even still!

This summit plans to be targeted to a broader audience out there as the analytics market in Canada is largely unknown and the WAA is trying to not be elitist and leave anyone out.

Keynote Address

Web Analytics 2.0 - Jim Sterne - Think DifferentJim Sterne gave a great keynote address entitled “Think Different” (inspired by Avinash’s post and image (see right)). In truth, I didn’t actually take many notes during the key note but Jim largely addressed issues around what’s now being called “Web Analytics 2.0″. A term referring to the emphasis to go beyond evaluating site success on just clickstream data and an effort to try to get that 360 degree view of you visitors. Avinash does a much better job explaining the strategy in his post, so I’ll leave the rest to him.

Microsoft Gatineau Preview

I’m very happy to say that today I was part of the privilaged few that got to see the first public demonstration of Microsoft Gatineau. For those of you who are unaware, Gatineau is Microsoft’s answer to Google Analytics and will be provided as a free analytics tool for all to use (provided you have an adCenter account).

Overall, I really liked what I saw of their offering. In particular, the more advanced options they offer in terms of visually modeling clickstream data as well as visitor segmentation (made possible by tying in Live ID profiles), will differentiate them enough from Google Analytics to provide some companies with a reason to switch over.

Another nifty differentiator is a tool that Gatineau has built in that will automatically tag your site for you. The demo we saw today accesses your web server via FTP and then checks the files on your server for a closing </body> tag somewhere in the page. When it finds one, it simply inserts the Gatineau code and you’re done! Imagine that, even less IT involvement than ever before! Obviously this tool will have it’s flaws on CMS driven or dynamically generated content, but still a very neat offering from Ian Thomas and his team.

Breakaway Session #1: R.E.A.L. Reporting for the Real World

Presented by Jennifer Veesenmeyer, I found this session a bit to rudimentary for my tastes but I think a lot of people got value out of it. The session largely focused on extremely applicable tips-and-tricks in order to shorten the pain in everyone’s butt which is producing reports. On top of that, Jennifer also went into some real world ways of changes you can make to your reports in order to convey only the most important information in a organized and coherent manner.

Her second session in the day provided some great insights on not only shortcuts to producing highly effective reports, but suggestions on how to get management buy-in to those reports in order to make decisions.

Again, my only problem was just that I knew most of the tips and tricks discussed, but otherwise I thought it was a great session!

Breakaway Session #1: Rethink SEM / PPC Analysis: Ego Bidding, Cannibalization, Long Tail Exploitation and More

Finally I got to see Avinash Kaushik present in person and he is just as enthusiastic, fun and animated as I’ve seen him on any of his videos. As I told Jim Sterne, Avinash’s session today alone made eMetrics worth the investment in my opinion. Although I don’t want to go into too much detail, Avinash presented 6 things to think about when looking at SEM and PPC campaigns:

  1. Measure bounce rate – when running SEM / PPC campaigns, don’t measure clickthroughs. A click is useless if, as Avinash states it, “they came, they puked, they left”. Although I’m in agreement with this completely, remember to go one step further. A low bounce rate on a campaign only implies that a visitor went > 1 page deep. Make sure to look at pageviews per visit and visit duration to make sure that you’re evaluating true measures of engagement and to an extent, satisfaction.
  2. No more ego bidding – stop worrying about bidding for spot number one if that spot is producing the worst qualified traffic. What is qualified traffic? Like I mentioned above, qualified traffic can be defined as “sticky” traffic or traffic that completes the goals you have set out on your site. Use tools like Google Analytics to not only evaluate which positions are bringing in traffic, but bringing in qualified traffic (see below).
    Keyword Positions The Wrong WayKeyword Positions The Right Way
    In the images above, the image on the left demonstrates the “wrong way” to look at keyword bidding. Notice that position 1 brought in the most amount of visits but as the second image shows, the third position actually brought in the most qualified traffic with the highest pageviews per visit!
  3. Search Traffic Cannibalization – before investing in PPC / SEM, realize the benefits of these methods versus organic search. In the PPC world, I purchase keywords that I know (or expect) my audience to be using and then based on which keyword, I can guide that user to the information I think is most relevant to them. This differs greatly from organic search that simply decides on its own what content on your site is most relevant to a visitor’s search. The reason we buy keywords is so that we can guide a visitor’s experience. Don’t buy a keyword that if I searched and clicked on an organic result, would drive me to the same spot on your site. In this case, you literally threw money down the drain in the form of results that organic search would’ve provided you with anyway!
  4. Think Long Tail – Understand that 10 keywords drive probably 90% your traffic.
    The “Long Tail”
    In the chart above, the “long tail” is that long thin portion of your incredibly diverse keyword landscape. At the “head” of the graph are those top 10, usually brand related keywords that drive the majority of traffic to your site. But brand keywords = brand awareness. The “long tail” of your site is where the work needs to be done. This is the traffic that came to your site possibly having no prior awareness of your brand at all and these are the people you need to work the hardest on in order to persuade and convert them.
  5. Experiment or go home! – Don’t guess at your SEM / PPC spend anymore. You’re spending a lot of money on these initiatives, make sure they’re working out for you!
  6. Competitive Intelligence Rocks – compete.com can give you views of people you didn’t even know you were competing with for your keywords! Hitwise also offers a variety of tools (except as I found out today, no luck for Canadian data from hitwise…yet).

That’s it for today!

It isn’t that there isn’t more to write about form today but just that I’m tired and there’s so much more to go into tomorrow! I’ll try to do a recap post at the end of the summit for anything I’m missing now, but I hope that gives everyone some relevant information!

Posted in news | Leave a comment