SharePoint 2013 Analytics A Big Step Backward

Analytics suck in SharePoint 2013. It’s been gutted. I know this happened because analytics moved into search, which was the right move, but don’t get me wrong… it’s bad the built in web analytics you’d get through the UI are more basic than you’d get in a simple WordPress blog.  Pretty useless other than to say, it’s being used and by how many something it calls users (browsers, machines. IP addresses, it’s unknown).  In fact it’s a huge step backward, and that’s what you’re going to see as I lay out the details. Let’s just admit that usage is not done in SharePoint.  It’s been ripped out of the UI.  Look for usage reports in site settings…  good luck!

First go to your site settings as Site Collection Admin and look in Site Collection Administration section for Popularity and Search Reports, then the next best bet is to look across your audit reports (it will only display what has been configured to capture), and your finally storage reports to put together the simple story of Unique Users (daily only even in the rolloup), hits (page views? who uses the term “hits?” that’s so 1995), and then your storage against your quota in classic storman.aspx which is back. If you’re not site collection admin, you can get the basic usage report in site settings under site administration titled “Popularity Trends” (What sounds like usability got all over that one??) It’s still just Hits and Unique Users, despite the line “This report shows historical usage information about the site, such as the number of views and unique users. Use this report to identify usage trends and to determine times of high and low activity.” No detail on hourly usage in the report, and since it uses “hits” which classically means all get/post and various verb HTTP responses I think what you’re actually seeing is page hits or page views.  This must have been an intern.  Historically means “Daily” and “Monthly.”  No way to break it down by hour.  Good luck identifying any usage trends other than day of the week since you can’t see any detail about who the users are, what the browser or agent string, or really anything about the user.  They don’t even define “hit” or “user.”  Every one of these reports is in Excel, but the data behind the scenes is not rich at all. Sad smile

image

image

Right out of Excel – All of the Reports are now based in Excel and download to the client.  No web based reporting.

Sad they don’t open up directly in Office Web Apps.

image

 

In the Audit Reporting

image

As a huge advocate of SharePoint, I am one of the first to stand up and say how great this next version is.  In fact I think people shouldn’t wait to upgrade because of the huge benefits in search and in mobile and cross browser support.  The latest version is a real game changer from a platform perspective, but still has a few gaping holes…  Compliance, Management, Storage, Reliable Backup/Restore and Recoverability, Replication, Workflow, Mobile, Social*, Web Analytics Reporting and More have created a rich ecosystem that the partners love to solve for SharePoint.  Would be interesting some time to really categorize these holes and list the partners all attempting to solve the same problem that Microsoft exposes.

Should you be ear marking money for additional software for a new deployment… YES!

Rant: Also don’t believe anyone in MS Sales if they tell you that SharePoint is an easy or trivial deployment.  It clearly is on the high end of what most web architects will ever see in terms of complexity (not in the install (which is still tricky), but in getting it deployed correctly).  It really takes knowledge of best practices and serious coordination with the business to get the most out of your new or existing deployment.

*Social was a big 2013 investment, but overshadowed by the acquisition, and is called out because you should get on board with Yammer or one of the other third parties that pull together the story.

Figure: FrontPage 2000 Usage Reports (Available for SharePoint Team Services)

Yesterday, I presented in a SharePoint 2013 Actionable Metrics webcast sponsored by Intlock Cardiolog.  In the webcast I presented a list of common, but actionable categories for designing your solution around.

Download the “SharePoint 2013: Making Metrics Actionable”

What’s amazing to me is how Microsoft in their tradeoffs of moving usage analytics to search ended up gutting usage and not providing much in the way of traditional usage reporting.  I venture to say that SharePoint Team Services the V1 product had better traditional usage (traffic) analytics than 2013 does.

Figure 2: Site Usage Report – WSS 2.0

Please refer to these ancient screenshots and a simple chart I put together and know while it use to be bad, it is now worse.  Yes, the report on the right refers to IE 5 as the popular browser and Win 98 as top OS in 2001.  Amazing how this list of usage metrics was cycled over and over in each successive version.  It is great someone decided that usage had to change, and putting it in search is and was brilliant, but we still need basic metrics with extensibility for rich metrics to make key decisions about what’s going on.  It’s strange that browser support is really one of the biggest reasons to upgrade to SharePoint 2013, but if you were using 2013, you wouldn’t be able to get the report to provide the justification.

 

Side by Side Comparison of Built in Usage Reporting in SharePoint over Time

* Note SharePoint Team Services required Server Health and WSS 2.0 required usage processing to be enabled.  SharePoint Portal 2001 is left out as it did not have usage reporting built in, it required scripts such as IIS log parser.  Site Server 3.0 had awesome analytics for it’s day, but let’s stop there.  Since 2007 – SharePoint Foundation has provided the usage and web analytics and available in standard and enterprise, so editions are left out on purpose.

Traffic Analysis SharePoint 2013 SharePoint 2010 SharePoint 2007 SharePoint 2003
(FrontPage 2003)
SharePoint Team Services
(FrontPage 2000)
Daily Visits X X X X X
Users Requires dev or tool X X X X
Browsers Requires dev or tool X X X X
Operating System Requires dev or tool X X X X
Referrals Requires dev or tool X X X X
Users Requires dev or tool X X X X in FrontPage
Bytes Requires dev or tool Requires dev or Tool (logs) Requires dev or Tool (logs) X in FrontPage X in FrontPage
Item Stats X (still is limited but better) Only Top Only Top Limited Limited
Search X+
(Tons of excel reports)
X (More w/ FAST)

What does all this tell you?  Microsoft has checked out of the Usage Reporting business.  If I get into the brains of the product team, they are thinking.  We have partners who do this for our customers.  There are plenty of tools out there that provide web analytics.  Customers will use the same tools they are already using on their other web platforms for a consistent experience. I could easily list a dozen tools that do it better, but that have most have yet to to answer the key SharePoint Adoption Questions of what features are people in my company using.   SharePoint team has focused on search, and auditing which are much more challenging for a third party to get at.  Same with the ULS logs and working with the data in that space.

Did focus on Cloud kill Usage Metrics in SharePoint?

Rather than rail on Microsoft which would be very easy to do in this particular space.  I’m instead going to say.  Hey there’s a HUGE hole, and you shouldn’t plan to only leverage SharePoint in the Usage space.  There’s a big problem of Office 365 having even more limited usage reporting.  I expect much of this will result in bots and reliance on third party solutions and analysis and number crunching happening from outside of the environment. (Maybe it all comes down to CPU cycles and MS wants to get rid of it as unnecessary that many will never even look at?)

Figure 3: FrontPage 2003 – Available for WSS 2.0 or SharePoint 2003

Microsoft I would like to give you a little wish list of what I would consider basic usage that any web platform should provide out of the box.  I do see it as unfortunate that many site admins will turn to Google analytics to gather these basic statistics.  If Microsoft wants someone to create an app to provide these they need to do a great job of exposing the right metrics that don’t give away the farm, but provide the right kind of logging data that makes it possible to do in a hosted state.

Basic Analytics – Things I would expect built in

Audience (help me understand my users)

  • Desktop, Tablet, OS and Browsers, plus screen resolution
  • Mobile OS and Devices (In SharePoint it would be great to know which mode they are viewing the site in, and 2013 it would have been nice to .)
  • Top New vs. Returning Users
  • *Real* count on monthly Authenticated (Intranet) or Unique Users (Anonymous), Session length and # Repeat Visits

Activity + Traffic Source

  • Pages – Total Page views over time, pages per visit
  • Engagement – Like, rated, shared
  • Language and Location
  • Referrals (referring domain and full URL)
  • Search Traffic sources and keywords an Queries (I know this is already in 2013)
  • Direct Traffic Landing Pages
  • Document storage file type metrics

 

Your key take away in all of this is you will need to spend some time thinking about how serious you are about metrics.  Will you evaluate and purchase a tool or create an FAQ or rely on apps to fill the hole.  Maybe it’s time for us to not blame Microsoft on this one… nah, that’s way too easy.  While there are always trade offs with any new product update, this one seems to really have been overlooked and as a result you’ll need to spend time on deciding what you’re going to do to fill the gap.  Anyone serious about Usage Analytics wasn’t using out the box metrics anyway.

Blog Talk Radio: Collaboration Tech Talk – SharePoint 2013 Insights

I’m going to be on the Blog Talk Radio Collaboration Tech Talk on June 6 visit the show to get the times, and call in detail.

“Our guest will be Joel Oleson, a social media strategist, Intranets guru and SharePoint evangelist.  He is also Managing Director at Salient6, and authors a blog as SharePoint Joel.  In this interview, Joel will talk about the recent release of SharePoint 2013, and what developers, end users and managers can expect. Topics will address most interesting SharePoint 2013 features, including new developer tools, and exciting social media and mobile functionality. We will also explore prospects for public and private sector adoption of this latest version of SharePoint.

Joining us for Q&A will be Mack Sigman, SharePoint Architect and Practice Leader atCSC, and President of the Federal SharePoint Users Group (FEDSPUG) in Washington D.C.

Gary Vaughan, Senior IT and Knowledge Management Advisor with Glotech at the State Department, will be the show host. Gary also provides independent SharePoint consulting in program and project management, user adoption and requirements in the D.C. area.  Notes and links discussed during this program will later be published on Gary’s blog, “Collaboration Times.””

SharePoint 2010 to 2013 Browser Comparison Report Card

Browser + Mobile enhancements are one of the Top 3 Reasons to Upgrade to SharePoint 2013

One of the big reasons I’m happiest when working on SharePoint 2013 has a lot to do with the huge improvements in browser support for basic things like multi file upload and working with data in a grid style view.  Replacing so much that previously was done in ActiveX with HTML5 compliant client based solutions with backward compatibility is huge.

In an attempt to tell the story of why I think the user experience is so much better for the life of a Mac user, the mobile user, the non IE user I put together this chart that speaks to the user experience.  I feel like MS has done such a better job with this release in terms of supporting these other non MS worlds that this story alone is one why companies should consider upgrading to SharePoint 2013.  There are 3 simple stories to me on why people should consider upgrade to SP2013 now, and this is story of mobile support + browser support is at the top of the list.

I was putting this story together for an upcoming webinar I’m doing on Improving the SharePoint Experience with SharePoint Analytics on May 22 1PM EDT where I’ll explore this in much more detail.

The Browser User Experience Report Card

SharePoint Browser Report Card

A: Best Experience

B: Some Functionality Missing

C: Not A Great Experience, but fine for browsing and limited editing

D: Poor/Frustrating Experience

(Minus and pluses used to differentiate the experience and used for comparison reasons)

This report was compiled based on my own testing, experience, and revisiting the TechNet content and getting frustrated.  For more details see the following… 

SharePoint 2013…. the browser story

The ActiveX controls have been minimized a lot.  The Silverlight dependencies have been minimized and attempted to only be utilized where it can be leveraged around video compatibility.  Drag and Drop and Multi File upload support has made the Firefox and Chrome experience tons better.  There are still a few office integration scenarios, but now those are primarily for power users, so the average user will find a good experience with Firefox and Chrome for the first time.

64 bit

The 64 bit experience is a second class experience if you’re use to IE, so please avoid it.  Windows 8 mode is also a disappointment due to lack of 64 bit support for a few of the ActiveX controls and again if you’re use to IE 32 bit mode, you will be disappointed.  Just use desktop mode and pin IE 32 bit.

Mac OS

Mac users will be very pleased to see support for multi file upload in Safari and Firefox.  While 2010 was better than 2007, this leap is even a better one.  Office integration is hopeful to get even better when the Office 2014 release happens.

Mobile

Huge leap in the mobile experience.  We go from a text by default experience to a rich experience that is more easily toggled, and controlled.  While I wish it was responsive by default, the iPad and Android Tablet experience really isn’t that bad.

It’s Official. I’m working for Salient6

I’ve dropped a couple of small hints over the last few weeks, but for the most part I think it stayed secret.  Then again the SharePoint Community is tight and word travels fast.  Did you already know? 

Who is Salient6?

Salient6 is a SharePoint Consulting firm that’s about 5 years old, but the average SharePoint tenure for the company is around 10 years per employee.  There are currently about 20 employees, but I expect that to double in the next year as we take things to the next level.  The unique focus of the company is about helping customers get real business value out of their existing SharePoint deployment.  This strategy is on working with the business to unlock the real potential in SharePoint and coordinating with IT.  That message really resonates with me as someone who has tried to create bridges in helping focus on business needs through business value planning for a well governed SharePoint platform. In addition, I was happy to discover that the SharePoint Social app shown at the SharePoint Conference by Badgeville was developed at Salient6.  Pretty cool.

You can see recent accomplishments with 8 recent SharePoint case studies http://www.salient6.com/work

Travel Less or More?

More, but it will be strategic.  Well, I’m happy to say I will be speaking at more conferences, as they are strategic, and part of what I do.  Keeping balance is still #1 priority with home life.  The domestic travel I do will be limited to shorter focused trips.  I’ve already committed to SPTechCon Boston, you’ll hear more about that later.  I’ll be in Quebec next week.  I’ve also got 3 big international trips planned for later this year.  I’m excited about a So Cal user group tour I’ll be doing at the end of June as well.

What is a Managing Director?

Managing directors often work as heads of individual business units within a company rather than heading up the company.  They have broad responsibilities heading up teams of employees and organizing efforts to meet certain internal and external goals.

With me the focus will be broad.  You’ll see me working on product strategy, solution delivery, marketing, pre-sales, marketing and social strategies and hopefully strategic direction amongst business development.  I definitely hope to raise the profile of the company and help others understand the good work we are doing and share in the successes.

Utah or Seattle?

I made a deal with my wife before joining up with Salient6.  I’ll be located in the greater Salt Lake City area until our oldest son graduates from high school (secondary school for foreigners), which will be about 3 years.  Following that, no restrictions… the world is open.  So reality is I’ll be in Seattle every 3-4 weeks for 2 or 3 days to keep the connections with the Salient6 team strong.  On a daily basis I’ll be stressing Lync and SharePoint Online in Office365 as Salient6 is a big advocate and user of cloud technologies.  I hope to coordinate my travel to the emerald city around the user group meetings and events going on in Seattle/Redmond to take advantage of community and Microsoft events.

Will you actually travel onsite to customers?

Yes! I will be spending time with important customers and doing the meet and greets.  I’m definitely interested as well in digging into business problems and helping customers figure out strategies to overcome them.  I’m currently working on a framework around many of the best practices I have used, as well as are many of the top players in our industry who are now working for Salient6 including Bill Pitts, Ted Green, Richard Sturman, Matt Shaffer and more.  I’ll also be delivering “The Art of the Possible” a business focused presentation that helps them imagine what is possible based on SharePoint Design and Development work that we have done in the past. 

I know I’ve had to turn away many opportunities in the past or try to do things in my spare time, but now is definitely the time where I can finally get my hands dirty.  Helping customers figure out their key enterprise strategies.  That’s exciting. 

Is there room?

There are 5 open positions.  We are looking for a Senior Developer, SharePoint Architect located in Bellevue, WA and more.

 

Thanks for the congratulations.  This is a great opportunity. 

Get to know Salient6 more by visiting their site at http://www.salient6.com

SharePoint vs. WordPress for Public Blog – No apology needed?

cliff hanger

Microsoft has never invested a lot in their blogs.  It’s ok to say that SharePoint isn’t the best blogging platform.  In fact I don’t shed a tear when I say it’s not the best wiki either.  There are point solutions out there that are better than SharePoint and most SharePoint consultants will stand up and admit it.  Maybe that’s even a good litmus test for your SharePoint consultant.  Tell him you want to stand up a public blog and ask him what you should use.

I’ve had a great run with this blog on the SharePoint platform, but it’s driven me a little crazy over time.  Rackspace has been great for giving me this complimentary blog for the last number of years.  I still recommend Rackspace and fpweb as great alternatives to Office365 if you need more ability to customize your solution.

This is not the end of my blog, but on May 1st this blog will be moving to WordPress.  I’ve found more than a dozen reasons why it will be a good thing for me and my blog.  I’m already picking out a responsive design theme, and looking at the SEO capabilities, and social integration plugins and wow! There are some incredible things I can do.  I’ll also be investing heavily in categories.  I can already see some big investment of time ahead of me, but I think you will ultimately thank me for doing this when you’ll see that comments end up being usable and the descriptions are better when you share them in social media and so many many more things will just simply work better.

I did spend a few days thinking about Office 365 and the public blog.  I even did a test migration and was pretty happy with it.  I think it was the themes and plugins that won me over.

Big kudos to Bjorn Furuknap @furuknap for helping me in making this decision and in the communty who helped me support this big decision.  This does not mean I’m not going to still be at sharepointjoel.com and it actually means I will be blogging more and you will have a better mobile experience, navigation experience and way more… tell me what you think on this new community platform called Nestivity.  It’s in beta, and I think it’s got some promise.

Join the “What is the best blogging platform for SharePoint bloggers” discussion and leave a reply!!

I’d love to hear your thoughts on if you think I should still be using SharePoint or if you think I’m making a mistake with WordPress and if there’s something better still out there.

SPChitChat is our own Nestivity SharePoint Community instance.  I plan to add more moderators as we get going.  More on that later.

 

Help me count down the days…. This blog will be on WordPress on May 1.

I’ll provide some sneak previews and early beta for feedback as it gets closer.