Showing posts with label Analysis. Show all posts
Showing posts with label Analysis. Show all posts

Tuesday, February 18, 2014

Digital Analytics in the Sporting Environment - Turning Data into Wins



 


Current Climate of Sports Analytics


Despite the increased availability to data and analysis techniques that can potentially aid sports management organizations of decisions, many teams do not use the tools available to them.

Interest in the sports analytics field has been rapidly growing as of late, highlighted by the book and film, Moneyball, which not only grossed over $75 million but also drew attention to the significant potential digital analytics holds within the sporting environment.

While the term ‘Moneyball’ was coined by author Michael Lewis in his 2003 book to describe a strategy that utilizes analytics, “Sports Analytics” involves the gathering and collection of data, data management, statistical analysis, data visualization and information systems to deliver better information more efficiently to decision makers within an organization. The technology behind these tools has advanced rapidly in the last decade, making access to immense amounts of data more readily available than ever before. [1]

 

Evolution of Analytics within Sports

 
The digital analytics field itself is still a developing industry therefore asking executives, managers, coaches and players to embrace analytical tools and techniques is a difficult task within the high pressure field of professional sports. Organizations are hesitant to expand their investment in a sports analytics program without an understanding of a clear proven way forward and sense of potential value. While sports analytics will continue to evolve as a field the following are challenges facing adoption of these tools and techniques: [1]
 

·         Natural inclination to resist change - Individuals and organizations both internal and external to the sporting environment are naturally inclined to resist change, making the shift toward basing major decisions on data and analysis driven models a slow moving process.

·         Distrust of the unfamiliar - Team executives are unfamiliar with statistical modeling, therefore have a predisposed distrust or discomfort with analytic tools and techniques.


·         Old-school traditional decision making vs. progressive data driven decision making – Similar to the business world, decision making in the sports industry is intuitive and instinctual. Shot-calling executives may have started as scouts or coaches, which had to rely on personal experience to make decisions. These same decision makers would view the use of digital analytics and data models as non-credible resources. As this video clip from Moneyball shows, organizational friction can occur in regards to how analytics should be utilized and trusted when making player personnel decisions.

·         Technical Barriers – General communication barrier between analysts and front office of a sports franchise, as typically those with decision making power in an organization are not familiar with the language of analytics.

·         Limited financial resources to spend on analytics

·         Implementation - Turning the data gathered from statistical tools into useful data is the main challenge teams now face as they implement new data collection and analysis methods. Then a team must determine what tools and techniques create the best value to help the team win. [2] 

The pace of adoption and evolution in sports analytics will depend on how quickly leaders are aware that significant investments into analytics will deliver a true competitive advantage. Within the past few years increased knowledge sharing and development of these analytic programs have come to the forefront of the sporting environment. Global conferences and college courses aid in improving communication skills between sports, analytics and data sciences.

 
 

The ‘Who’, ‘What’, and ‘Why’ of Sports Analytics

 
The expansion into sports analytics territory also comes with many questions. Understanding the strengths and weaknesses in your organizations can help guide how sports analytics are best utilized. Being able to harness its analytic capabilities and work past obstacles can create a significant competitive advantage on the field
 
Who can use Analytics?

·         General Manager and Executives – making player personnel decisions

·         Coaches – reinforces gut instinct or uncovers something not previously seen, whether this be tactically or personnel related. As one NBA head coach noted “It’s a good backup for what your eyes see, but we can’t make all your decisions based on it; the tools can’t measure heart, chemistry and personality.”

·         Players -

o   Assists in injury analysis - understanding when to taper off individual training schedules to avoid overuse injuries and ensure players are kept fresh for game day
 
o   Performance analysis – objectively know players are in optimal condition going into games by monitoring training load and determine who isn’t working hard enough

o   Technical analysis – tracking individual movements to improve tactical analysis [2]

·         Referees - Improve officiating of games by using analytics to determine if a refs positioning and site lines were appropriate based on the calls which were made

·         Fans – Digital analytics can also help improve fan/consumer experience, by putting meaningful numbers in front of fans and GMs alike, rather than outdated meaning less statistics. [3]

 
What is used to gather sports analytic data?

The following companies are changing the way data is collected as well as the types of data available for consumption:

·         STATS LLC – Utilizes cameras and optical tracing technology to capture the positioning of everything that moves on a court or field of play, from the players to the ball to the referees. This data can be captured at a rate of 25 times a second, critical in high movement sports. [5]

·         Catapult Sports – Utilizes GPS, accelerometers and other wearable technology to track players movements and physical characteristics such as heart rates.[4]
 
 Video: How does the Catapult system collect data from athletes?
 


 

 

 

 



Why are sports analytics effective?

Digital analytics are causing a major shift in the type of data available in sports from specific court/field actions (attempted shots, passes, rebounds etc.) to data drawn from continuous movements of every element within a play. Analytics also play a large role in front-office player personnel decisions.

 

Examples:

·         The Rockets signed Carlos Delfino last season in part because the camera data revealed he grabbed an unusually large percentage of rebounds that fell near him, very valuable for a player in his position. [3]

·         Regarding the analysis of officiating, “We will use whatever data and means we can to improve our referees,” says Steve Hellmuth, the NBA’s executive vice president of operations and technology. “The refs haven’t been tracked before. Now for the first time, they will be.” [3]

·         The Moneyball strategy is a prime example of how sports analytics can be utilized, implemented and developed into a value added investment. The Moneyball strategy is a concept used to identify undervalued players, so that teams with lower payrolls can still compete at a high level. Currently both the Oakland A’s and the Tampa Bay Rays have followed this strategy to success, making the 2013 playoffs despite being in the bottom 5 payrolls league-wide.  [6]

·         Data visualization showing advanced player statistics and movement tracking

 

 

 

Sports Analytics Overview

 
With today’s speed of computing, increase in processing power, as well as economies of scale sport organizations are more able than ever to move toward implementation of a data-driven sports analytics model, with the end goal being able to create a competitive advantage on the field of play.
 
Along with the significant leap forward in technology in terms of data gathering, through companies such as Stats LLC and Catapult Sports, more knowledge is readily available for those franchises willing to move forward into this field. Benjamin Alamar, an industry leading sports analytics consultant, speaker and author of “Sports Analytics”, has successfully has helped teams, businesses and individuals establish analytic systems – translating facts, figures and other data – into usable information.

 
The franchises who are successful in truly leveraging analytics will be those that come to see data and model results as the mechanism through which information (unstructured text as well structured data) is transformed to deliver insight to decision makers in a well-contextualized format” - Ben Alamar, whose clients include San Francisco 49ers, ESPN, Portland Trailblazers, OKC Thunder, among many others. [7]

 

Building more effective and unified communication channels between digital analytics and the sporting environment is vital to the success of a sports analytic program. This will enable the analysts, coaches, players, scouts and general managers to work with one another to improve the team and the ultimate goal: Wins.




------------------------------------------------------------------------------

[3] Lowe, Zach. “Seven Ways the NBA’s Camera System Can Change the Future of Baseketball.” http://grantland.com/the-triangle/seven-ways-the-nbas-new-camera-system-can-change-the-future-of-basketball/. 4 Sept 2013. Web. Feb 2014.
[7] Alamar, Benjamin. “Sports Analytics”. http://www.alamarsportsanalytics.com. Aug 2013.  Web. Feb 18th.

Monday, February 17, 2014

The Web Analytics Association to Digital Analytics Association

Figure 1: The Digital Analytics Association: Your Community, Your Collaboration, Your DAA

 

DAA Background 

The Web Analytics Association


Figure 2: WAA Logo
Sometime in the year 2003, three people came together in order to unite the individuals and organizations participating in analytical roles throughout the web industry. These three individuals, Jim Sterne, Bryan Eisenberg and Andrew Edwards all all joined forces with the purpose of creating an organization that would foster the Web Analytics industry [1], by allowing individuals to come together to accomplish and determine best practice methods for data acquisition, exploration, analysis and application. By 2004, the organization came to be known as the Web Analytics Association (WAA), providing individuals with the opportunity to add value through education, community, research and advocacy [2]. At the time, the WAA's scope was centered around analytical concepts and techniques related to website analysis. At this point in time, web analytics could be defined as data that has been captured and collected on an exclusive silo'ed data source. Some examples of early web analytics can include a marketing department analyzing their eCommerce trends, adjusting parameters as they see to best take advantage of the current trend. This basic type of web analytics pertains to associating data from one channel and source of traffic. The year 2011 would define a turning point in which the WAA recognized a new trend within the analytics world.


The Digital Analytics Association 


Figure 3: DAA Logo
2011 brought some change to how the WAA approaches analytics, mostly due to increasing use and wanted insight from external third party traffic sources. These third party traffic sources can include things like social media websites, forums and review websites. Through the transformation of Web 1.0 to Web 2.0, the WAA reacted properly, allowing them to maintain their foothold at the forefront of  the digital analytics industry. By adapting to this change, the Web Analytics Association re-branded themselves in 2011, becoming the Digital Analytics Association (DAA). The renewed mission of the DAA was to no longer silo off analytics to a single website, but rather to "...account for the analyst's changing role of weaving together data from multiple sources and channels" [2].


DAA Transformation

Web to digital transformation

 

The adaptation by the now DAA, shows its innate ability to understand the analytical industry. This adaptation allowed the DAA to stay relevant in the analytics industry as well as help provide input and training for organizations on how to use analytics in Web 2.0 as opposed to Web 1.0.

Figure 4: Web 1.0 vs. Web 2.0
When the WAA first started operating in the early 2000's, the internet was functioning in what we call Web 1.0. The concept of Web 1.0 dates to the early inception of the World Wide Web until sometime in the mid 2000's. Web 1.0 encapsulated websites that essentially could only be consumed, "content creators were few in Web 1.0 with the vast majority of users simply acting as consumers of content" [3]. For the most part, analytical power was centered on the main website page and web pages with the most traffic. In addition to this, analysis was was all mostly internally focused.

The change to Web 2.0 brought changes to how users not only absorb content but also react to content. One sided content pull has transformed into push/pull content generation and getting rid of old static web pages to allow for collaboration and interaction between internal and external users of your website. This two sided content exchange allowed for analysts to connect customer behavior to the bottom line of the company, by "...tie[ing] outcomes to profits..." [4].

The expansion of Web 2.0 brought on the creation of social networks, websites dedicated to allowing network like structures of individuals to communicate and exchange user generated content with one another. Types of social media mediums can include the following:
Figure 5: Social Media Websites
  • Forums
  • Blogs
  • Wikis
  • Social Networks
  • Podcasts
  • Videos
  • Pictures 
The shift in thinking of the DAA allowed for these external channels to be included within its web analytics standards. Their view on analytics now not only encompasses a website that has the most visitors or the web page that generates the most traffic but rather using all of these different channels, to create a single seamless digital footprint. This single footprint can then be used to see how web media is doing no longer as a part but in its entirety.

Leveraging the DAA 

What does the DAA provide?

 

Figure 6
So we have already gone through a basic rendition of what the Digital Analytics Organization is and how it came to be. With all of this general background information, I have not included information on exactly what the Digital Analytics Association provides. Ultimately, the DAA's value to the industry can be seen through its supplemental resources of:
  • Education
  • Community
  • Research
  • Advocacy 
Education includes the DAA provides individuals with online courses and certifications. Online courses are provided by the University of British Columbia, focusing in introduction to web analytics, site optimization, measuring online marketing campaigns and creating and managing business analytics culture.Certification for analysts is called the DAA Certified Web Analytists. This certification is a computer based test that allows individuals to demonstrate their expertise in best practices regarding web analytics.

The DAA community is similar to many other association communities in existence. The main purpose of the community imposed by the DAA allows for individuals and organizations to actively participate in helping shape web analytics standards. The DAA website states that through their communities, they are able to:
  • Offer group training and certification
  • Encourage institutions of higher learning to add web analytics to circula
  • Attemyp to unite web analytics professions to agree on
    • Standards
    • Definitions
    • Define and promote web analytics world wide [5]

Research is another thing that the DAA provides for individuals and organizations. The DAA is constantly researching and advancing their standards. New knowledge sources and industry trends are being published all the time. The DAA provides users with the Knowledge Center. This page on their website houses information related to new industry trends, current and developing analytics standards, hyperlinks to peer reviewed journals and other industry active blogs.

The DAA is constantly looking not only to its communities but also to the industry in order to form advcacy groups to put some standardization into web analytics. This can include holding public and private analytics based events, promoting higher ed institutions to the use of analytics in education programs and utilizing their industry power to advocate for standardization. 

The DAA and Future

What does the DAA have planned for the future?

 


Figure 7: The Future is Next
With Web 2.0 functionality currently in full effect, the current state of the Digital Analytics Association has adapted properly. With more and more social channels and mediums being used on the internet, analysts and organizations will need to constantly apply new Web 2.0 analytics standards recommended by the DAA in order to best add value to their bottom line. By attending current conferences and symposiums put on by the DAA, organizations and individuals will have the opportunity to have first hand knowledge with how the industry is currently acting and ways in which the industry can be moving. In addition to applying these concepts, analysts also need to be wary on how they can provide insight and help others understand what their are seeing. This ever evolving concept is something that the DAA needs to be at constant understanding with. By adapting standards and advocacy to new digital trends, analysis and analysis standards across the internet can become a coherent seamless tool that organizations can leverage to best add value to something that used to be so simple.

--------------------------------------------------------------------------------------------------------------------------------------------------------------------

[1] Waisberg, Daniel. "Web Analytics Association: A Special University." Online-Behavior. http://online-behavior.com/analytics/web-analytics-association-223, May 2010. Web. Feb. 2014.
 
[2] Facebook.com | Digital Analytics Association." Digital Analytics Association. https://www.facebook.com/digitalanalyticsassociation/info, Digital Analytics Association, n.d. Web. Feb. 2014.
 
[3] Cormode, Graham, and Balachander Krishnamurthy. "Key Differences between Web 1.0 and Web 2.0 | Cormode | First Monday." Key Differences between Web 1.0 and Web 2. http://firstmonday.org/ojs/index.php/fm/article/view/2125/1972, N.p., 15 Feb. 2008. Web. 17 Feb. 2014.

 
[4] Kaushik, A., Web Analytics 2.0: The Art of Online Accountability & Science of Customer Centricity Wiley, 2010

[5] Digital Analytics Association | Communities." Digital Analytics Association. http://www.digitalanalyticsassociation.org/committees, N.p., n.d. Web. Feb. 2014.

Figure 1: http://www.digitalanalyticsassociation.org/images/bg.jpg
Figure 2: https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhKZtYCpNxo5FPv2NhA-AhH0D8qYAWTZVhC-YE3UcABdWzqpNxAXq-F2xP4LaEtv9z617-tv_UStMXKTawSYWfo3zCQH0Ewd0ThvvTLiKepygzF6vEVID5b_2Wx4WPoJUTlF4xFCZSPH6k/s1600/web.png
Figure 3: https://blogger.googleusercontent.com/img/b/R29vZ2xl/AVvXsEhUs4J95NXAP8CTJq2hiIRbeRBoMx1mNV98gomgggE6tJrLgSN58x3uLhJlEVfqtzwbnYk2fFqWKDA2u-HfkIT7qwac0JAWvM7M4QPxM4BRot4qimNk8JIA8_krUn49NgVK5TWKfOdny2Q/s1600/digi.png

Figure 4: https://wemtech.wikispaces.com/file/view/web1vsweb2.png/101172389/web1vsweb2.png
Figure 5: http://directsitesonline.com/wordpress/wp-content/uploads/2013/09/online-social-media.jpg
Figure 6: https://blogger.googleusercontent.com/img/proxy/AVvXsEjzRpk0v-lLmCTbsItuLrORdis0hyphenhyphenFJcknE_1ILMenibFPw47PdS5boC6ltULGQSLT6CyZUt7Xzj2hL03Z0_UEFzWYwiwP9A9ligNvFgykRwpkPR2bwwQkv_IX9rimUDhfo7wxPcwoCMweM3xFLE18zhLmSuSMM65E=
Figure 7: http://www.greenbookblog.org/wp-content/uploads/2013/06/Future_Sign_Exit.jpeg

Saturday, January 26, 2013

How to Create a Successful Test Campaign


How to Create a Successful Test Campaign


1.  Start with A/B Testing


A/B Testing involves taking a current web page and comparing it to one or more updated interfaces.  Because a large number of changes are being tested at one time, this method of analysis typically produces a variety of conversion rates and in most cases, a clear winner is easy to establish.
"The Conversion rate is defined by how a prospect moves in stages through a company's sales process, and how effectively the route they take matches this process [1]" - Brian Eisenberg, CIO of Future Now, Inc.
The diagram below provided by WiderFunnel Marketing Optimization demonstrates the testing process. Users are randomly divided between each page flow and analyzed until either a fallout or a conversion occurs.  

*Image by WiderFunnel Marketing Optimization

A/B Testing can be done in a condensed duration and still achieves accurate results.  Once a desired sample size has been reached based on a preferred confidence level, testing can be immediately deactivated.

Greg Linden, a developer at Amazon, recommended offering customers a personalized, impulse buy while in the check out, but his idea was turned down.  “I was told I was forbidden to work on this any further,” Linden stated in a blog post[2].

Linden didn't give up, but instead ran an A/B Test which confirmed his idea generated higher revenue.  “I do know that in some organizations, challenging an SVP would be a fatal mistake, right or wrong,” Linden continued to write. But once his idea proved to be successful, Amazon’s executives couldn't refuse.  Amazon is now known for offering personalized features to customers thanks to Linden's determination to test an idea before letting it go[2].

Data will always speak louder than status. 

A/B Testing Tools on the Market Today:

Testing Tools
Advantage
Disadvantage
Adobe Test & Target
  • A/B Testing and Multivariate Testing
  • Segmentation on All Features
  • Expanded Customer Profile
  • Connects with SiteCatalyst and Google Analytics
  • Expensive
  • Longer development time

Google Optimizer
  • Free
  • A/B Testing
  • Easy to setup
  • Limited Multivariate Testing
  • Limited Analytic Tools

Optimizely
  • Minimal Cost
  • Simple Javascript Snippets
  • Easy to setup
  • No Connection to SiteCatalyst
  • Limited Multivariate Testing

Vanity
  • Free
  • A/B Testing Sidebar
  • Connects with Google Analytics
  • Difficult to Develop
  • Rails and Ruby coding
  • No Multivariate Testing


2.  Mix in Multivariate Refinement


After the initial A/B Test is complete, the campaign will still require fine-tuning. Multivariate Refinement inspects a variety of features at once. The tests are explored individually as well as combined to determine the greatest outcome in the shortest amount of time.

*Image by WiderFunnel Marketing Optimization

Segmenting can also be applied to Multivariate tests to determine if certain browsers or device types prefer a specific feature. If necessary, segmenting can continue to be used permanently on the website to accommodate these conditions.

3.  Repeat to maintain Conversion Optimization Strategy 

The last step is to continually examine the website’s conversion strategies by lifting up value and removing pitfalls. The following questions will guide analysts to make wise strategic decisions[3]:

  • Relevance – Does the content of the page appeal to customer’s expectations?
  • Clarity – How clear are your solutions, products, and content?
  • Anxiety Are there features visible or missing that cause users confusion or frustration?
  • Distraction Are there unnecessary components that are distracting your customers from a successful conversion?
  • Urgency Are there features motivating your customers to act immediately? Buy now?

Use these questions to continually test  and optimize your website. Optimization is an on-going process. When one test is over, a website should be exploring additional solutions that need to be taken.  Regular testing will ensure your website is producing its highest level of revenue and keep your brilliant engineers employed. Since very few engineers will make it in stand-up comedy, the more work you give them the better it is for everyone. 



Learn More About: Sherrie Cowley

Blog analysis:
Research Time – 4 hours
Blog Creation – 2 hours

Blog Channels:
Facebook
Linkedin

Reference:
[1] Eisenberg, Bryan (2002). “TheMarketer’s Common Sense Guide to E-Metrics”. Future Now. Fairfield, CT.


[3] WiderFunnel (2013). “OurProcess for Strategic Conversion Optimization”. WiderFunnel Marketing Inc. Vancouver, Canada.