Learning analytics examples: 5 case studies of data insights in action

05 May 2021 by Anna Lloyd

The Experience API (xAPI for short) is far more than just an update to SCORM, the popular standard for tracking data from a learning management system. xAPI opens up a whole new world of possibilities for learning analytics. Examples of what real organizations are doing with it in real-life situations make it easier to grasp the scale of this advance and apply the learnings to your own situation.

 

Few people in learning will have entered the field because they wanted to spend more of their lives gazing at spreadsheets and analytics dashboards. So discussions of xAPI can often feel rather abstract and unmoored from the reality of the learning professional’s day-to-day activities as they go about the business of helping people achieve in their careers and generally make their lives better. 

 

Learning analytics examples

So it is useful to see examples of how people have applied the functionality offered by xAPI and the learning record store (LRS) to real-world challenges. Here are five learning analytics examples that show the dramatic potential of using learning data to affect a range of different outcomes from better compliance learning to predictive analytics.

    

 

Case study 1: Measuring behavior change at InterContinental Hotels Group with xAPI

 

IHG hotels provide more than 674,000 guests rooms globally, serving over 150 million guests each year. Learning Pool’s Learning Locker LRS was used to analyze conversations from an ongoing Massive Open Online Course (MOOC) followed by 3,000+ first-level leaders across the globe with the aim of improving the quality of communication with customers. 

 

As our first learning analytics example, the case study details how, within weeks of the social experience starting, Learning Pool’s data scientists were able to show that 50% of participants had seen how they could change and 12% of participants had actually tried a new behavior.

 

  • At level 1, learners were simply expressing what they had watched, read, or understood
  • At level 2, they were expressing a desire to change
  • At level 3, they were reporting back on how they tried to do something new, reflecting on how it went and on how they might do things next time

 

Working with unstructured, qualitative data gathered from online conversations, the semantic analysis provided IHG with hard evidence that the MOOC had been successful in its objectives.

 

 

Case study 2: City & Guilds use xAPI for predictive analytics and evidence-based recognition

 

Our second learning analytics example is from UK-based City & Guilds who work with education providers, companies and governments in over 80 countries to enable people and organizations in developing their skills for personal and economic growth. 

 

TechBac® is a professional program for 14-19 year-olds. Its Skills Zone portal brings together workplace skills training with a mentoring program, business challenges and an online CV builder. These different systems are linked together using the Experience API (xAPI). The Learning Locker LRS integrates data from multiple systems, websites and apps and displays the data to both learners and their tutors.

 

Learners visualize their work on the City & Guilds Skills Wheel; a personalized dashboard of progress. Learners can export this data to their own tailored CV, customizing the information they present back to potential employers.

 

Meanwhile, predictive learning analytics help tutors predict areas of risk to the Learner’s progress and allows them to intervene at the right time, and an integration with Mozilla’s Open Badges recognizes the Learner’s competence in each of seven skill areas by awarding Mozilla Open Badges.

 

 

Case study 3: UniSuper uses xAPI to help build business resilience capability for better regulatory compliance 

 

Melbourne-based UniSuper is an Australian superannuation fund that provides superannuation services to employees of Australia’s higher education and research sector.

 

Previously, compliance learning initiatives had tended to be viewed at the firm as more of a ‘checkbox’ activity rather than something that would engage learners and produce meaningful data.

 

To start to change this situation, Learning Pool and UniSuper’s subject matter experts came together. An xAPI data model was built, allowing xAPI data to be gathered on training effectiveness, participation rates, success rates, responses, completion statistics and employee confidence across a number of operational risks.

 

An interactive scenario then correlated confidence with explicit knowledge. Before and after course delivery the confidence of participants was self-assessed in order to assess the program’s efficiency in addressing key psychological dimensions.

 

Following the project, self-rated confidence scores in the challenges presented increased from by 24% to a total of 92%.

 

 

Case study 4: JISC uses xAPI to create a national learning analytics architecture

 

Jisc (formerly the Joint Information Systems Committee) is a UK non-departmental government body and registered charity that provides digital solutions for UK education and research.

 

As part of an ambitious project to create a set of online tools for UK universities and colleges to better understand their learner data and make more informed decisions so that they might increase student satisfaction, retention, and attainment, Jisc selected the Learning Locker LRS as the key central data store to underpin the solution. 

 

Through a range of add-ons and improvements, the LRS was transformed into a Learning Records Warehouse (LRW). Working with third-party providers of VLEs and predictive tools, Jisc’s vision of a national learning analytics architecture was brought to life.  

 

Today’s Learning Locker represents the UK’s national Learning Records Warehouse (as provided by Jisc), with open APIs to interface common data sources and commercial or open-source dashboards, analysis tools and apps. This centralization helps to de-risk adoption by universities, reducing the cost of sales and barriers to innovation for vendors, and creates a globally unique big data source for benchmarking and research into modern blended HE.

 

 

Case study 5: Egyptian Knowledge Bank (EKB) for Schools uses xAPI to personalize and improve learning for 20 million teachers and learners

 

Powered by CDSM’s Thinqi Learning Platform, the Egyptian Knowledge Bank (EKB) for Schools is an educational project designed to provide life-changing opportunities to Egypt’s children and young people by enabling them access to the world’s best learning technologies and resources. CDSM designed their next-generation learning system with Learning Locker LRS and xAPI at the foundation. 

 

The use of xAPI and LRS has become an essential component in realizing the project vision and has been invaluable to their development team when designing and prioritizing the future roadmap of their software. Through the integration of Learning Locker®, Thinqi for EKB has been able to provide the following features for teaching/learning in Egypt:

 

  • Personalized content discovery tools
  • Administrator reports offering valuable insights previously unavailable
  • The ability to segment content usage across multiple axes
  • Identifying content gaps to guide procurement 

 

This learning analytics example will set the blueprint for how a 21st-century digital learning ecosystem can offer seamless integration across 3rd party services, and add value to learning communities beyond the sum of its component parts.

 

For a more in-depth exploration of how to measure employee performance goals, and many more useful tools and insights download our new eBook, ‘Adding data and learning analytics to your organization’.

You can also view more of our learning analytics examples via our case studies page.

 

Anna Lloyd
Director of Product

Anna is a highly experienced digital education and training specialist, working in education and training product development and management for the past 10 years.

Having worked as a senior leader in large education companies, Anna has lead teams developing and managing a wide range of learning products reaching hundreds of thousands of learners.

Outside of work, Anna volunteers as a Beaver leader for the Scouts.

View more from Anna Lloyd
Read more about Learning Pool
Visit our Learn and Connect section

Get a free demo

Get in touch to find out how we can help

Start your learning journey

Get started by telling us what you need and one of our team will be in touch very soon.