How Astra International Uses Game-Based Assessment to Improve Employee Behavior Analysis

How Astra International Uses Game-Based Assessment to Improve Employee Behavior Analysis

Employee recruitment is a crucial process for organizations as it determines the quality and suitability of the workforce. However, traditional candidate assessment methods, such as written tests or interviews, have several limitations. Conventional assessment methods are often inaccurate and may not be relevant to job requirements and situations. Moreover, they may fail to capture the complex and dynamic behaviors needed by the organization. 

To address these challenges, Astra International collaborated with Level Up to create a game-based assessment tool that can evaluate the behavioral traits of potential employees in an engaging and accurate manner. The game, called Astra Underwater Maze, was designed to measure one crucial behavior for Astra International: perseverance. 

Perseverance, or the ability to keep trying, is key to achieving goals and overcoming challenges. It is also linked to other behaviors expected by an organization, such as problem-solving, decision-making, adaptability, and resilience. Therefore, an organization can gain valuable insights for various positions and job tasks by assessing perseverance. 

The objective of the Underwater Maze Game

The main goal of creating Astra Underwater Maze is to enhance the assessment of employee candidates by moving away from traditional written tests. The game aims to provide an accurate way to evaluate specific behaviors, especially perseverance, through an interactive and enjoyable experience. 

Game-based assessment is an innovative method to measure learning outcomes and behaviors using digital games as assessment tools. Game-based assessment offers several advantages over conventional assessment methods, such as: 

  • Providing authentic and realistic contexts relevant to job requirements  
  • Offering quick feedback tailored to situations that enhance learning and motivation, collecting rich 
  • Diverse data reflecting candidate actions, choices, strategies, and processes  
  • Conducting hidden assessments seamlessly integrated into the game without disrupting fun and engagement 
  • Enhancing interest and satisfaction, reducing stress and boredom during tests. 

 

Through these advantages, Astra International hopes to achieve a more effective and efficient way to assess perseverance and related behaviors in candidates. 

Level Up Solution

The Astra Underwater Maze game involves navigating a ship from one point to another without hitting maze walls. The ship moves automatically, requiring players to determine the next point for the ship’s movement accurately. This gameplay is designed to test players’ ability to control the ship without errors, indicating perseverance. 

The game consists of three levels with varying difficulty levels. Each level has a different maze shape, time limit, number of checkpoints, and lives. The game also provides feedback on player performance after each level, such as the number of mistakes made, time taken, and the score obtained. 

The results of the Astra Underwater Maze game can be used as an assessment of an individual’s level of perseverance. Perseverance is defined as “how much someone keeps trying to achieve goals despite facing difficulties or failures.” Perseverance is further divided into four sub-behaviors:  

  1. Willingness to try again  
  2. Ability to overcome disappointment  
  3. Seeking help or feedback  
  4. Enthusiasm to complete tasks 

 

Implementing the assessment for Astra Underwater Maze involves collecting and analyzing data from gameplay. This data includes: 

  • Number of mistakes made by players in each level 
  • Time taken by players to complete each level 
  • Score obtained by players in each level 
  • Number of players repeating or exiting the game 

This data is used to calculate a perseverance score for each player, as well as four norm scores indicating sub-behaviors of perseverance. The perseverance score ranges from 0 to 100, with a higher score indicating higher perseverance. The norm scores range from 1 to 5, with a higher score indicating higher sub-behavior. 

Results

After collecting and analyzing data for over three years, the Astra Recruitment Center obtained significant results. The game results not only provided a standard perseverance score but also four other norm scores. These insights offer a comprehensive understanding of candidate behavioral traits, enabling better recruitment decisions. The effectiveness of the game was demonstrated through a one-year performance analysis of accepted candidates. 

 

Some key findings from the game include: 

  • Player perseverance scores positively correlate with academic performance and candidates’ critical thinking abilities, indicating that perseverance is a sign of general intelligence and capability. 
  • Player perseverance scores also positively correlate with job performance and satisfaction, suggesting that perseverance can make employees successful and happy in their roles. 
  • The four norm scores for players show different behavioral patterns among candidates, such as willingness to take risks, seeking solutions, self-regulation, and confidence. These patterns help identify candidates’ strengths and weaknesses, as well as their suitability for various positions and job tasks.

     

These results demonstrate how the Astra Underwater Maze game provides a source of data on candidate behaviors. By using game-based assessment, Astra International was able to gain deep insights into candidate perseverance traits, surpassing what standard tests could provide. Furthermore, by comparing game results with actual employee performance, the Astra Underwater Maze game-based assessment proved accurate in indicating employee perseverance, making it a precise assessment tool.  

If you are interested in learning more about gamification and how it can benefit you or your organization   

Check out our gamification services page and contact us today. We are ready to help you create a gamification experience that aligns with your needs and preferences.     

All company names, brand names, trademarks, logos, illustrations, videos and any other intellectual property (Intellectual Property) published on this website are the property of their respective owners. Any non-authorized usage of Intellectual Property is strictly prohibited and any violation will be prosecuted under the law.

© 2023 Agate. All rights reserved.
Edit Template