A/B test Number Hive in your class

Use our simple A/B test to try Number Hive in your class, and see growth in your student’s engagement, confidence and interest in math(s)

Trying new things in the classroom is hard

As we all know, teachers are constantly seeking innovative ways to engage students in the classroom and enhance their learning experiences. But trialing new things often comes at a cost. A difficult bit of technology, or poorly thought out user experience can very easily take an exciting initiative and turn it into a disaster of a lesson. We’ve developed an approach to help you A/B test Number Hive in your class.

It can be time consuming and complex

Quite simply, teachers don’t have time to learn new things, and risk everything going wrong during a well planned lesson. Added to that, increasingly Ed-tech products are getting some complicated, it often feels like you need a PHD in computer engineering just to upload your class. The effort frankly is very rarely worth the reward.

And how do you even know it works?

We’ve all done it, you invest a chunk of time and effort trialing an ed-tech product, spend hours learning the tool, and planning your lesson, and then, even if it does all go smoothly to plan, you get to the end and notice that you actually still have no idea if it will be effective and make the difference you seek in your classroom.

If you can’t jump straight into an use a product in your class, it will fail. And if you can’t judge likely impact quickly, it doesn’t work. It’s that simple.

How to A/B test Number Hive in your class

The most compelling thing about Number Hive is that you can actually test it’s impact in a single lesson. Teacher’s frequently report to us that they see immediate changes in student engagement in number operations the first time they play the game in their class.

Regardless, we know you want to be clear on the impact that Number hive will have on your students over time, so we’ve developed a simple test plan, that is easy to implement – to give you a definitive view on the impact that Number Hive can have on your class in just 5 days.

First up, learning Number Hive is actually easy

One of the reasons our A/B test is easy is that Number Hive is designed to be easy. In fact, it’s deceptively easy to use and explain in the classroom. The depth of the game lies is in the strategic thinking and productive challenge students need to employ to win – not in the endless complexity of the product. Which is why teachers love to pick up and use it so freely and flexibly in the classroom or for reinforcement at home. You can pick up the basics of Number Hive in 3 mins using our Tips & ‘How to’ guide

Step 1: Set up you A & B Groups

Divide the class into two groups randomly, ensuring they are relatively homogeneous in terms of prior mathematical knowledge and abilities. Group A will use Number Hive as a supplemental tool for learning multiplication this week, while Group B will stick to traditional methods like worksheets, textbooks, and teacher-led instruction. Both groups will receive equal instructional time and resources.

Step 2: Take a quick pre-test survey

Before starting the trial period, administer a survey to assess students’ initial engagement, confidence, and interest in mathematics. Use a Likert scale or open-ended questions to gauge their feelings towards the subject, their motivation levels, and their preferred learning methods. Additionally, inquire about their current understanding of multiplication concepts and any challenges they face. Here’s a few questions as examples:

• How interested are you in mathematics?
• How confident do you feel when solving multiplication problems?
• What methods do you currently use to practice multiplication?
• What challenges do you face when learning multiplication?

Step 3: Optimum practice time

Aim for approximately 15 minutes of daily multiplication practice for both groups. This timeframe strikes a balance between engagement and avoiding excessive cognitive strain.

Step 4: Take a quick post test survey

At the end of the trial period, administer a post-trial survey to both groups to assess any changes in their engagement, confidence, and interest in mathematics. Compare the responses to those obtained in the pre-trial survey to identify any significant shifts or improvements. Additionally, ask specific questions about the students’ experiences with Number Hive, including their perceptions of its effectiveness and their preference for using it over traditional methods.

• Did your engagement with mathematics change during the pilot? If yes, how?
• Did you feel more confident in solving multiplication problems after the pilot? Why or why not?
• Did using Number Hive improve your interest in mathematics? If yes, how?

Assessing academic performance

To measure academic performance, conduct a short assessment that covers the multiplication concepts taught during the trial period. Administer the assessment to both groups, ensuring that the questions are comparable in difficulty and cover the same content. Compare the scores between Group A and Group B to determine if the use of Number Hive has any impact on students’ understanding and retention of multiplication skills..

Data Analysis and Conclusion

Analyze the collected data, including survey responses and assessment scores, to draw conclusions about the effectiveness of Number Hive compared to traditional methods. Look for patterns and trends that indicate changes in student engagement, confidence, and interest in mathematics. Consider qualitative feedback from the surveys to gain insights into students’ perceptions of the game and its impact on their learning experience.

Why not finish the week with a class tournament?

So you’ve tried Number Hive, you’ve seen a step change in engagement and interest in math(s) in your class – what next? Why not try a Number Hive tournament – it’s easy to do and your students will love it. We’ve pulled together everything you need, including a tournament league poster and instructions on hosting a class tournament in 4 easy steps