[et_pb_section fb_built=”1″ _builder_version=”4.16″ _module_preset=”default” background_color=”#FFFFFF” custom_margin=”||||false|false” custom_padding=”0px||||false|false” global_colors_info=”{}”][et_pb_row _builder_version=”4.16″ _module_preset=”default” global_colors_info=”{}”][et_pb_column type=”4_4″ _builder_version=”4.16″ _module_preset=”default” global_colors_info=”{}”][et_pb_text_block_v1 admin_label=”Sell line” _builder_version=”4.17.3″ _module_preset=”default” global_colors_info=”{}”]<\/p>\n
As part of the Innovation Workshop, the lead researchers in the Global Victoria EdTech Innovation Alliance provided their key advice on EdTech efficacy research. These top 5 tips can also be found in the whitepaper: \u201cDesigning an EdTech Efficacy Research Report.\u201d<\/span><\/i><\/p>\n [\/et_pb_text_block_v1][\/et_pb_column][\/et_pb_row][et_pb_row _builder_version=”4.16″ _module_preset=”default” global_colors_info=”{}”][et_pb_column type=”4_4″ _builder_version=”4.16″ _module_preset=”default” global_colors_info=”{}”][et_pb_text_block_v1 admin_label=”Intro” _builder_version=”4.17.3″ _module_preset=”default” global_colors_info=”{}”]<\/p>\n Undertaking research for education technology solutions is complex: there are hoops to jump through before getting educators and management on board, and a positive user experience may not necessarily mean educational impact. The Global Victoria EdTech Innovation Alliance<\/a> provides a support team for education technology solutions to navigate the quirks of this kind of research.\u00a0<\/span><\/p>\n The Alliance coordinates the cooperation between providers, education technology companies and academics to trial technologies that solve and enhance learning outcomes. Not only are the teams testing for the real world efficacy and impact of their solutions, but they\u2019re observing whether their product can be exported and useful in education settings outside of Australia.<\/span><\/p>\n Researchers Drs Margaret Bearman, Michael Henderson and Phillip Dawson have provided these 5 tips for education technology companies evaluating and interpreting data.\u00a0\u00a0<\/span><\/p>\n [\/et_pb_text_block_v1][\/et_pb_column][\/et_pb_row][et_pb_row module_id=”anchor1″ _builder_version=”4.16″ _module_preset=”default” global_colors_info=”{}”][et_pb_column type=”4_4″ _builder_version=”4.16″ _module_preset=”default” global_colors_info=”{}”][et_pb_text_block_v1 _builder_version=”4.17.3″ _module_preset=”default” global_colors_info=”{}”]<\/p>\n [\/et_pb_text_block_v1][et_pb_text_block_v1 admin_label=”Tip 1″ _builder_version=”4.17.3″ _module_preset=”default” global_colors_info=”{}”]<\/p>\n Sometimes, what you find may be too good to be true. It\u2019s important to take a step back and analyse the evidence you have before you. Is the evidence reliable? Would you get the same results again and again?<\/span><\/p>\n [\/et_pb_text_block_v1][\/et_pb_column][\/et_pb_row][et_pb_row _builder_version=”4.17.0″ _module_preset=”default” global_colors_info=”{}”][et_pb_column type=”4_4″ _builder_version=”4.17.0″ _module_preset=”default” global_colors_info=”{}”][et_pb_text_block_v1 module_id=”anchor2″ _builder_version=”4.17.3″ _module_preset=”default” global_colors_info=”{}”]<\/p>\n [\/et_pb_text_block_v1][et_pb_text_block_v1 admin_label=”Tip 2″ _builder_version=”4.17.3″ _module_preset=”default” global_colors_info=”{}”]<\/p>\n Likeability can help your EdTech solution become more successful, but you still need the <\/span>foundation of learner impact and alignment with curriculum. While there are standardised expectations of learner comprehension level, each education institution has a set of varying needs to teach their students.<\/span><\/p>\n [\/et_pb_text_block_v1][\/et_pb_column][\/et_pb_row][et_pb_row module_id=”anchor2″ _builder_version=”4.16″ _module_preset=”default” global_colors_info=”{}”][et_pb_column type=”4_4″ _builder_version=”4.16″ _module_preset=”default” global_colors_info=”{}”][et_pb_text_block_v1 module_id=”anchor3″ _builder_version=”4.17.3″ _module_preset=”default” global_colors_info=”{}”]<\/p>\n [\/et_pb_text_block_v1][et_pb_text_block_v1 admin_label=”Tip 3″ _builder_version=”4.17.3″ _module_preset=”default” global_colors_info=”{}”]<\/p>\n What does your solution seek to achieve with learners and\/or educators? Evidence may not be straightforward, and requires some consideration on what outcomes you\u2019re looking for and how to measure and find those outcomes.<\/span><\/p>\n [\/et_pb_text_block_v1][\/et_pb_column][\/et_pb_row][et_pb_row module_id=”anchor2″ _builder_version=”4.16″ _module_preset=”default” global_colors_info=”{}”][et_pb_column type=”4_4″ _builder_version=”4.16″ _module_preset=”default” global_colors_info=”{}”][et_pb_text_block_v1 module_id=”anchor3″ _builder_version=”4.17.3″ _module_preset=”default” global_colors_info=”{}”]<\/p>\n [\/et_pb_text_block_v1][et_pb_text_block_v1 admin_label=”Tip 4″ _builder_version=”4.17.3″ _module_preset=”default” global_colors_info=”{}”]<\/p>\n Context is key \u2014 data can never be understood on its own. Observe the contributing factors that may have made your solution successful or unsuccessful, and carefully consider the learner outcomes as a result of using your solution.<\/span><\/p>\n [\/et_pb_text_block_v1][\/et_pb_column][\/et_pb_row][et_pb_row module_id=”anchor2″ _builder_version=”4.16″ _module_preset=”default” global_colors_info=”{}”][et_pb_column type=”4_4″ _builder_version=”4.16″ _module_preset=”default” global_colors_info=”{}”][et_pb_text_block_v1 module_id=”anchor3″ _builder_version=”4.17.3″ _module_preset=”default” global_colors_info=”{}”]<\/p>\n [\/et_pb_text_block_v1][et_pb_text_block_v1 admin_label=”Tip 5″ _builder_version=”4.17.3″ _module_preset=”default” global_colors_info=”{}”]<\/p>\n We, as individuals, can be stuck in our own interpretations of the information available to us, based on our own personal knowledge. Invite others on your team or a paid analyst to review the data that you have. You never know: there may be a pattern or learning in the midst that will change the way you view your solution.<\/span><\/p>\n [\/et_pb_text_block_v1][\/et_pb_column][\/et_pb_row][et_pb_row _builder_version=”4.16″ _module_preset=”default” global_colors_info=”{}”][et_pb_column type=”4_4″ _builder_version=”4.16″ _module_preset=”default” global_colors_info=”{}”][et_pb_text_block_v1 module_id=”anchor” _builder_version=”4.17.3″ _module_preset=”default” global_colors_info=”{}”]<\/p>\n To find out more about the researchers\u2019 recommendations, download the <\/span>Designing an EdTech Efficacy Research Report<\/span><\/i><\/a> whitepaper.<\/span><\/p>\n The Global Victoria EdTech Innovation Alliance program is funded by the Victorian Government as part of the $3.6 million International Research Partnerships program under the International Education Short-Term Sector Recovery Plan.<\/b><\/p>\nBe critical of the evidence itself \u2014 don\u2019t jump to conclusions too quickly<\/strong><\/h4>\n
Whether the learner likes the solution is not proof that the solution is effective<\/strong><\/h4>\n
Quantitative isn\u2019t always better than qualitative \u2014 it depends on what you\u2019re observing<\/strong><\/h4>\n
Each data point needs context to understand it<\/strong><\/h4>\n
Have multiple people and perspectives review the data<\/strong><\/h4>\n