{"id":295,"date":"2018-03-26T10:50:27","date_gmt":"2018-03-26T00:20:27","guid":{"rendered":"http:\/\/blogs.flinders.edu.au\/cilt\/?p=295"},"modified":"2019-07-01T12:39:03","modified_gmt":"2019-07-01T03:09:03","slug":"students-using-touchpoint-surveys","status":"publish","type":"post","link":"https:\/\/blogs.flinders.edu.au\/cilt\/2018\/03\/26\/students-using-touchpoint-surveys\/","title":{"rendered":"Where are my students at? Using Touchpoint surveys"},"content":{"rendered":"<p>&nbsp;<\/p>\n<p><a href=\"https:\/\/flo.flinders.edu.au\/mod\/glossary\/showentry.php?courseid=151&amp;eid=26995&amp;displayformat=dictionary\">Touchpoint<\/a> is a short survey that can be offered to students part way through the delivery of a topic, to try and gauge their thoughts around their learning experiences to date.\u00a0 Although this can be incredibly useful, to avoid some common pitfalls it is really important to get some key design and analysis considerations sorted from the start. Although not exhaustive, here are some important considerations&#8230;<\/p>\n<p>&nbsp;<\/p>\n<p><strong>1.Be aware of the technology and use it well<\/strong><\/p>\n<p>Within FLO, you can use the Feedback tool to create surveys you want your students to complete.\u00a0 You can include many different types of questions, with multiple choice, short response and long response questions being commonly used. The best way to become familiar with what options are available is to create a Feedback activity and investigate its functions. You may have come across some really sophisticated survey questions, such as matrix tables and visual analogue scales previously. Even though these more complex options are not available within FLO, you can still get good outcomes with the tools available.<\/p>\n<p>&nbsp;<\/p>\n<p><strong>2. Use sound survey design principles<\/strong><\/p>\n<p>To develop an effective Touchpoint survey, apply sound survey development principles. Some examples include:<\/p>\n<ul>\n<li>Minimising the number of questions that you ask \u2013 longer surveys can have lower completion rates<\/li>\n<li>Having a clear purpose so that you are seeking specific information rather than mining for random data<\/li>\n<li>Double checking the wording of your questions to make sure they aren\u2019t ambiguous<\/li>\n<li>Minimising the number of times you ask your students to complete your surveys. Asking too many times can also reduce completion rates. If you are seeking feedback part way through the semester, consider putting a single Touchpoint survey in at the midway point. If you want to determine whether differences in perception emerge over the semester, look at including one Touchpoint survey a few weeks into, and another a few weeks from the end of, the teaching semester.<\/li>\n<\/ul>\n<p>&nbsp;<\/p>\n<p><strong>3. Think about time<\/strong><\/p>\n<p>One of the great things about the Feedback tool in FLO is that you can generate automatic reports on your data. To do this, click on the \u2018Analysis\u2019 tab.\u00a0 However, this function is only available for questions where students select responses from pre-populated options. In other words, you can\u2019t use it for open-ended questions such as long and short responses.\u00a0 Where possible, it\u2019s best to aim for closed-type questions in your Touchpoint surveys. In addition to the efficiency factor around analysis, think about buy-in from the students. Many students love having the opportunity to say what they want, so it is a good idea to have at least one open-ended question that allows this (e.g. <em>\u2018Do you have any other comments?\u2019<\/em> as a final question). However, many students also do not provide any comments for these types of questions, so having lots of open-ended questions might mean that it will take you a large amount of time to analyse a small amount of data.<\/p>\n<p>&nbsp;<\/p>\n<p><strong>4. Don\u2019t promise the world<\/strong><\/p>\n<p>On your FLO site, you will need to introduce the Touchpoint survey, invite students to participate, and explain its purpose. Ideally the information that you gain part way through delivery of a topic will enable you to make minor adjustments to teaching for the rest of the semester. Sometimes, you won\u2019t be able to make these in real time, so make sure that you manage expectations by using wording that leaves students informed about possibilities but not disappointed by unkept declarations.<\/p>\n<p>&nbsp;<\/p>\n<p><strong>5. De-identify your participants<\/strong><\/p>\n<p>When you look at your survey data, it\u2019s possible you may come across responses represented by a small sample size. For example, in asking students in a lecture to complete a survey that includes asking them to identify their age range, you might find something like what is shown in Table 1:<\/p>\n<table>\n<tbody>\n<tr>\n<td width=\"150\"><strong>Age range<\/strong><\/td>\n<td width=\"150\"><strong>No. responses<\/strong><\/td>\n<td width=\"150\"><strong>Age range<\/strong><\/td>\n<td width=\"150\"><strong>No. responses<\/strong><\/td>\n<\/tr>\n<tr>\n<td width=\"150\">17 &#8211; 19<\/td>\n<td width=\"150\">34<\/td>\n<td width=\"150\">45 &#8211; 49<\/td>\n<td width=\"150\">1<\/td>\n<\/tr>\n<tr>\n<td width=\"150\">20 &#8211; 24<\/td>\n<td width=\"150\">52<\/td>\n<td width=\"150\">50 &#8211; 54<\/td>\n<td width=\"150\">0<\/td>\n<\/tr>\n<tr>\n<td width=\"150\">25 &#8211; 29<\/td>\n<td width=\"150\">21<\/td>\n<td width=\"150\">55 &#8211; 59<\/td>\n<td width=\"150\">0<\/td>\n<\/tr>\n<tr>\n<td width=\"150\">30 &#8211; 34<\/td>\n<td width=\"150\">10<\/td>\n<td width=\"150\">60 &#8211; 64<\/td>\n<td width=\"150\">0<\/td>\n<\/tr>\n<tr>\n<td width=\"150\">35 &#8211; 39<\/td>\n<td width=\"150\">1<\/td>\n<td width=\"150\">65 and over<\/td>\n<td width=\"150\">1<\/td>\n<\/tr>\n<tr>\n<td width=\"150\">40 &#8211; 44<\/td>\n<td width=\"150\">0<\/td>\n<td colspan=\"2\" width=\"301\"><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p><strong>Table 1:<\/strong> Age distribution of students enrolled in SURV101<\/p>\n<p>&nbsp;<\/p>\n<p>In this situation, most of the respondents are under the age of 35, with the remaining three being distributed across a variety of age ranges. Think about the person who has nominated that they are over the age of 65.\u00a0 While it may be clear that they are older than everyone else, they may not want people to know how old they are. By looking at this data though, it could be possible to work out that they are at least 65 years of age. The solution to this scenario is to work according to the principal of three. By having a minimum of three people in a group, it isn\u2019t possible to tell who has responded to what.\u00a0 In other words, respondents have been de-identified.\u00a0 In this situation, the data would be presented as follows (Table 2):<\/p>\n<table>\n<tbody>\n<tr>\n<td width=\"150\"><strong>Age range<\/strong><\/td>\n<td width=\"150\"><strong>No. responses<\/strong><\/td>\n<td width=\"150\"><strong>Age range<\/strong><\/td>\n<td width=\"150\"><strong>No. responses<\/strong><\/td>\n<\/tr>\n<tr>\n<td width=\"150\">17 &#8211; 19<\/td>\n<td width=\"150\">34<\/td>\n<td width=\"150\">30 &#8211; 34<\/td>\n<td width=\"150\">10<\/td>\n<\/tr>\n<tr>\n<td width=\"150\">20 &#8211; 24<\/td>\n<td width=\"150\">52<\/td>\n<td width=\"150\">35 and over<\/td>\n<td width=\"150\">3<\/td>\n<\/tr>\n<tr>\n<td width=\"150\">25 &#8211; 29<\/td>\n<td width=\"150\">21<\/td>\n<td colspan=\"2\" width=\"301\"><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p><strong>Table 2:<\/strong> Age distribution of students enrolled in SURV101<\/p>\n<p>&nbsp;<\/p>\n<p>It\u2019s really important to make sure that anyone who participates in your surveys always remains de-identified to ensure that confidentiality is maintained.<\/p>\n<p>Although not exhaustive, these tips should give you a good starting point. Some excellent resources are available to give you further guidance around survey design.\u00a0 Some are quite sophisticated, but if you are after some easily digestible summaries, you may be interested in the following resources:<\/p>\n<ul>\n<li><a href=\"https:\/\/psr.iq.harvard.edu\/files\/psr\/files\/PSRQuestionnaireTipSheet_0.pdf\">Tip sheet on question wording<\/a> (Harvard University)<\/li>\n<li><a href=\"http:\/\/www.ucl.ac.uk\/isd\/services\/learning-teaching\/elearning-staff\/core-tools\/opinio\/survey-design-ideas\">Things to think about before designing a survey<\/a> (UCL)<\/li>\n<li><a href=\"http:\/\/www.virginia.edu\/processsimplification\/resources\/survey_design.pdf\">Survey design: getting the results you need<\/a> (University of Virginia)<\/li>\n<\/ul>\n<p>Also remember that your <a href=\"mailto:cilt@flinders.edu.au\">academic development support<\/a> and <a href=\"https:\/\/flo.flinders.edu.au\/mod\/page\/view.php?id=1600\">eLearning teams<\/a> are available to help.<\/p>\n<p>Contributed by Dr Cheryl Schelbach<br \/>\nLearning Designer &#8211; CILT<\/p>\n","protected":false},"excerpt":{"rendered":"<p>&nbsp; Touchpoint is a short survey that can be offered to students part way through the delivery of a topic, to try and gauge their thoughts [&hellip;]<\/p>\n","protected":false},"author":335,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[4],"tags":[39,24,420],"class_list":["post-295","post","type-post","status-publish","format-standard","hentry","category-digital-learning","tag-educational-technology","tag-student-engagement","tag-touchpoint"],"post_mailing_queue_ids":[],"_links":{"self":[{"href":"https:\/\/blogs.flinders.edu.au\/cilt\/wp-json\/wp\/v2\/posts\/295","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.flinders.edu.au\/cilt\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.flinders.edu.au\/cilt\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.flinders.edu.au\/cilt\/wp-json\/wp\/v2\/users\/335"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.flinders.edu.au\/cilt\/wp-json\/wp\/v2\/comments?post=295"}],"version-history":[{"count":0,"href":"https:\/\/blogs.flinders.edu.au\/cilt\/wp-json\/wp\/v2\/posts\/295\/revisions"}],"wp:attachment":[{"href":"https:\/\/blogs.flinders.edu.au\/cilt\/wp-json\/wp\/v2\/media?parent=295"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.flinders.edu.au\/cilt\/wp-json\/wp\/v2\/categories?post=295"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.flinders.edu.au\/cilt\/wp-json\/wp\/v2\/tags?post=295"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}