Showing posts with label eassessment. Show all posts
Showing posts with label eassessment. Show all posts

Monday, 26 April 2010

irubric & rcampus

After trawling through another of my regular Google Alerts on e-portfolios this link caught my eye.  It began as an interesting link to a web based tool to create a set of rubrics for assessing e-portoflios: called irubric . Very neat idea, for those just embarking on the use of assessed e-portfolios.  And for those (like me) who are not exactly sure what a rubric is :
 A rubric is a scoring tool that's generally used for subjective and authentic assessments. In subjective assessments, rubrics help create a certain level of objectivity. As a result, learners are more clear about the expectations prior to assessment and are clear about their areas of weakness and strength after the assessment. In authentic assessments (which are usually subjective), rubrics help educators communicate and assess levels of performance.



Moving on to Rcampus - from the above irubric pages, I noted that they host e-portfolios and courses (like a VLE) all for free :OD - why pay more?   Looks V good (at first glance)  For more info watch the vid : 



Friday, 16 April 2010

Online Learning Task Force



I've just skimmed through the March 2010 update of the HEFCE Online Learning Task Force.  Makes for some very interesting reading.  Basically it boils down to 3 things that need to be adhered to;
  • Do the market research (who is doing what well, & learn from others mistakes), the OU is obviously a good model to learn from, and conversely so was the UKeU!!  Often I see HE going "off on one", blissfully ignorant of the good practice that's gone before by others who've done this well (Ultraversity is a good model, as it Sheffield College Net trainers courses, so is Oxford Brookes, to name but a few). Professor Gilly Salmons 5 stage model & emoderators books are a good place to start.
  • "Traditional" distance courses are built around a vocational model, relying heavily on adult leaning and work based motivational needs (see also Maslow). Paper behind glass would form the basis of this experiences. This model is a cost saving model.  I'd guess very little moderator/facilitator interaction or even less peer2peer engagement.  Good online/distance learning takes time to nurture & support and promote student centred & active learning. It is not cheap, and requires skill & time to design and support. I repeat, it it not a cheap alternative to F2F delivery.


  • And finally, this interim report acknowledges that effective pedagogy and the supporting organisational infrastructure is the key to successful online/distance learning.
  • The technology is here, now all we have to do is catch up. See also USA, North America & Australia for exemplars of effective distance learning :O)


Snippets from the report.....


Online learning: the current picture in the UK....This research suggests that:


a. More should be done to provide a simple taxonomy of the wide range of
student experiences that currently fall under the broad title of ‘online distance
learning’.


b. The vast majority of online distance learning offered by HEIs is focused on
postgraduate-level provision.


c. Most online distance learning can be identified as professional development,
or as having a strong vocational focus.


d. It can be challenging for potential students to find out about online distance
learning courses, with information often hidden in complex institutional web-sites.
Where details are available, they frequently fail to provide the full range of
information that a potential student needs to make a decision about studying
online.


e. We need to improve the market intelligence available to give a clearer picture
of the position of UK online distance learning in an international context.

and further more :

We have examined what lessons the UK HE sector can learn from previous online
learning ventures, whether successful or ones that no longer exist. ...some interesting points noted so far include:

1. It is important to clarify the purpose of the venture, including a viable, robust
business model.

2. Building on existing success tends to be most effective: in general it seems
wise to grow in, and from, subject areas and markets where institutions have an
established reputation.

3. Clear leadership and ownership is required to maintain strategic focus and
avoid an attitude that online learning is an ‘add-on’ or peripheral activity.

Finally these excerpts caught my eye:

  • It is also clear that technology platforms are not a barrier to success. The OLTF does not intend to dedicate significant attention to this area. We intend to pay more attention to business models to ensure sustainability and cost-effectiveness, and to pedagogical good practice to support academic quality.
  • ...the importance of good pedagogy to the design and delivery of excellent online learning, recognising similarities and differences between on-site, blended and fully online models different organisational structures and business models that are used to support the development and expansion of online learning for the benefit of newer entrants..

Thursday, 7 January 2010

evaluate or fail?



 I'm embarking upon a large scale eportfolio project very soon, and as part of that I'm giving advice on evaluating an eportfolio pilot.  I'd though I'd share this list &exemplar matrix with you. essentially I'm giving local learning providers a chance to "try before you buy" a selection of Open Source eportfolio tools.  


BTW, the matrix was provided by the talented Kirstie Coolin of the very successful LEAP Ahead project in the  East Midlands. Thanx for sharing the matrix Kirstie.


Typical evaluation matrix

Name of project and institution
Purpose/Context
Process
Information
capture
Information retrieval
Planning
Reflection
Feedback
Collaboration
Presentation
Assessment







Personal Development Planning/
Continuing Professional Development







Work Based Learning/
Employment







Transition/
Application







Other purpose












Sources of information regarding elearning evaluation & criteria:


Friday, 11 December 2009

Game based learning




Game based learning is a hybrid area of development taking the best of games technology and trying to shoehorn it into some serious educational contexts.  This area of R&D is growing in popularity. See my previous posts on what Sony (PSP) are doing in this arena.

I attended a webinar the other day that was co-orgnaised by the www.elearningnetwork.org
 and www.alt.ac.uk.  


I took some notes from the webinar & would like to share them with you plus some related videos that will feed into this blog post neatly.


Scott Hewitt from : http://stressmeless.org/?page_id=308,  gave a first half presentation encompassing some very interesting topics and some current projects and platforms.

  • revising to combat revision stress - Flash based learning game. It included easter eggs + combination scorings. planning revision breaks was paramount - they scored higher if they did this.



    Scott then talked about another tool Open simulator :  http://opensimulator.org/wiki/Main_Page currently in alpha version - create own virtual environments - d/load onto own server - Open Source - similar to SL. Can build your own "worlds", and make it private - UK Army are experimenting with it.  BCU have built Shareville as a 3D immersive world as a learning resource: http://shareville.bcu.ac.uk/


    • Unity : multiple platform development tool - very advanced, but need some experience to use it. A widespread community.  http://unity3d.com/

    • Thinking worlds (Caspian) : a rapid development engine, SCORM output, scoring and links to LMS to record scoring, shallow learning curve - advantageous to elearning devleopment teams (and as a teaching + learning tools) . Using with Students - pushing the boundaries: http://www.thinkingworlds.com/


    • Blackberry, iphone,  ipod touch are all being used for innovate games design, in schools. Flash support for iphone comming soon, which will help release more applications, quicker and easier.

    http://www.readwriteweb.com/archives/13_tools_for_building_your_own_iphone_app.php


    • Can you develop a game in a day? Yes they did with 35 games design students, see the project @ URL:
     http://www.realprojects.co.uk/gamebasedlearning/eln%20resources.php , see 1/2 way down page for brief they gave to students to deign the games. They used thinking worlds for this. Split into roles and went through the whole process, including narrative, rewards, learning outcomes, flowchart, storyboards, testing and pilot, etc. All groups (about 6 in each group) did at least 1 game each in 1/2 day. nb/. dentisry looking at the wii controller to teach techniques.

    www.realprojects.co.uk/gamesbasedlearning

    See also this useful video on hacking the wii:



    Second half of the session was run by Steve Harris - Northumbria Uni. His talk was equally interesting, but focussed on the underpinning principles of effective games design he teaches. High level concepts about game design and how education can benefit from these high level principles. Some notes I made:


    • Pace of learning - using games for differentiated learning design.

    • Recouperation is good for this- command and conquer, ie. intense period of action, then relaxation to reflect. Don't throw a constant barrage of info' at learners. Give time to reflect.
    • Motivation - fallout 3 game: sense of freedom (like ps2 game) - sense of discovery (not critical to quest) like easter eggs! Player feels as if they are in more control of the narrative - like GTA. ie. medical sim game - delivering medicines - add other medicines. They can discover to use in other situations.

    • Conflicts : places player in a situation where they have differing situations - like mad dash racing. Developing tactics and strategies to cope with rules of games. Helps to develop thninking, by allowing them to develop specifc skills i.e. time management.

    • Condorcet Paradox in gaming : remove dominant strategies: few number of paramenters create larger number of possibilities. Don't allow the learner to always win. Desgin in simple strategies.

    • Reward systems - fundamental in games: Operant conditioning - the more you use a technique or method, the better you become. It has to be balanced with other strategies to make you follow game rules. And Xbox 360 gamer acheivements online tag, to show others your skills. Simple to bolt on to a platform.

    • Apply thorough testing: ie. Halo 3 heat maps : bungie has these heat maps on their web site - in relation to specific weapon use - live payer date captured to allow you to learn from others. Intelligent use of gamer data.

    • Player assistance: i.e. player 2 can take temporary control to help player 1. Works with young and special needs games design.

    • Look at existing board games for ideas for effective learning/game design.



    I posed the question "are games designers utilising existing educational pedagogies to make their games educational?"  The answer was a no!  Which I thought was very strange indeed.  It seemed like a one way street, i.e. educators are looking for games based applications/platforms/technolgoes/graphics to make learning objects or content more engaging, but why are'nt games designers looking at the many (thousands of years) of teaching and learning experiences to make their games better? Or are they?  Let me know.

    Links and related books:




    • Understanding Video Games. Nielsen, Smith &  Tosca. (2008) . Routledge. ISBN: 0415977215. Gee, P. (2007) What Games Have to Teach Us About Learning and
    • Game Design Workshop: designing, Prototyping and Playtesting Games Literacy. Palgrave. ISBN: 1403984530. Fullerton, Swain &  Hoffman. (2004) . ISBN: 1578202221





    • + The cube   I love bees + NiN ARG (Wired article)




    • UK army gave personel DS Lites for eLearning: Developed by Epic (Stuart Chadwick) - won an award this year



    Finally have a look into the future at Project Natal


    Tuesday, 10 November 2009

    eportfolio book review






    Electronic Portfolios: Personal Information, Personal Development and Personal Values.
    Electronic Portfolios: Personal Information, Personal Development and Personal Values.








    This book was written by Simon Grant of JISC CETIS fame, covers all things eportfolio.  It’s a very easy book to digest for senior managers, and practitioners alike who need to know, “just what is an eportfolio, and why and what would we need it for”? Dip into the bits you need and pass it onto others.
    The book begins with an overview of current thinking; by identify 4 primary areas of use;

    Ref: http://wiki.rscwmsystems.org.uk/index.php/Eportfolios  (see BECTA video which also explains these areas – link on above page).
    Simon then complements the above areas of eportfolio “use” with 3 primary principles, namely;




    1.     
    1. Purpose – usually very specific (assessment, reflection, CPD, PDP, etc);

    2.    Information – personalised – which is the underlying message of the book. The eportfolio owner chooses to share the contents with whomever and whenever they choose;

    3.    Functionality – what bells and whistles can the platforms offer? Or indeed what kind of learning approach is afforded by its interface + feature set.

    Simon argues that if we remove any of these 3 pillars, our ability to understand eportfolio based learning and try and implement or support it becomes implausible. 

     
    The book is fronted by a chapter on typical scenarios which help to contextualise all of the possible uses of an eportfolio that are currently being implemented in academic, work, and professional (CPD) areas.  These scenarios help to set the scene and guide readers through this daunting subject area. 


     
    The book does not purport to give you the answer to which platform to choose, but it does give a well thought out set of guides, underlying principles, and current practice, that will help inform all interested stakeholders.
    See also:

    • ‘Study on the role of e-portfolios in formative and summative assessment practices’ by a team led by the Centre of Recording Achievement, is now available from: http://www.jisc.ac.uk/whatwedo/programmes/elearning/eportfolios/studyontheroleofeportfolios.aspx





    (this paper explores the use of ePortfolio tools to support teaching, learning and the personal and professional development of postgraduate students at the Institute of Education (IOE). The needs of tutors and students are considered alongside the affordances and limitations of specific tools in relation to these needs.)


    Friday, 31 October 2008

    Catch-copy-catch


    I'm due to give a few presentations this month to academics on the current state of play regarding the technology to used in the continuing battle against bad scholarly practice. Yes I mean coping with plagiarism and collusion in assessments. You may remember in the summer I reported on the results of the three year survey on the (approx 50%) accuracy of Turnipin the popular text matching software. Well I've been trawling some JISCmail plagiarism posts to bring you some nuggets of effective practice and recent innovations in this area.

    • The second blog post discussed a new pebblepad plug-in and a comparison of text matching tools.

    • Please access the wealth of papers and presentations from June's 3rd International Plagiarism Conference are now available at www.plagiarismconference.co.uk .

    • I learned this summer that two academic experts based at the University of Birmingham and Aston University are collaborating to create their own text matching tool. Someone please tell me more about this and how it's progressing.

    • At the ALT-C conference in Sept 08 I was given some excellent student Turnitin crib sheets from the Elearning department @ Teesside Uni. I did try to find a link to electronic copies, but to no avail. If they were made public, they would make a good tool for all UK HE staff. Let us know if you've developed you own resources you would like to share.

    • There is a new Electronic Theses Online Service (EThOSnet) project web site. : http://www.ethos.ac.uk/ . EThOS is: Improving research theses access to those who need it . Improving post graduate research knowledge transfer to students Creating a one stop electronic shop for all UK Theses. Promoting UK Higher Education post graduate research to the world .Contributing to the global knowledge pool.

    • An effective and tested approach that one University uses to improve scholarly practice/referencing skills:

    1. find a willing volunteer who has handed some draft work in and use the work as an example with the rest of the class highlighting good and bad practice


    2. showing students suitable (nameless) examples from the previous year's cohort


    • Toby Grainger at The University of East London
      has developed a very short and simple policy for academic misconduct and the use of text matching software. He gave it out to JISCmail subscribers, so I'm sure he'd be happy to let others use it as a basis for customisation.


    • For the BB users out there, a new (July 08) tool called Safe-assign that plugs into the VLE. Use instead of or as well as Turnitin?

    • "Smart students" check their drafts for plagiarism even before going to tutors, which is not a bad thing given some of the conversations I've just read. Be a smarter student using this free service, I just stumbled across : http://www.plagiarismdetect.com/

      Free plagiarism detection
    UPDATE!!! A number of experts have checked this site , since the post and all pulled it to pieces regarding it's usefulness. One academic categorises it as a cheat site. Be warned, treat this "site" with skepticism
    • I just discovered the UK Research Integrity Office (UKRIO), which is an independent body which offers advice and guidance to universities and other research organisations, and also to individual researchers, about the conduct of research. Hosted by Universities UK, our aims are to: Promote the good governance, management and conduct of research; Share good practice on how to address misconduct in research; and Give advice and guidance on specific cases. They have developed a Procedure for the Investigation of Misconduct in Research



    Wednesday, 18 June 2008

    Turnitin and text matching




    • Dr Niaill Hayes described (at the ASKe CETL one-day conference on institutional management of plagiarism) a three year study, just finished in May 2008, funded by FDTL5 and based at the University of Lancaster and the LSE. The study attempted to 'get inside' plagiarism detection software systems to try and understand the underpinning assumptions and procedures that the system creators were using. They tested 15,000 fragments of text to try and gauge the likelihood that any student's copied text would be identified by Turnitin. They found the likelihood to be about 50% - that is, students who copied had about a 50/50 chance of being identified though of course, this is a crude number and would be impacted by other factors such as where the student copied from etc.

      It certainly confirms the widely held view that the software NOT finding a match does not mean the text is not copied. [apologies for all those negatives]


      The above statement was a precis provided by Jude Carroll to me, three weeks ago. Her 10 minute plagiarism video housed at the Nottingham Uni best practice web portal is well worth a look.

      The research also looked into the use of illegal characters (see Guardian link below) used by some to dupe the system, and also the interpretation of the originality report. Full report is out soon. We are waiting from an official reply from JISCiPAS the JISC plagiarism advisory service that supports manages the TII database UK franchise.


      To conclude

      Don’t over hype the capabilities of TII – as has patently already occurred across academia. The implementation and subsequent use of this type of software MUST be part of a holistic range of measures that educates both staff and students to the requirement for scholarly practice at higher levels. JISCiPAS as an organisation do this extremely well. Please take time to visit the excellent resources on their website. http://www.jiscpas.ac.uk/ . The move towards more creative ways of assessing student capabilities is beginning to gather momentum. The use of group work, vivas, computer aided assessments, and more personal reflections are all being promoted as alternatives to the traditional essay, which, coupled with the (misuse of) internet are blamed for the ease/rise of plagiarism.

      Further reading:

      Other relevant Plagiarism news is rife at present and reinforces beliefs on students “buying” more ready-made essays and the shortfalls of TII’s algorithms.

    • Essay auctions 'harder to catch':
      http://news.bbc.co.uk/1/hi/education/7302641.stm
    • A new AMBeR report just published by the Academy
    http://www.heacademy.ac.uk/news/detail/uk_report_student_plagiarism

    http://www.ics.heacademy.ac.uk/resources/assessment/plagiarism/