Lightbox User Testing Protocol
Michael S Elledge
elledge at msu.edu
Thu Oct 18 15:37:18 UTC 2007
Either works for me. Just let me know when to be there and if there's
something I should think about ahead of time. :-)
Mike
Barbara Glover wrote:
> Actually I'm in that meeting too. How is 1pm EST which 10am PST, or
> 4pm EST which is 1pm PST?
>
>
> On 18-Oct-07, at 11:24 AM, Michael S Elledge wrote:
>
>> I have a 2:00 - 3:00 PM meeting on Sakai Accessibility Testing; other
>> than that I'm available all day until 4:30 EST/1:30 PST. Nothing like
>> being in the office. :-)
>>
>> Just let me know what works for you!
>>
>> Mike
>>
>> Barbara Glover wrote:
>>> Hi Daphne/Mike
>>> I wanted to thank you for your comments. I agree it will be good to
>>> get a more comprehensive section of faculty than just Eileens.
>>> Actually I think it may be difficult to get faculty in general. In
>>> light of us wanting a more comprehensive sample than just our
>>> primary persona, Allison's matrices will be helpful to foster us
>>> thinking when recruiting faculty.
>>>
>>> My thought is that we start recruiting and see who we can get, see
>>> how these early faculty fit into Allison's matrices and then, later
>>> on we can target other faculty that we might be missing.
>>>
>>> I'm starting to talk to some faculty here to see what might be
>>> possible. My understanding is that we would test the demo of the
>>> light box that is on the Sakai site. I'll put a link on the wiki.
>>>
>>> Mike and Daphne are you available for a breeze meeting later today?
>>> Anyone else interested let me know.
>>>
>>> cheers
>>> Barbara
>>>
>>> On 18-Oct-07, at 11:00 AM, Michael S Elledge wrote:
>>>
>>>> Hi Everyone--
>>>>
>>>> Barbara, you've done a very nice job putting together the user
>>>> study info and protocol. The categories are quite comprehensive and
>>>> will be very helpful when we move into more contextual testing.
>>>>
>>>> I want to second Daphne's comment about being flexible when testing
>>>> the tool. Faculty (at least on this campus) are notoriously
>>>> difficult to recruit, especially on short notice. I also imagine
>>>> we'll find out what we need to know after a fairly small number,
>>>> say ten, keyboard and non-keyboard users try it out (that is 5 each).
>>>>
>>>> In the meantime, can someone post a link on the site to the
>>>> instance of Lightbox we'll be testing?
>>>>
>>>> Also, I've made some edits to the page. Feel free to comment, etc.
>>>>
>>>> Thanks!
>>>>
>>>> Mike
>>>>
>>>> Daphne Ogle wrote:
>>>>>
>>>>> On Oct 17, 2007, at 8:17 AM, Barbara Glover wrote:
>>>>>
>>>>>> Hi Allison
>>>>>> Thanks for sending the link to the chart. That will help out.
>>>>>> Originally I wanted to do a more comprehensive study of users
>>>>>> representing both our faculty persona as well as student
>>>>>> personas. Daphne and I had a conversation about that this week
>>>>>> and with the shortened time-line we thought to focus this round
>>>>>> on faculty with the addition of a few key-board only users.
>>>>> Right now, students are not able to use the reorderer -- no
>>>>> permissions in the Image Gallery tool to reorder images. This is
>>>>> likely to come but not for a couple versions. Our focus right now
>>>>> is to make the experience of posting images for students to view
>>>>> as easy and pleasant as possible for instructors. That said,
>>>>> testing some students on the lightbox will give us some good user
>>>>> data on the reorder generally -- how do the controls and
>>>>> interesting moments work; do they know what they can do when and
>>>>> where they can do it (related to my final comment).
>>>>>
>>>>> IMO focusing on our primary persona is not critical at this
>>>>> point. The current functionality is pretty generic around
>>>>> reordering images. When the personas get interesting is in future
>>>>> phases of the Image Gallery (and perhaps some of this will end up
>>>>> in the lightbox component) when we support image heavy course
>>>>> instructors in building their course content. We of course want
>>>>> to test some users that are used to working with images like
>>>>> Eileen is but I also think we want to test a diverse mix of people
>>>>> to get a sense of where and when the lightbox will support users
>>>>> best.
>>>>>>
>>>>>> Since our planning meeting yesterday though it appears we may
>>>>>> have more time to complete further testing. In light of this, I
>>>>>> would like to propose we start the testing with faculty matching
>>>>>> our primary persona for Sakai and then, branch out to include the
>>>>>> students.
>>>>>>
>>>>>> As far as extrapolating to the Re-orderer in general, that was
>>>>>> not the intent of these studies. However it is a good suggestion
>>>>>> and one as we do more planning around user testing in general
>>>>>> that we should consider.
>>>>> We should get some good user data about the reorderer in relation
>>>>> to images by testing the lightbox. We could also think about
>>>>> testing the uPortal portlet layout implementation to round out the
>>>>> results a bit. Perhaps we could outline what we want to know
>>>>> about the reorderer and make sure we include tasks that get at
>>>>> that information.
>>>>>
>>>>> -Daphne
>>>>>>
>>>>>> cheers
>>>>>> Barbara
>>>>>> On 16-Oct-07, at 8:46 PM, Allison Bloodworth wrote:
>>>>>>
>>>>>>> Hi there,
>>>>>>> It seems that one addition we should make to the testing
>>>>>>> protocol is identifying the attributes of the users we want to
>>>>>>> test, and then keeping track of which user types we've been able
>>>>>>> to find. See
>>>>>>> http://wiki.fluidproject.org/display/fluid/Users+to+Research for
>>>>>>> an example of an (admittedly complicated--we probably don't need
>>>>>>> nearly this much detail) matrix Daphne, Judy and I came up with
>>>>>>> for the Content Management Research. Are we only planning to
>>>>>>> target folks who are similar to the two Lightbox personas
>>>>>>> (http://wiki.fluidproject.org/display/fluid/Lightbox+Personas),
>>>>>>> both of which are faculty members? It sounds like we at a
>>>>>>> minimum need to add "keyboard-only user" to the list of target
>>>>>>> characteristics. Are there others?
>>>>>>>
>>>>>>> A question that may help answer that is to ask whether we trying
>>>>>>> to extrapolate testing for the Re-orderer from testing of the
>>>>>>> Lightbox? If so, I am wondering if we should consider also
>>>>>>> testing students and people who are using Sakai for research or
>>>>>>> project management as well (e.g.
>>>>>>> http://wiki.fluidproject.org/display/fluid/Sakai+Personas),
>>>>>>> since they may be using a version of the re-orderer in another
>>>>>>> Sakai tool (e.g. Page Order Helper). It wouldn't be testing in
>>>>>>> context, but at least it would be testing user types who may
>>>>>>> encounter the Re-orderer. There would also be the users of other
>>>>>>> Fluid applications to consider, but I'm guessing they may be
>>>>>>> covered by some of the Lightbox or Sakai personas, and am not
>>>>>>> sure it would make sense to define our target testing subjects
>>>>>>> in an incredibly granular fashion (because we are going to be
>>>>>>> limited as to who we can access).
>>>>>>>
>>>>>>> Allison
>>>>>>>
>>>>>>> On Oct 16, 2007, at 2:54 PM, Colin Clark wrote:
>>>>>>>
>>>>>>>> Hi Barbara and all,
>>>>>>>>
>>>>>>>> This is a really good testing protocol for the Lightbox. Nice
>>>>>>>> work!
>>>>>>>>
>>>>>>>> The UX team talked about user testing briefly on our planning
>>>>>>>> call today. For those of you who weren't there, here's a quick
>>>>>>>> summary.
>>>>>>>>
>>>>>>>> The 0.1 release is unusual in that we haven't had the
>>>>>>>> opportunity to do a lot of user testing on the Lightbox yet.
>>>>>>>> Now that we've got a solid test plan, it will serve as the
>>>>>>>> basis for identifying and fixing usability issues with the
>>>>>>>> Lightbox and Reorderer over the next few releases. User testing
>>>>>>>> will become an ongoing activity for us from here on.
>>>>>>>>
>>>>>>>> We'll fix as many issues as we can before 0.1, and then
>>>>>>>> continue with user testing and refactoring into 0.2, refining
>>>>>>>> the test plan as we go.
>>>>>>>>
>>>>>>>> Barbara mentioned during the meeting that she's planning to run
>>>>>>>> this plan with Justin Obara early next week here in Toronto. Is
>>>>>>>> anyone else able to do some testing with users at their
>>>>>>>> institution?
>>>>>>>>
>>>>>>>> Colin
>>>>>>>>
>>>>>>>> Barbara Glover wrote:
>>>>>>>>> Hi Daphne/Mike/Allison/Shaw-Han
>>>>>>>>> We're trying to get some quick user testing done for the
>>>>>>>>> release of the Lightbox at the end of October. Several of
>>>>>>>>> you have offered to help with this testing especially the
>>>>>>>>> accessibility sections at your universities.
>>>>>>>>> I've put together a protocol that we can use with the
>>>>>>>>> instructor user. Please review and make changes at the
>>>>>>>>> folllowing wiki page.
>>>>>>>>> http://wiki.fluidproject.org/display/fluid/Lightbox+User+Study+Protocol
>>>>>>>>>
>>>>>>>>> Let's try and determine if we can get any testing completed in
>>>>>>>>> the next week before the release is done.
>>>>>>>>> cheers
>>>>>>>>> Barbara
>>>>>>>>> _______________________________________________
>>>>>>>>> fluid-work mailing list
>>>>>>>>> fluid-work at fluidproject.org <mailto:fluid-work at fluidproject.org>
>>>>>>>>> http://fluidproject.org/mailman/listinfo/fluid-work
>>>>>>>>
>>>>>>>> --Colin Clark
>>>>>>>> Technical Lead, Fluid Project
>>>>>>>> Adaptive Technology Resource Centre, University of Toronto
>>>>>>>> http://fluidproject.org
>>>>>>>
>>>>>>> Allison Bloodworth
>>>>>>> Senior User Interaction Designer
>>>>>>> Educational Technology Services
>>>>>>> University of California, Berkeley
>>>>>>> (415) 377-8243
>>>>>>> abloodworth at berkeley.edu <mailto:abloodworth at berkeley.edu>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>
>>>>>
>>>>> Daphne Ogle
>>>>> Senior Interaction Designer
>>>>> University of California, Berkeley
>>>>> Educational Technology Services
>>>>> daphne at media.berkeley.edu <mailto:daphne at media.berkeley.edu>
>>>>> cell (510)847-0308
>>>>>
>>>>>
>>>>>
>>>
>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: elledge.vcf
Type: text/x-vcard
Size: 313 bytes
Desc: not available
URL: <http://fluidproject.org/pipermail/fluid-work/attachments/20071018/660860ab/attachment.vcf>