Lightbox User Testing Protocol
Barbara Glover
barbara.glover at utoronto.ca
Thu Oct 18 15:33:44 UTC 2007
Actually I'm in that meeting too. How is 1pm EST which 10am PST, or
4pm EST which is 1pm PST?
On 18-Oct-07, at 11:24 AM, Michael S Elledge wrote:
> I have a 2:00 - 3:00 PM meeting on Sakai Accessibility Testing;
> other than that I'm available all day until 4:30 EST/1:30 PST.
> Nothing like being in the office. :-)
>
> Just let me know what works for you!
>
> Mike
>
> Barbara Glover wrote:
>> Hi Daphne/Mike
>> I wanted to thank you for your comments. I agree it will be good
>> to get a more comprehensive section of faculty than just Eileens.
>> Actually I think it may be difficult to get faculty in general.
>> In light of us wanting a more comprehensive sample than just our
>> primary persona, Allison's matrices will be helpful to foster us
>> thinking when recruiting faculty.
>>
>> My thought is that we start recruiting and see who we can get, see
>> how these early faculty fit into Allison's matrices and then,
>> later on we can target other faculty that we might be missing.
>>
>> I'm starting to talk to some faculty here to see what might be
>> possible. My understanding is that we would test the demo of the
>> light box that is on the Sakai site. I'll put a link on the wiki.
>>
>> Mike and Daphne are you available for a breeze meeting later
>> today? Anyone else interested let me know.
>>
>> cheers
>> Barbara
>>
>> On 18-Oct-07, at 11:00 AM, Michael S Elledge wrote:
>>
>>> Hi Everyone--
>>>
>>> Barbara, you've done a very nice job putting together the user
>>> study info and protocol. The categories are quite comprehensive
>>> and will be very helpful when we move into more contextual testing.
>>>
>>> I want to second Daphne's comment about being flexible when
>>> testing the tool. Faculty (at least on this campus) are
>>> notoriously difficult to recruit, especially on short notice. I
>>> also imagine we'll find out what we need to know after a fairly
>>> small number, say ten, keyboard and non-keyboard users try it out
>>> (that is 5 each).
>>>
>>> In the meantime, can someone post a link on the site to the
>>> instance of Lightbox we'll be testing?
>>>
>>> Also, I've made some edits to the page. Feel free to comment, etc.
>>>
>>> Thanks!
>>>
>>> Mike
>>>
>>> Daphne Ogle wrote:
>>>>
>>>> On Oct 17, 2007, at 8:17 AM, Barbara Glover wrote:
>>>>
>>>>> Hi Allison
>>>>> Thanks for sending the link to the chart. That will help out.
>>>>> Originally I wanted to do a more comprehensive study of users
>>>>> representing both our faculty persona as well as student
>>>>> personas. Daphne and I had a conversation about that this week
>>>>> and with the shortened time-line we thought to focus this round
>>>>> on faculty with the addition of a few key-board only users.
>>>> Right now, students are not able to use the reorderer -- no
>>>> permissions in the Image Gallery tool to reorder images. This
>>>> is likely to come but not for a couple versions. Our focus
>>>> right now is to make the experience of posting images for
>>>> students to view as easy and pleasant as possible for
>>>> instructors. That said, testing some students on the lightbox
>>>> will give us some good user data on the reorder generally -- how
>>>> do the controls and interesting moments work; do they know what
>>>> they can do when and where they can do it (related to my final
>>>> comment).
>>>>
>>>> IMO focusing on our primary persona is not critical at this
>>>> point. The current functionality is pretty generic around
>>>> reordering images. When the personas get interesting is in
>>>> future phases of the Image Gallery (and perhaps some of this
>>>> will end up in the lightbox component) when we support image
>>>> heavy course instructors in building their course content. We
>>>> of course want to test some users that are used to working with
>>>> images like Eileen is but I also think we want to test a diverse
>>>> mix of people to get a sense of where and when the lightbox will
>>>> support users best.
>>>>>
>>>>> Since our planning meeting yesterday though it appears we may
>>>>> have more time to complete further testing. In light of this,
>>>>> I would like to propose we start the testing with faculty
>>>>> matching our primary persona for Sakai and then, branch out to
>>>>> include the students.
>>>>>
>>>>> As far as extrapolating to the Re-orderer in general, that was
>>>>> not the intent of these studies. However it is a good
>>>>> suggestion and one as we do more planning around user testing
>>>>> in general that we should consider.
>>>> We should get some good user data about the reorderer in
>>>> relation to images by testing the lightbox. We could also think
>>>> about testing the uPortal portlet layout implementation to round
>>>> out the results a bit. Perhaps we could outline what we want to
>>>> know about the reorderer and make sure we include tasks that get
>>>> at that information.
>>>>
>>>> -Daphne
>>>>>
>>>>> cheers
>>>>> Barbara
>>>>> On 16-Oct-07, at 8:46 PM, Allison Bloodworth wrote:
>>>>>
>>>>>> Hi there,
>>>>>> It seems that one addition we should make to the testing
>>>>>> protocol is identifying the attributes of the users we want to
>>>>>> test, and then keeping track of which user types we've been
>>>>>> able to find. See http://wiki.fluidproject.org/display/fluid/
>>>>>> Users+to+Research for an example of an (admittedly
>>>>>> complicated--we probably don't need nearly this much detail)
>>>>>> matrix Daphne, Judy and I came up with for the Content
>>>>>> Management Research. Are we only planning to target folks who
>>>>>> are similar to the two Lightbox personas (http://
>>>>>> wiki.fluidproject.org/display/fluid/Lightbox+Personas), both
>>>>>> of which are faculty members? It sounds like we at a minimum
>>>>>> need to add "keyboard-only user" to the list of target
>>>>>> characteristics. Are there others?
>>>>>>
>>>>>> A question that may help answer that is to ask whether we
>>>>>> trying to extrapolate testing for the Re-orderer from testing
>>>>>> of the Lightbox? If so, I am wondering if we should consider
>>>>>> also testing students and people who are using Sakai for
>>>>>> research or project management as well (e.g. http://
>>>>>> wiki.fluidproject.org/display/fluid/Sakai+Personas), since
>>>>>> they may be using a version of the re-orderer in another Sakai
>>>>>> tool (e.g. Page Order Helper). It wouldn't be testing in
>>>>>> context, but at least it would be testing user types who may
>>>>>> encounter the Re-orderer. There would also be the users of
>>>>>> other Fluid applications to consider, but I'm guessing they
>>>>>> may be covered by some of the Lightbox or Sakai personas, and
>>>>>> am not sure it would make sense to define our target testing
>>>>>> subjects in an incredibly granular fashion (because we are
>>>>>> going to be limited as to who we can access).
>>>>>>
>>>>>> Allison
>>>>>>
>>>>>> On Oct 16, 2007, at 2:54 PM, Colin Clark wrote:
>>>>>>
>>>>>>> Hi Barbara and all,
>>>>>>>
>>>>>>> This is a really good testing protocol for the Lightbox. Nice
>>>>>>> work!
>>>>>>>
>>>>>>> The UX team talked about user testing briefly on our planning
>>>>>>> call today. For those of you who weren't there, here's a
>>>>>>> quick summary.
>>>>>>>
>>>>>>> The 0.1 release is unusual in that we haven't had the
>>>>>>> opportunity to do a lot of user testing on the Lightbox yet.
>>>>>>> Now that we've got a solid test plan, it will serve as the
>>>>>>> basis for identifying and fixing usability issues with the
>>>>>>> Lightbox and Reorderer over the next few releases. User
>>>>>>> testing will become an ongoing activity for us from here on.
>>>>>>>
>>>>>>> We'll fix as many issues as we can before 0.1, and then
>>>>>>> continue with user testing and refactoring into 0.2, refining
>>>>>>> the test plan as we go.
>>>>>>>
>>>>>>> Barbara mentioned during the meeting that she's planning to
>>>>>>> run this plan with Justin Obara early next week here in
>>>>>>> Toronto. Is anyone else able to do some testing with users at
>>>>>>> their institution?
>>>>>>>
>>>>>>> Colin
>>>>>>>
>>>>>>> Barbara Glover wrote:
>>>>>>>> Hi Daphne/Mike/Allison/Shaw-Han
>>>>>>>> We're trying to get some quick user testing done for the
>>>>>>>> release of the Lightbox at the end of October. Several of
>>>>>>>> you have offered to help with this testing especially the
>>>>>>>> accessibility sections at your universities.
>>>>>>>> I've put together a protocol that we can use with the
>>>>>>>> instructor user. Please review and make changes at the
>>>>>>>> folllowing wiki page.
>>>>>>>> http://wiki.fluidproject.org/display/fluid/Lightbox+User
>>>>>>>> +Study+Protocol
>>>>>>>> Let's try and determine if we can get any testing completed
>>>>>>>> in the next week before the release is done.
>>>>>>>> cheers
>>>>>>>> Barbara
>>>>>>>> _______________________________________________
>>>>>>>> fluid-work mailing list
>>>>>>>> fluid-work at fluidproject.org <mailto:fluid-
>>>>>>>> work at fluidproject.org>
>>>>>>>> http://fluidproject.org/mailman/listinfo/fluid-work
>>>>>>>
>>>>>>> --Colin Clark
>>>>>>> Technical Lead, Fluid Project
>>>>>>> Adaptive Technology Resource Centre, University of Toronto
>>>>>>> http://fluidproject.org
>>>>>>
>>>>>> Allison Bloodworth
>>>>>> Senior User Interaction Designer
>>>>>> Educational Technology Services
>>>>>> University of California, Berkeley
>>>>>> (415) 377-8243
>>>>>> abloodworth at berkeley.edu <mailto:abloodworth at berkeley.edu>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>
>>>> Daphne Ogle
>>>> Senior Interaction Designer
>>>> University of California, Berkeley
>>>> Educational Technology Services
>>>> daphne at media.berkeley.edu <mailto:daphne at media.berkeley.edu>
>>>> cell (510)847-0308
>>>>
>>>>
>>>>
>>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: elledge.vcf
Type: text/x-vcard
Size: 313 bytes
Desc: not available
URL: <http://fluidproject.org/pipermail/fluid-work/attachments/20071018/fc2e3e11/attachment.vcf>
-------------- next part --------------
More information about the fluid-work
mailing list