OpenSource Usability Labs

With the new version - Mialena - of Tine 2.0 out, it is time to take a look back at the feedback you provided to us in the past version.

As you know we ask you - our users on the log-in screen to participate in short surveys. They all have one common goal: to assess your impression of the quality of Tine 2.0. So, how do you like Tine 2.0?

The overall impression of Tine 2.0 is good (about 2.4 on a scale from 1 (excellent) to 7 (needs improvements)). The rating of the individual applications varies with addressbook and calendar leading with approximately the same value as the Tine 2.0 overall impression. The other important applications (Tasks, Email, Admin) follow, getting good to above average ratings while still leaving some room for improvements. Only sales, phone and voipmanager get below average ratings.

So, with Mialena we decided to improve the basic concepts in Tine 2.0 further. Most application now have a proper filter- and favorites concept. We hope this will better your impression of most of the applications. We also decided to move the navigation from the Outlook-like-app-pile to a modern Tab-interface. I am curious how you like this! We also spent some love to calender, email and syncing (my N900 now works fine!) - and of course some more which you should not hesitate to find out!

For a lot improvements we did your free comments inspired us a lot. We believe that we managed to fulfill about 50% of the free suggestions you made in Mialena now. So thanks for that input and keep on going like this. It really hepls us a lot to get even better!

We also asked you a couple of other questions about your context of use (mainly business, but also for other private purposes, managing between 1 and 800 users) and the necessity for a handbook (about 40% would like one) or seminars (about 25% would like one). Even though we need to get better in documentation on our wiki and other resources (so you told us!), most of the users are quite satisfied with the documentation and help they can already get.

So, please check out Mialena and continue to participate in our surveys - and in any other way you like. We desperately seeking for designer wanting to contribute to the look and feel (esp. icons need to be done), volunteers working on documentation and in the forum - or how would you like to participate in the Tine 2.0 development?

Thank you all for the great participation in the challenge… As we hoped everyone would have some fun, there still is a serious goal behind it: Defining the new frame for Tine 2.0 and getting you - our users - into the boat. So now we have come up with what we would call the final prototype. Final in terms of: if you do not find anything bothering you and telling us so, we will start to implement it.

More information?

Find the whole challenge here

Find the final prototype here

Please comment in the Tine 2.0 Forum on this and rather not in my blog - so we only have one discussion!

We always try our new paths in user participation in the development of Tine 2.0. Inspired by the great ideas Thasmo had in our forum, we decided that we want to try to integrate our users even more into the process of re-designing the Tine 2.0 applications-frame. So we ask you to provide and discuss ideas with us and the other users. Please have a look at our

Tine 2.0 community mock-up challenge.

Have fun!

Thank you, to all you those about 30 Tine 2.0 users who have answered our survey accompanying the last beta phase. Your participation is very welcome!

As you will have noticed, we introduced a new welcome / log-in screen to Tine 2.0. On that screen you will get informed whenever we start a new survey. This way we want to better get in touch with the users of Tine 2.0 - and we want to understand in how we can make Tine 2.0 better for them. In the past we had the problem that by our means of publishing the surveys, we mainly got responses from Tine 2.0 admins, who have a real reason to visit our homepage. The opinion from them helped us a lot, but we need to get more feedback also from less technical users.

In this light I would like to say thank you for your trust. The results of the survey (more…)

First of all:
A BIG thank you to all the 143 participants that took all the way of our survey! Your feedback helps us a lot, because we are doing Tine 2.0 only for you! If you missed participation this time: join us on our mailing-list for Tine 2.0 surveys!

Let’s take a look at the main results:

What shall we do next?

We asked you to sort a couple of ideas we have on what features we could work on next. It showed no real winner, so I guess all our ideas have to be integrated in Tine 2.0. Still some points that seem to be more important are:

• Dashboard
• Birthday in Calendar
• Attachments
• Editable Notes
• Linking

These 5 were the winners and we will gladly consider your voting in our feature-plan.

Also we got a lot of comments on features you would like to see. Of course, we will discuss your ideas and  in the next survey we will ask how relevant they are for all of you!

How do you like and use Tine 2.0?

(more…)

There are many directions for the Tine 2.0 development we are discussing at the moment. But in the good tradition of our development we really want to know what you - our users and potential user - want us to do. So we decided to start a short survey and kindly ask you to participate - it will cost you less then 5 minutes and helps you and us to make Tine 2.0 the most rocking groupware around!

Tine 2.0 user survey

(The survey is powered by usability-methods.com)

I want to thank everyone who was interested in taking part in the Usability calendar tests. Unfortunately I could only invite people from Berlin, because the tests had to be conducted in person. So a special thanks to all the testers that came!

In the test I focused on the Tine 2.0 calendar. The tasks included creating a shared calendar, creating whole day and recurring events, inviting, copying data from the address book to the description of an event, accepting an invitation and moving an appointment to another calendar.

These are the top 5 problems the testers had:

1. For moving an appointment to another calendar, nearly everyone tried to drag and drop this appointment. (#1460 in the Bugtracker)
2. When inviting people, 2/3 of the testers expected to find the accounts, they shared the calendar with, to be first in the invitation menu. (#1522)
3. When creating a recurring event, 2/3 of all testers found “Every 1. month” irritating. A proposal for redesign is attached to the issue in the Bugtracker. (#1524)
4. Accepting or declinig an invitation is not obvious and fast enough. Two thirds of everyone struggled to complete the task. They couldn’t find said invitation without knowing at which day it was and then didn’t expect to have to open the Edit window to accept. (#1440)
5. When copying data from the business card area in the address book, more than half of all testers tried highlighting and then right clicking to copy. This didn’t work. (#1422)

Including the above problems there will be a priority list handed over to the great guys at Metaways and we’ll hopefully see most of the things already included in the next release of Tine 2.0.

If you have questions, please email me or write a comment.

To the nearly 200 (173, to be exact) participants in our icon test: Thank you all for taking part! We got great results in terms of the quality of the Tine 2.0 icons (which are, in fact from the Oxygen Iconset). Also, we would like to thank you for all the comments you gave: Many of them were really encouraging, we got many compliments, but also some valuable criticism and tipps.

How did the icon test work?

We not only recorded which icons were chosen for which terms, but also how long it took you to decide.

From that, we could calculate three values:

• “Strength of association” (Indicates what percentage of the users assigned this icon with this term.),
• “Discriminatory power” (Indicates wether and how often this icon was assigned to other terms as well.) and
• “Conspicuity” (Indicates how fast the icon was chosen by the user in proportion to the average.)

In the pictures below you can find the three values on the left in the above order. The three values together give an overall Rating between 0 and 10. After a few tests we conducted, we can say that only icons with a rating above 8 can be seen as perfect for a term.

What is very apparent in all the results: The Oxygen Icons are not made for Tine! From the few terms we wanted to find the perfect icon for, only “User” got a rating above 8:

The weakest rating was achieved for “Today”, which is very interesting, because I expected this to be the most evident one:

Here are the results of all the other terms:

Add Appointment:

Add Calendar:

And Resource:

What do we learn from that?

First of all, we need icons that fit better to the special Tine 2.0 terms. Of course, the Oxygen Icons are a great start, but they just don’t fit all of our needs.

That’s why we want you, our community, to contribute!

• If you use Tine 2.0 and you see an icon which you think doesn’t fit: Tell us!
• If you are an icon designer and love to play with pixels: We need you!
• If you know how to visualize complicated things with as little complexity as possible: Write us!
• And even if you just know someone of the above (or know someone that knows someone :), we would like to hear from you!

Please write your ideas and suggestions to: tine.calendar@gmail.com or post in the Tine forum.

Anne and I will be at the LinuxTag in Berlin. Hope it will be as much fun as in the last years!

The plans are at the moment that at least one of us will be there on Wednesday and Thursday afternoon, as well as Friday the whole day. We will be mainly at the Tine 2.0 booth (Halle 7.2a Stand 102a). You will have the possibility to participate in a small Icon-Usabilitytest to identify the best icons for the new Tine calender-app there!

We are looking forward to discuss any issue with you concerning the Usability of Tine 2.0 or any other Open Source Software.

Thank you for taking the time answer our survey!
We had a great outcome with a total of 365 successfully completed surveys and 106 partially finished ones.

A few things that came out that you might find interesting:

• Overall, 346 people took the survey in German, 68 in English
• 30% were women, 70% were men
• on average, people were 31 years old
• 85% come from Germany, 10% from the Rest of Europe, the remaining 5% are from other parts of the world including China and South Africa (!)
• Professional appointments: women mostly use papercalendars (65%) and locally installed calendar applications (44%), men mostly use locally installed calendar applications (54%) and Smartphone calendars (46%)
• Private appointments: women mostly use paper calendars (83%) and locally installed calendar applications (24%), men mostly use Smartphone calendars (49%) and locally installed calendar applications (45%)
• The calendar application used the most is Microsoft Outlook (45%) followed by others (25%) and eGroupware (23%)
• 43% of all people asked use a smartphone, the biggest smartphone brand being Nokia (30%) followed by Apple iPhone/iPod touch (27%)
• 1/3 of smartphone users synchronize daily between phone and computer
• Per week, 3/4 of all respondents make one or no all day appointment, 2-10 appointments shorter than one day, none with international partners and 1-5 recurring appointments
• Half of all people who answered don’t make any multi-day appointments per week
• Nearly half of all people (45%) don’t make any public appointments, while 2/3 of them make 2-5 private appointments per week
• Nearly two thirds (65%) of the people asked find it very important or important to include tasks and milestones into their calendar
• Slightly more than two thirds of all respondents find it very important or important to make appointments distinguishable by colour
• But there no noticeable tendency when it comes to accessing other calendars to coordinate appointments: 39% say, that this is absolutely not important or not important to them, while 34% say the opposite. 20% are inbetween, though.
• An clear majority of everyone (86%) who answered wants to have a “quick save possibility”, with start (98%), name (92%), place (67%) and end (58%) being the most important information for creating an appointment.
• As for the calendar view, people considered the week view to be the most important one followed by the day view.
• Also, Pop-Up seems to be the most favourite way of all the respondents to be reminded of an appointment, 2/3 (67%) voted for that, followed by sound signal (48%).
• And for the last question: As you can see in the picture below, synchronization is what people miss most in their current calendar, followed by reminders and groupware functionality:

If you have any questions regarding the survey, please ask!