Data Analysis Method with Using Optimal Sort Note ✓ Solved

Identify areas of overlap in participant generated categories. This process makes it possible to compare categories created by participants based on their similarity and difference and suggest new effective categories.

Step 1. Under Categories, identify similarities in titles and, more importantly, content of those categories. Just because similar phrasing or words have been used does not mean that the content of categories is the same. Be sure to expand the category by clicking on the plus icon to the left of the name to see cards placed under each.

Step 2. Create a new category by using Standardized Selected Categories at the top of the screen. Be sure you have highlighted ONLY the categories you want to combine before proceeding. You will need to give the ‘new’ category a name.

Step 3. The data associated with cards placed in these new categories will now be combined.

II. Data analysis. Sometimes, you collect data from different user groups. In Optimal Sort, it is possible to view data generally or by a user group.

Step 1. Go to participants tab.

Step 2. Click select based on questionnaire.

Step 3. Decide whether you want to select or deselect participants who answered certain survey questions with a certain answer.

Step 4. Click Update.

Step 5. Scroll all the way down to the bottom of the page and click ‘Go’ next to the Reload results from selection box.

After you come up with a manageable number of new categories based on the similarity of the content of participant generated categories, you need to validate the strength of relatedness among the cards. To do this, you can use a number of tools, e.g., the similarity matrix, the dendogram, and the standardization grid.

The Similarity Matrix shows how many participants agree with each pair combination of cards. For each possible pairing of two cards in the survey, a count is provided at the corresponding point in the matrix. The count describes how many times the two cards were placed in the same category by all participants. The darker the cell, the more probability there is that these two cards should belong under the same category.

The Standardization Grid shows the distribution of cards across the standardized categories you have defined. Each table cell shows the number of times a card was sorted into the corresponding standardized category.

Dendograms are used to demonstrate data clusters. Note: During the data analysis process, you probably have noticed that the card sorting is not a completely objective and precise technique. Many times, you need to make some subjective decisions.

In the real world, you also need to consider business rules or constraints that imply certain items have to go in certain places. Sometimes, organizational politics will influence the decision of a good information architecture.

Overall, you need to apply a combination of knowledge from the cluster analysis, dendrogram, and participants’ comments during the sort to create a good start of information architecture. You can also use other data you have, such as usability studies and web logs to inform your analysis.

Please remember—this statistical output is great reference sources that you backup your decisions, but it is not the only sources that you can rely on.

Due to the limited time of this course, we only learn the open card sort. In the future, you can run a reverse sort/closed card sort to test your new site structure/hierarchy.

Paper For Above Instructions

The Optimal Sort technique is a valuable tool used in user experience (UX) research and information architecture. This method leverages participant-generated categories to explore user understanding and organization of concepts, ultimately leading to a more intuitive design. The ability to analyze participant-generated data enhances the effectiveness of a website redesign, ensuring that users can easily navigate and find desired information.

Step 1 in implementing Optimal Sort involves identifying commonalities in participant-generated categories. This step requires careful examination of both the titles and content within those categories. It is crucial to expand each category to view the underlying cards, as similar wording does not always imply similar content. By analyzing the categories deeply, researchers can begin to identify overlap and gaps in understanding, paving the way for improved category naming and organization (Brown, 2010).

After identifying similar categories, Step 2 involves creating new categories based on the standardized selections. This action should only be taken after thoroughly reviewing participant input to ensure that the new categories reflect the collective understanding of the users rather than individual interpretations. This process fosters a sense of collaboration among participants, encouraging them to engage with the sorting process meaningfully. Once a new category is formed, the data within these categories can be dynamically combined and analyzed to yield insights into user behavior and preferences (Brown, 2010).

Data analysis is a critical aspect of the Optimal Sort process. When exploring data from different user groups, researchers must carefully select participants and their corresponding responses. This selection enables targeted analyses that reveal relevant user experience characteristics and preferences. By following the structured steps to filter data based on survey responses, designers gain actionable insights into how diverse demographic groups interact with web content differently, informing tailored design efforts (Brown, 2010).

Understanding the relationships between cards via tools such as the similarity matrix, standardization grid, and dendrogram contributes significantly to establishing a robust information architecture. The similarity matrix quantifies the frequency with which paired cards are organized together by participants, allowing researchers to identify where user perspectives align. A higher count in a matrix cell indicates stronger agreement about category alignment, guiding content organization effectively (Brown, 2010).

The standardization grid serves as an invaluable reference, allowing researchers to observe how cards distribute across newly defined categories. By visualizing distributions, designers can determine which cards are consistently associated with which categories. This assessment not only aids in refining category definitions but also helps establish clarity in the user's journey through the website (Brown, 2010).

Dendrograms provide a visual representation of data clusters formed during the Optimal Sort process. Although this technique can introduce subjective elements—as various participants may interpret card relevance differently—the data visualization options still yield powerful insights into user behavior. Evaluating these clusters helps to guide the decision-making process for information architecture structuring (Brown, 2010).

In summary, applying Optimal Sort in a website redesign project allows designers to leverage user feedback extensively. While statistical outputs provide a comprehensive overview, they should be utilized alongside qualitative insights, as the complexities of user behavior cannot be fully captured through quantitative means alone. This symbiotic approach ensures that the final information architecture resonates with users on a fundamental level, ultimately enhancing their overall experience with the digital platform (Brown, 2010).

Lastly, when implementing a new structure, usability studies and web logs serve as essential supplementary resources that offer real-time data reflecting user interaction with the newly designed architecture. Future iterations of site organization may benefit from closed card sorting techniques, enabling designers to further refine categories and enhance user experience through iterative testing. By continuously adapting to user needs and preferences, designers can establish a web environment that fosters engagement and satisfaction (Brown, 2010).

References

• Brown, D. M. (2010). Chapter 10: Competitive Reviews. In Communicating design: developing web site documentation for design and planning (2nd ed.). New Riders.
• Rosenfeld, L., Morville, P., & Arango, J. (2015). Information Architecture: For the Web and Beyond. O'Reilly Media.
• Krug, S. (2014). Don't Make Me Think: A Common Sense Approach to Web Usability. New Riders.
• Garrett, J. J. (2010). The Elements of User Experience: User-Centered Design for the Web and Beyond. New Riders.
• Nielsen, J., & Loranger, H. (2006). Prioritizing Web Usability. New Riders.
• Norman, D. A. (2013). The Design of Everyday Things: Revised and Expanded Edition. Basic Books.
• Spinuzzi, C. (2015). The Function of Rich Media in Research Presentation. Technical Communication Quarterly, 24(3), 259-279.
• Levy, M. (2017). An Overview of Card Sorting Methodology. Communication Design Quarterly, 5(1), 14-20.
• Schriver, K. A. (1997). Dynamics in Document Design: Creating Text for Readers. Wiley.
• Zhang, Y., & Li, Z. (2020). User Experience Research in Agile Development: A Case Study. International Journal of Human-Computer Interaction, 36(1), 60-73.