JoJo

Think Beyond

Degree Project

Product Design

Inclusive Design

UX Research

2D & 3D Motion Design

Data Visualization

Team

Solo Project

Role

Product Designer

Timeline

24 Weeks

Tools

Figma, Blender, After Effects, Tableau

Jojo is a personalized AI companion designed to encourage active thinking, improve focus, and help users regain balance in their digital lives. Unlike traditional AI tools that passively provide solutions, Jojo creates an engaging and interactive experience by integrating human-like interaction features and fostering critical thinking.

Overview

Research

Research Question

Research Findings

Counter Argument

Goal

Design Solution

Target User

User Interview

Persona

Journey Mapping

Problem & Solution

Prototype1 (Character)

Prototype 2 (Web)

Final Solution

Takeaway

Problem 1

Difficulty maintaining cognitive focus and sustained engagement in digital environments.

Cognitive challenges caused by digital technology are real, and many people rely on AI tools to help them stay focused and manage their tasks.

Solution 1-1 (cognitive thinking decline)

Activeness Mode: stimulate deeper thought and active engagement without user prompts.

A Background-Working Web App That Monitors User Activity
Question Prompts Instead of Direct Answers

Solution 1-2 (decreased engagement)

An AI character that can express emotions through facial expressions based on the conversation flow.

The character’s expressions help users stay focused and emotionally connected to the topic.

Problem 2

Cognitive thinking and engagement are abstract, which makes it hard for users to gauge their progress or improvement.

Cognitive challenges caused by digital technology are real, and many people rely on AI tools to help them stay focused and manage their tasks.

Solution

An intuitive reporting system that measures both cognitive thinking and engagement levels

The report translates complex data into clear, visual scores. Based on these insights, JoJo provides personalized feedback and motivational encouragement, helping users reflect on their behaviour, track their progress, and feel supported in their journey.

Project Objectives

Develop a conversational AI system that addresses and provides solutions for common cognitive challenges faced by young adults.
Challenge and address the paradox of solving issues caused by digital technology with another form of technology, supported by real user experiences and research findings.
Translated abstract concepts like cognitive thinking and engagement improvement into clear, easy-to-understand data visualizations.

Process

The first 12 weeks were dedicated to research to define the problems people are currently facing and set clear goals for the project. Starting with the initial research question, a literature review was conducted to finalize the research question and identify the problem this project aims to solve, as well as the goals it seeks to achieve.

Primary research involved desk research to broadly explore the challenges humans face due to digital technology and potential solutions. To validate the research findings, 8 real users were interviewed to cross-check whether their personal experiences aligned with the identified issues. This process confirmed that the research findings were not merely generalized but represented real challenges faced by a significant number of users in everyday contexts.

The remaining 12 weeks have been focused on building a solution based on the insights gained from the research. This phase is still ongoing and is expected to conclude in April. The diagram below outlines the projected timeline, with the project now progressing into the UX design stage.

*Note: This section is very detailed and explains the entire process step by step*
(which means it's going to be VERY long)

Research

Research Question

How can conversational AI be designed as a complementary tool to engage critical thinking and address cognitive accessibility challenges for adults aged 18 to 35, reducing the effects of over-reliance on digital technology?

As someone who grew up immersed in digital technology, I often feel that it has negatively impacted our generation's cognitive abilities. This project aims to explore whether there is a correlation between digital technology and cognitive challenges and to investigate how conversational AI can be leveraged to address these issues.

Why conversational AI specifically?
Over the past two years, AI has revolutionized the tech industry and become an integral part of daily life. Efforts to implement AI in the existing products are increasing rapidly, and I’ve noticed both myself and those around me frequently relying on AI tools. Since the use of digital technology is inevitable, I want to explore ways to optimize its implementation, ensuring it serves as a solution rather than exacerbating existing problems.

This project is dedicated to answering this research question and finding ways to design conversational AI that supports critical thinking and cognitive health.

Are you still doubting, wondering, 'You're solving a problem caused by digital technology with yet another digital technology?' If so, check out the counter-argument section below.

Research Findings

Q1. Does digital technology truly cause cognitive issues, or is it merely a delusion?

The answer is yes, it does cause cognitive issues.

# Primary Research

Excessive digital device use causes memory loss, attention deficits, difficulty in decision making, and a decline in communication skills.

Digital platforms promote instant gratification, encouraging quick interactions that may discourage cognitive functions.

People are required to use digital devices whether they like it or not, resulting in greater exposure to technology than ever before.

Since the pandemic, online classes and remote work are the new normal.

# Interview

Seven out of eight reported noticing changes in their cognitive functions.

One participant mentioned multiple symptoms.

The changes align their cognitive function difficulties with the period of digital technology use, particularly AI.

Six participants reported noticing these changes about two years ago, while one attributed the changes to when they first started using a smartphone.

All participants have been using AI tools for one to two years.

Turning off their digital devices or deleting the social media apps entirely was not an option because their work and study environments heavily rely on these tools.

Q2. So What Do We Do When We Can’t Focus?

Maybe it’s not the online environment itself that’s the problem—it’s how we’re using it. What if we approached it differently?

Passive listening or just making prompts isn’t enough. The key is to engage actively. Talk, chat, participate—make it interactive. When you treat the online environment like a physical one and actively join in, it can actually work just as well.

# Primary Research

Discussions with peers and teachers vs passive lectures make a significant difference in critical thinking ability — The same applies to Digital tech.

Passive listening or making prompts alone is not effective.

# Interview

Six participants stated that they attempt to engage with others when they feel less engaged during online meetings or classes.

Participants knows the importance of incorporating human interaction to enhance engagement levels.

All participants reported a decrease in their engagement level during online classes, meetings, or calls/chats.

Those actions help simulate face-to-face interaction by providing instant reactions and enabling others to recognize them as individuals, including reading their facial expressions.

And AI, a new digital technology, isn’t actually all that bad!

The key isn’t to avoid AI but to use it actively and in a balanced way, making technology a powerful ally rather than a threat.

# Primary Research

Augmented intelligence tends to make the better choice, particularly in complex decision-making scenarios

Using technology and AI is not inherently bad—in fact, it can be highly beneficial. In complex decision-making, combining human intelligence with AI, also known as augmented intelligence, often leads to better outcomes compared to relying solely on humans or AI.

AI tends to outperform humans in high-confidence situations where clear and consistent patterns exist.

However, humans excel in mid-confidence cases, drawing on broader contextual understanding and adapting to unique, rare, or complex scenarios.

By leveraging AI at a moderate and thoughtful level, we can enhance the decision-making process by balancing the strengths of both humans and AI. Therefore, using AI is not harmful if it is approached actively and in a balanced manner.

Q3. Then which one is better Speech-based or text-based AI?

Well… both! Each has its own strengths.

# Primary Research

Speech-based AI with text-based AI has even greater potential to enhance critical thinking.

The answer is not so simple—both have their own unique strengths. Voice assistants are more efficient and engaging for goal-directed tasks, offering quick, hands-free solutions that enhance productivity. On the other hand, chatbots are more effective for exploratory or experiential activities, where users can dive deeper into learning or problem-solving at their own pace. Combining these two approaches has the potential to create a more balanced and impactful tool, particularly for fostering critical thinking.

This raised another question for me: what do people think about interacting with AI? Understanding user perspectives became an important part of my research.

Alright, let’s dive into what people really think about interacting with AI!

Many find talking to GPT kind of boring.

# Primary Research

Talking to GPT is boring.

Many people find interacting with ChatGPT dull and uninspiring. Participants in studies noted that ChatGPT lacked human-like "personal visualization," which made the interaction feel less engaging and impersonal. Some suggested that incorporating a visual character alongside the text could make the experience more personal and enjoyable—an idea I found particularly interesting. This highlights a potential gap in conversational AI, where adding visual and interactive elements could improve user engagement and make the interaction more dynamic.

Robot? It’s fun, but creepy.

On the other hand, studies comparing conversational AI with robot interfaces revealed that participants found interacting with robots enjoyable and fun, largely due to their expressive facial features and engaging interfaces. However, the robot’s blinking and its eyes were often cited as sources of discomfort, with some participants describing them as "creepy." While robots bring a more entertaining and interactive experience, their human-like traits can evoke unease, emphasizing the need for careful design to balance engagement with user comfort.

Reference: (Yamamoto & Ananou, 2015) (Shanmugasundaram & Tamilarasu, 2023) (Rossi et al., 2021) (Rzepka et al., 2022) (Malkomsen, n.d.)
Interview: A total of 8 participants were involved, and the interviews were carried out in a quantitative format.

Wait

So... you're addressing a problem caused by digital technology using more digital technology?

Isn't This a Paradox?

There’s definitely a risk of worsening the problem by relying on the same digital technology that contributed to it.

However,

Over half of the interview participants reported experiencing cognitive issues and stated that they use AI to address these challenges.

Five out of seven participants who noticed changes in their cognitive functions mentioned relying on AI tools like ChatGPT, Copilot, and Perplexity to stay focused. These tools have become essential for managing their daily lives, whether for work or study. People are already turning to digital technology, through AI, to solve the problems it has created.

The Goal

Since coexistence with digital technology is inevitable, my goal is to identify ways to use it effectively and responsibly, avoiding a harmful cycle of dependency.

Design

Let’s narrow down the target user

The primary target users are young adults who want to use AI tools in a smart and sustainable way, but are concerned about becoming too dependent on them.

Back to the interviews

Participants highlighted concerns about over-reliance on AI, as instant answers often diminish opportunities for critical thinking. They emphasized the need for AI tools to strike a balance between convenience and engagement by supporting focus and offering guided solutions.

Common painpoints

Over-Reliance, Distractions, and Vicious Cycle

Participants expressed concerns that instant answers from AI tools often reduced their opportunities to think critically.
Some found it challenging to stay focused when accessing AI tools via laptops, often ending up distracted by social media.
Features like automated meeting notes made participants less focused during meetings, leading to greater reliance on AI.

User Needs

Guided Solutions and Focus Support

Users wished AI could help them find answers collaboratively rather than simply providing instant responses—only when desired.
Also, they wanted AI tools could assist them in maintaining focus on their tasks without introducing distractions.

#General information about participants and AI use
#User pain points and needs about AI tools and use

User Persona

Key Insights

COGNITIVE LOAD AND DIGITAL OVER-RELIANCE

Both Josh and Lena rely heavily on digital tools to manage their workload efficiently.
Josh struggles with balancing AI reliance while maintaining his critical thinking skills.
Lena finds digital tools essential for productivity but faces distractions, particularly in a hybrid work environment.

ENGAGEMENT & PRODUCTIVITY CHALLENGES

Josh needs structured tools to manage cognitive overload from his packed schedule and maintain productivity.
Lena seeks workflow optimization to enhance team communication and manage multiple projects effectively.

WORK-FROM-HOME ENVIRONMENTS DEMAND BOTH TEXT AND VOICE BASED AI TOOL

Josh juggles academic deadlines, teaching, and research—his needs shift throughout the day.
Lena switches between remote and in-office work, requiring digital tool integration

NEEDS OF AI AS AN ACTIVE THINKING COMPANION

Both users want AI to assist but not take over their thinking process.

AI needs to encourage engagement, problem-solving, and strategic thinking, not just automate tasks.

Journey Mapping

More Opportunities I found…

PROVIDE THINKING PROGRESS ANALYSIS REPORT

Integrate cognitive performance insights, showing users how their focus and productivity evolve over time since thinking progress is abstract to track.

This report would help users realize, "Oh, I actually put in effort and thought!" This could be a key feature that sets it apart from other AI tools.

FINALLY, I finalized the key problems and solutions to focus on

Problem 1

Difficulty maintaining cognitive focus and sustained engagement in digital environments.

Cognitive challenges caused by digital technology are real, and many people rely on AI tools to help them stay focused and manage their tasks.

Solution 1-1 (cognitive thinking decline)

Activeness Mode: stimulate deeper thought and active engagement without user prompts.

A Background-Working Web App That Monitors User Activity
JoJo runs in the background, using screen activity tracking, face recognition, and eye tracking to analyze user focus, confusion, or hesitation. Based on this data, JoJo proactively initiates thought-provoking questions tailored to the user’s context, encouraging them to think critically rather than simply absorb information.

Question Prompts Instead of Direct Answers
JoJo runs in the background, using screen activity tracking, face recognition, and eye tracking to analyze user focus, confusion, or hesitation. Based on this data, JoJo proactively initiates thought-provoking questions tailored to the user’s context, encouraging them to think critically rather than simply absorb information.

Solution 1-2 (decreased engagement)

An AI character that can express emotions through facial expressions based on the conversation flow.

The character’s expressions help users stay focused and emotionally connected to the topic. Over time, the character learns from the user’s expressions and gradually begins to mirror them, creating a more personal and empathetic interaction.

Problem 2

Cognitive thinking and engagement are abstract, which makes it hard for users to gauge their progress or improvement.

Cognitive challenges caused by digital technology are real, and many people rely on AI tools to help them stay focused and manage their tasks.

Solution 2

An intuitive reporting system that measures both cognitive thinking and engagement levels

Prototype 1: AI Character

Introducing JoJo!

The main reason of making a character is for enhancing interaction between AI with users. JoJo should adopt and make its own facial expression when it interacts with users, so I made various options for face animation for JoJo.

Prototype 2: Web UI

Balancing Visibility and Subtlety in a Background AI Experience.

One key consideration I kept in mind while designing the UI was that JoJo is a background-working web app. That meant I had to carefully think about where the JoJo character should be positioned on the screen without disrupting the user’s workflow.

Turning reports into experiences

Rethinking JoJo’s report screen by leveraging the interactivity of desktop web apps. Instead of stacking static graphs and text, I explored cursor-based design to create a more dynamic and engaging user experience.

Static reports I made initially

Interactive reports

FINAL SOLUTION

Activeness mode + AI Character

JoJo offers thought-provoking questions or prompts based on what’s on your screen

Users can start a discussion using their voice by simply clicking the JoJo icon in the background menu bar.

There’s no need to open the full app. Just speak directly about what’s on the screen. All conversations are transcribed and automatically saved in a dedicated folder.

Of course, users can also engage in voice conversations within the regular chat window.

If Activeness Mode is turned on, even in a regular chat window, JoJo will ask questions to encourage deeper thinking instead of providing direct answers.

Report: Key Metrics JoJo Tracks

Cognitive Thinking Score

This shows how actively you think, ask questions, and solve problems.

Follow-up Question Frequency
Independent Problem-Solving Tasks
Hesitation or Rephrasing
Activeness Mode Usage

Engagement Score

This shows how focused you are during work or study sessions.

Screen Focus Time
Gaze Focus
Emotional Engagement
Typing Speed and Activity

Productivity Score

This is a snapshot of how consistent and effective your work has been.

Active Work Time
Consistency in Task Engagement
Use of Tools
Distraction Time

↓

Overall Score

This is your combined score out of 100.
The higher your score, the more balanced and focused your working habits are.

It’s calculated using:

40% Engagement Score
35% Cognitive Thinking Score
25% Productivity Score

Report

JoJo’s report is designed to help you build better habits with technology by tracking how you think, focus, and interact throughout your day.

Each circle represents a day’s data.

When you hover over a circle, you can see detailed data for that day on the right side. The red-filled circle highlights today’s data.

JoJo compares your current scores with your personal goals.

Your progress over time (daily, weekly, monthly)
Goal achievement rate
Specific recommendations on how to improve

User can set a cognitive thinking & Engagement goal.

To set or edit your goals, click the “Set Goal” or “Edit Goal” button located in the bottom-right corner of the screen.

JoJo shows user's goal in a very simple and intuitive way.

The orange lines represent your personal goals on the chart.

For example, if your Cognitive Thinking Goal is set to 70 and your Engagement Goal is 80, the graph will display those thresholds with horizontal and vertical orange lines.

The orange square highlights the area where you’ve met your Cognitive Thinking Goal.
The blue square highlights where you’ve achieved your Engagement Goal.
The yellow square (where the two overlap) means you’ve successfully achieved both goals.

Wanna see more details?

You can explore more detailed information on the Report page!

Click on JoJo in the doc → Select the report icon on the far-left navigation bar → Then click the “How to Read” section in the report menu next to the nav bar.