HeartString-

HeartString-

Heartstring is an innovative digital art therapy platform using AI to help users explore and understand their deepest emotions, going beyond conventional reading to reveal their true feelings and desires.

Heartstring is an innovative digital art therapy platform using AI to help users explore and understand their deepest emotions, going beyond conventional reading to reveal their true feelings and desires.

Heartstring is an innovative digital art therapy platform using AI to help users explore and understand their deepest emotions, going beyond conventional reading to reveal their true feelings and desires.

Role


Researcher

UIUX Designer

Prompt Engineer

Front-end developer

Role


Researcher

UIUX Designer

Prompt Engineer

Front-end developer

Role


Researcher

UIUX Designer

Prompt Engineer

Front-end developer

Timeframe


4 month


Timeframe


4 month


Timeframe


4 month


Tools


Figma

HTML, CSS, Javascript

API




Tools


Figma

HTML, CSS, Javascript

API




Tools


Figma

HTML, CSS, Javascript

API




Background

Background

Overwhelming Emotion

Overwhelming Emotion

In the fast-paced modern world, individuals often struggle to find outlets for emotional expression and introspection.

In the fast-paced modern world, individuals often struggle to find outlets for emotional expression and introspection.

Therapy limitation

Therapy limitation

Traditional forms of therapy may not be accessible or appealing to everyone, due to the cost, time, preference for anonymity, mobility...


Traditional forms of therapy may not be accessible or appealing to everyone, due to the cost, time, preference for anonymity, mobility...


Target Audience

Target
Audience

This project is aimed at individuals overwhelmed by their feelings, primarily comprising students, office employees, and independent contractors.

This project is aimed at individuals overwhelmed by their feelings, primarily comprising students, office employees, and independent contractors.

Overwhelming Emotion

Overwhelming Emotion

In the fast-paced modern world, individuals often struggle to find outlets for emotional expression and introspection.

In the fast-paced modern world, individuals often struggle to find outlets for emotional expression and introspection.

Therapy limitation

Therapy limitation

Traditional forms of therapy may not be accessible or appealing to everyone, due to the cost, time, preference for anonymity, mobility...


Traditional forms of therapy may not be accessible or appealing to everyone, due to the cost, time, preference for anonymity, mobility...

This project is aimed at individuals overwhelmed by their feelings, primarily comprising students, office employees, and independent contractors.

This project is aimed at individuals overwhelmed by their feelings, primarily comprising students, office employees, and independent contractors.

Target Audience

Research

Research

To understand how users deal with their emotions and interact with different therapies, we select a diverse range of participants including students, office workers and freelances for research and interviews.

To understand how users deal with their emotions and interact with different therapies, we select a diverse range of participants including students, office workers and freelances for research and interviews.

To understand how users deal with their emotions and interact with different therapies, we select a diverse range of participants including students, office workers and freelances for research and interviews.

Insights

Insights

The majority of people experience intense feelings more than 5 times weekly.

It's simple for them to connect with visuals and language.

One preferred selection of cards are those that reflect their imaginative and aesthetic tendencies.

The majority of people experience intense feelings more than 5 times weekly.

It's simple for them to connect with visuals and language.

One preferred selection of cards are those that reflect their imaginative and aesthetic tendencies.

The majority of people experience intense feelings more than 5 times weekly.

It's simple for them to connect with visuals and language.

One preferred selection of cards are those that reflect their imaginative and aesthetic tendencies.

Market Research

Market Research

Despite the potential of art therapy in comprehending and articulating feelings, why isn't there more awareness and involvement in this therapy domain?

Despite the potential of art therapy in comprehending and articulating feelings, why isn't there more awareness and involvement in this therapy domain?

Despite the potential of art therapy in comprehending and articulating feelings, why isn't there more awareness and involvement in this therapy domain?

Two popular remedies for easing minor psychological discomfort are mindfulness and virtual peer support. As a result, I've carried out an analysis contrasting these approaches, with the aim to uncover how art therapy can be transformed into a powerful treatment option. The texts in white background highlight their benefits over Art Therapy.

Two popular remedies for easing minor psychological discomfort are mindfulness and virtual peer support. As a result, I've carried out an analysis contrasting these approaches, with the aim to uncover how art therapy can be transformed into a powerful treatment option. The texts in white background highlight their benefits over Art Therapy.

Two popular remedies for easing minor psychological discomfort are mindfulness and virtual peer support. As a result, I've carried out an analysis contrasting these approaches, with the aim to uncover how art therapy can be transformed into a powerful treatment option. The texts in white background highlight their benefits over Art Therapy.

How might we

create an accessible art therapy for individuals undergoing constant, intense emotions, allowing them to find relief through art immersion?

How might we

create an accessible art therapy for individuals undergoing constant, intense emotions, allowing them to find relief through art immersion?

How might we

create an accessible art therapy for individuals undergoing constant, intense emotions, allowing them to find relief through art immersion?

Our Approach

Our Approach

Our Approach

An online platform providing emotive art therapy via therapeutic employment of poetry and drawings

An online platform providing emotive art therapy via therapeutic employment of poetry and drawings

An online platform providing emotive art therapy via therapeutic employment of poetry and drawings

AI Solution

AI Solution

AI Solution

Our solution employs AI algorithms to generate personalized poetry and illustrations, enabling users to create their own mood books and fostering a community for mental healing through infinite machine creativity.

Our solution employs AI algorithms to generate personalized poetry and illustrations, enabling users to create their own mood books and fostering a community for mental healing through infinite machine creativity.

Our solution employs AI algorithms to generate personalized poetry and illustrations, enabling users to create their own mood books and fostering a community for mental healing through infinite machine creativity.

AI generation pipeline

AI generation pipeline

Prompting process

Prompting process

After thousands rounds of testing with different prompts and parameters, the best result comes by Combining emotion with randomly selected poetic forms and poetic devices from predefined categories for each generation.

After thousands rounds of testing with different prompts and parameters, the best result comes by Combining emotion with randomly selected poetic forms and poetic devices from predefined categories for each generation.

After thousands rounds of testing with different prompts and parameters, the best result comes by Combining emotion with randomly selected poetic forms and poetic devices from predefined categories for each generation.

Demo Result

Demo Result

Navigation System

Navigation System

Introducing

Introducing

An AI driven platform for poetry therapy

#1 landing page

#1 landing page

The landing page is consist of the entry for generation and the inspiration pool.

The landing page is consist of the entry for generation and the inspiration pool.

The landing page is consist of the entry for generation and the inspiration pool.

#2 home page (generation interface)

#2 home page

#2 home page

You are invited to input your feelings. If feelings or emotions at this moment aren't easily recognizable, you can select "I can't tell" for prompt advice and stimulus.

During the generation process, you will be exposed to the definition of your input word for further confirmation on your feelings and better understanding yourselves.

You are invited to input your feelings. If feelings or emotions at this moment aren't easily recognizable, you can select "I can't tell" for prompt advice and stimulus.

During the generation process, you will be exposed to the definition of your input word for further confirmation on your feelings and better understanding yourselves.

You are invited to input your feelings. If feelings or emotions at this moment aren't easily recognizable, you can select "I can't tell" for prompt advice and stimulus.

During the generation process, you will be exposed to the definition of your input word for further confirmation on your feelings and better understanding yourselves.

#2 home page (generation interface)

#3 generation page

#3 generation page

Three choices are at the disposal of you during your reading journeys:

Next Page: is available if you connect with the poem or image and wish to continue your reading.

Regenerate: if the content does not strike a chord with you, you always have the option to refresh.

Change: whenever you experience a shift in your emotions, feel free to redefine the sentiments and fabricate new pages anchored in fresh prompts.

Three choices are at the disposal of you during your reading journeys:

Next Page: is available if you connect with the poem or image and wish to continue your reading.

Regenerate: if the content does not strike a chord with you, you always have the option to refresh.

Change: whenever you experience a shift in your emotions, feel free to redefine the sentiments and fabricate new pages anchored in fresh prompts.

Three choices are at the disposal of you during your reading journeys:

Next Page: is available if you connect with the poem or image and wish to continue your reading.

Regenerate: if the content does not strike a chord with you, you always have the option to refresh.

Change: whenever you experience a shift in your emotions, feel free to redefine the sentiments and fabricate new pages anchored in fresh prompts.

#2 home page (generation interface)

#4 mood book formation page

#4 mood book formation page

Upon completing the finish action, your reading journey's mood book will be compiled. Always welcome to read and include it on your book shelf.

Upon completing the finish action, your reading journey's mood book will be compiled. Always welcome to read and include it on your book shelf.

Upon completing the finish action, your reading journey's mood book will be compiled. Always welcome to read and include it on your book shelf.

#2 home page (generation interface)

#5 user account page

#5 user account page

History mood books and collected mood books will be presented under this tab.

History mood books and collected mood books will be presented under this tab.

History mood books and collected mood books will be presented under this tab.

#2 home page (generation interface)

#6 exploration page

#6 exploration page

The discovery page displays all mood books posted by all users. Hit the heart button if you resonate with their feelings.

The discovery page displays all mood books posted by all users. Hit the heart button if you resonate with their feelings.

The discovery page displays all mood books posted by all users. Hit the heart button if you resonate with their feelings.

Interface Design System

Interface Design System

Interface Design System

Design Language

Design Language

Interface Design System

Reflection and next steps

Reflection and next steps

Reflections: This is an amazing experience! I decided to start this project when I feel like there's a need to artistically address mental health issues in people's normal life. I researched on compelling poems and illustration creation, designed the interfaces and experiences for the innovative and digital art therapy concept, prompted the generating instructions and coded the workable website with Javascript, css, html in React..

This is also my first project to explore the infinite generativity of machines. I created this in my Art and Machine learning course, when I kept thinking of what role machine will play in human life and how could we make use of AI generated content. 


Next steps: In my case, the poems and illustrations generation speed and quality are two most challenging issues. In the future development, I expect to leverage machine learning techniques to predict how users’ feelings change and what kind of themes would most surprise them.  I'm also actively seeking opportunities to bring this concept to life in this year!

Reflections: This is an amazing experience! I decided to start this project when I feel like there's a need to artistically address mental health issues in people's normal life. I researched on compelling poems and illustration creation, designed the interfaces and experiences for the innovative and digital art therapy concept, prompted the generating instructions and coded the workable website with Javascript, css, html in React..

This is also my first project to explore the infinite generativity of machines. I created this in my Art and Machine learning course, when I kept thinking of what role machine will play in human life and how could we make use of AI generated content. 


Next steps: In my case, the poems and illustrations generation speed and quality are two most challenging issues. In the future development, I expect to leverage machine learning techniques to predict how users’ feelings change and what kind of themes would most surprise them.  I'm also actively seeking opportunities to bring this concept to life in this year!

Reflections: This is an amazing experience! I decided to start this project when I feel like there's a need to artistically address mental health issues in people's normal life. I researched on compelling poems and illustration creation, designed the interfaces and experiences for the innovative and digital art therapy concept, prompted the generating instructions and coded the workable website with Javascript, css, html in React..

This is also my first project to explore the infinite generativity of machines. I created this in my Art and Machine learning course, when I kept thinking of what role machine will play in human life and how could we make use of AI generated content. 


Next steps: In my case, the poems and illustrations generation speed and quality are two most challenging issues. In the future development, I expect to leverage machine learning techniques to predict how users’ feelings change and what kind of themes would most surprise them.  I'm also actively seeking opportunities to bring this concept to life in this year!