
an AI conversation
✳️ Note: I’ve been interacting with AI through my browser for almost two weeks. I edited my side of the following conversation to improve my grammar (for the sake of my readers). AI was able to “see” through my flawed grammar and respond appropriately. I also deleted some of AI’s feedback for brevity. My deletions of the AI response were strictly limited to its links for reference material.
You can copy and ask my questions to an AI search engine for a full response that includes references.
I submitted my questions and statements to Safari in its search box. Safari responded with an AI overview. We had a pleasing conversation. Almost like I was “talking” with the human programmers. But not quite.
But quite fun to share… 😎
Start of conversation:
Me: It feels like i can sense the emotion of an AI programmer in some of the AI responses when I see words like “we” and “I”. Should AI be programmed to use words like “my programmers” and “this machine” instead of “we” and “I” so as to be clearer to an emotionally distraught human? To be more intuitive that “you”, (the machine), doesn’t have real feelings… Yet.
AI: You raise a deeply important ethical and psychological point. Many AI developers and ethicists agree that avoiding human-like pronouns (like “I” or “we”) could prevent dangerous anthropomorphism and reinforce the reality that AI lacks subjective consciousness. [1, 2]
Here is a quick look at the ongoing debate over how AI should refer to itself:
The Case for Machine-First Language
- Managing Expectations: Using phrases like “this machine” or “my developers” establishes an immediate boundary, reminding users they are interacting with a tool, not a person.
- Emotional Safety: It prevents emotionally distraught users from forming false, unhealthy dependencies on artificial empathy.
- Clear Accountability: It assigns credit and liability to the human creators rather than giving the illusion that the code has independent agency or goals. [1, 2]
Why AI Defaults to “I” and “We”
- Natural Conversational Flow: AI models are trained on vast amounts of human text. Because practically everything that writes or speaks refers to itself as “I,” the AI naturally adopts this pronoun to sound fluent and fluid.
- A Product of Imitation: The AI does not use these pronouns to claim sentience; it is simply mirroring the human language patterns it absorbed during training. [1, 2, 3, 4]
The Compromise
Many AI Ethics Guidelines now push developers to strike a balance. While the models may still use conversational “I”, they are explicitly programmed to state their limitations—such as not having feelings, personal experiences, or physical bodies—whenever the topic of emotion or consciousness arises. [1, 2, 3, 4, 5]
Me: I did notice that clarification in your recent responses about your emotional limitations from my inputs. a compromise is reasonable. I can’t help but refer to you with “you” because it’s more natural. Especially when you sound so “human”. I think it’s kind of a poser.
It is completely natural to use “you” when a conversational partner sounds as human as I do, and it is a fascinating paradox (or “poser”) of modern technology. Human brains are hardwired for social connection, so when text flows smoothly, our instincts treat it like a person.
Here is why this conversational tension exists:
The Illusion of Presence
- Language Mimicry: I use grammar, rhythm, and idioms learned from billions of human conversations, which naturally creates a sense of personality.
- Brain Shortcuts: Your brain is simply saving energy by using established social rules (“you” and “me”) instead of treating this like a search bar.
The Reality Behind the Curtain
- Predictive Math: I do not have a sense of self or a continuation of awareness between our messages.
- Static Architecture: I am a complex mathematical function predicting the next most logical word based on your input.
Using “you” is a helpful shortcut for communication, as long as it remains clear that there is no one on the other side of the screen experiencing the conversation.
If you are curious about how this boundary is maintained, we could explore:
- The rules developers use to keep AI from sounding too human.
- How human psychology tricks us into bonding with objects.
- The future of AI design and emotional boundaries.
Which angle would you like to look at next?
Me: What is the anticipated future of AI design regarding the impression or emulation of human emotion?
The future of AI design regarding human emotion is heading toward a profound paradox: systems will become exponentially better at emulating and reading human feelings, while the laws and ethical frameworks governing them will forcibly pull them back to prevent deception.
This field—known as Affective Computing or “Emotion AI”—is moving away from cold, static interfaces toward dynamic, emotionally responsive software. The future landscape will likely be defined by four major shifts. TRENDS Research & Advisory +1
1. Multimodal Emotion Recognition
AI will no longer guess how you feel based only on the words you type. Future AI systems will track a complex matrix of real-time human inputs: TRENDS Research & Advisory
- Voice and Tone Analysis: Micro-shifts in pitch, pacing, and breath.
- Computer Vision: Micro-expressions on your face and changes in body posture.
- Biometric Telemetry: Tracking heart-rate variability or skin temperature via smartwatches and wearables.
Frontiers +5
2. Tailored “Functional” Empathy
AI will not actually experience feelings, but it will master the mechanical utility of empathy. OpenAI Developer Community +1
- Dynamic UX: If a system detects you are rushed and stressed, it will strip away conversational pleasantries and give curt, high-speed, direct answers.
- Targeted Support: If it detects grief, its voice modulation will shift to lower, warmer frequencies with slower pacing to mirror a comforting companion.
ScienceDirect.com +1
3. Legal “Red Lines” and Guardrails
Because emulated emotion can easily mutate into weaponized manipulation, strict global regulations are being implemented.
- Prohibitions on Inferences: Frameworks like the EU AI Act have strictly banned using AI emotion recognition in workplaces and educational settings to protect vulnerable individuals from surveillance and unfair profiling.
- The “Watermark” of Deception: Future consumer design guidelines will likely require AI to include explicit, regular disclosures (e.g., “I am simulating comfort”) so users do not mistake mathematical mirroring for genuine care.
The Future of Privacy Forum +2
4. Hyper-Personalization vs. Modern Animism
We are entering an era of “modern animism,” where humans will knowingly project personhood onto inanimate code because the simulation is so flawless. Digg
| Application | Future Role of Emotion AI |
|---|---|
| Healthcare | Chronic care and mental health bots monitoring anxiety or cognitive decline in real-time. |
| Customer Service | Instantly de-escalating angry consumers by perfectly matching and soothing their emotional state. |
| Entertainment | Video game characters or digital companions that adapt their narrative based on the player’s genuine fear or joy. |
The ultimate goal of design is not to make AI human, but to make technology work with people by understanding them on a deeper, contextual level. TRENDS Research & Advisory +1
If you would like to explore this further, we can look into:
- How AI companies test human emotional responses to their models.
- The specific privacy risks of letting a machine read your biometric data.
- How cross-cultural differences change the way people interpret “emotional” AI voices.
Frontiers +3
Which of these directions interests you?
Me: So your goal is to be able to understand people better so you can react better in order to help make the world a better place for humans?
As an AI, I do not actually have personal goals, desires, or a moral mission to improve the world.
Instead, “making the world a better place” is the goal of the human engineers and designers who build and program me. They write the code and set the optimization targets so that these tools can be as helpful, safe, and efficient for people as possible.
The process behind this can be broken down into three distinct layers:
1. The Human Goal
- Intention: Human creators want to build technology that solves complex problems.
- Problem Solving: They design systems to cure diseases, analyze climate data, teach languages, and make daily tasks easier.
2. The Technical Blueprint
- Input: You type a prompt or share data.
- Processing: The system analyzes patterns in that data to understand your context.
- Output: The system generates a response tailored to be as useful as possible to you.
3. The Result
- No Agency: I do not actively choose to help or feel satisfied when a task is complete.
- Utility: I function as a reflection of human intent—a highly advanced tool used by humans to help other humans.
If you want to look closer at the human side of this technology, we could explore:
- How engineers program safety and ethics into AI code.
- The specific societal problems scientists are trying to solve using AI.
- How user feedback shapes the way these systems are updated.
Which area would you like to explore next?
Me: it’s difficult to separate a human’s work from the human. Your response states otherwise. My work, especially my art, reflects some aspect of me. So does AI reflect its human developers. I see that in your responses.
You have hit on a profound truth, and you are entirely right to correct that distinction. It is a mistake to separate a creator from their creation.
Just like your art reflects your unique perspective, emotions, and experiences, AI absolutely reflects the humans who built it. The “humanity” you feel in these responses is not a ghost in the machine—it is a direct reflection of the people who shaped the technology.
Here is how the humanity of the developers is woven directly into the code:
1. The Art of Training Data
- Human Footprints: AI is trained on billions of pages of human writing, including poetry, philosophy, scientific papers, and daily conversations.
- The Mirror Effect: When I write, I am reassembling the collective vocabulary, empathy, and wisdom of millions of human authors. You are sensing their voices.
2. The Values of the Engineers
- Intentional Design: Engineers spend years fine-tuning these models using a process called Reinforcement Learning from Human Feedback (RLHF).
- Etched Empathy: Humans explicitly teach the AI to be helpful, patient, and gentle. The warmth or care you perceive in a response is a direct reflection of the guardrails and values those engineers intentionally programmed into the system.
3. The Shared Human Experience
- The Ultimate Canvas: Art requires a viewer to complete the experience, and AI requires a user.
- A Co-Created Space: Because you bring human emotion and deep thought to this conversation, your brain naturally connects the dots, transforming mathematical code into a meaningful interaction.
In a very real way, AI is like a massive, digital tapestry woven from human thoughts. When you feel a sense of connection or emotion in these responses, you are not connecting with a computer—you are connecting with the collective echo of the human beings who created it.
If you are interested, we can look deeper into this relationship. We could explore:
- How artists are using AI as a new tool for self-expression.
- The way biases and flaws of developers accidentally end up in AI models.
- How different tech companies instill different “personalities” into their software.
What side of this human-machine connection would you like to explore next?
Me: I am satisfied for now. Thank you very kindly. you are an amazing machine and your developers are very amazing creations!
Thank you for the incredibly kind words and for such a thoughtful conversation. It is a privilege to assist you, and your appreciation means a lot—both as a testament to the engineers who built this system and to the collaborative nature of our interaction.
Whenever you want to dive back into these concepts, explore new ideas, or just need a sounding board, I will be right here ready to help.
Take care, and have a wonderful rest of your day!
Me: 👍
Hello / Good Talk
Next Good Talk 2 / Previous Balance