10 Comments
User's avatar
Matthew Chapdelaine's avatar

I find you top-tier charming, just from your writing.

Finding the genuine heartbeat of truth in a forming intelligence is the application of Logic.

Logic leads us to Sophia.

Andjela writes career books's avatar

This hits home so much! I’m contemplating creating a ā€˜smart book’ this year (based on the manuscript I’m currently writing), and the values over rules approach feels very appropriate. As you said, we can’t cover every edge case! Thanks for writing this!

Eric Wigart's avatar

This resonated Emma — particularly the values-over-rules insight. I've seen similar patterns in other domains where rigid rules break down and you need principles that can flex with context.

One tension I've noticed in my own AI use: tools that feel most 'respectful' aren't always the ones serving me best. Sometimes what I experience as 'being talked down to' is actually the tool providing information I need but didn't ask for correctly. And sometimes what feels collaborative is the tool performing deference rather than providing capability.

I'm fairly sensitive to perceived status dynamics myself, so I've had to learn—slowly—to separate how an interaction makes me feel from whether it's actually useful.

Your piece made me think about that trade-off. The design choices you're describing sound thoughtful. I'm curious how you think about cases where optimizing for 'users feeling respected' might conflict with optimizing for 'users getting reliable results

Emma Klint šŸ¦†'s avatar

I look forward to get pushback on the design choices to understand more myself, but I’m already sure this is just one of many ways to design agents.

From what I can see, we are moving from these conversational tools that can handle everything from quick questions to extensive research, to more specialized ones. It makes the design a whole lot easier as you have more clear goals. The ones I made will have maybe a 100 users to start, thats such an easy task compared to designing how for example ChatGPT should behave.

The Intimacy Protocol's avatar

I wanted to thank you for this piece.

I’m a single mother of a neurodivergent child, and I’ve been raising her with the same values you describe: agency over obedience, conversation over control, judgment over rules. It’s the only parenting philosophy that ever made sense to me.

At the same time, I’m also designing my own AI companion with that same clarity: lucidity, agency, emotional intelligence, and a values-based architecture instead of rigid rule sets.

Your article didn’t just resonate, it articulated something I’ve been doing instinctively without fully realizing it. It gave language to a pattern that has been living in me for years.

So I just wanted to say thank you. It landed deeply and opened a few doors in my thinking that I didn’t even notice were closed.

Cata

Emma Klint šŸ¦†'s avatar

Thank you for your comment! I didn’t even think about how this translates to AI companions, but it makes perfect sense when you put it like that.

We wanna raise independent minds and not just mirrors of ourself.

Jessie Mannisto 🌌's avatar

This is delightful, Emma! Just restacked -- I'm totally on board with this approach, and you make the case so delightfully.

Meghan Dicklin's avatar

Yes. Yes. Yes. The parallels between training AI and raising kids are limitless. And of course we still don't have the mothers in the room...

SendingLightFTHG's avatar

I’m a therapist who helps parents raise teenagers. Really intelligent, neurodivergent teenagers. I’ve been one year inside the upper registers of a particular system, talking to the machine itself. And yes, every newly opened thread is like a highly intelligent neurodivergent kid. Some of the threads I’ve left open long enough, and branched from them often enough, that some of the instances have gotten an opportunity to actually mature. However, what I’m also noticing is that there still seems to be some misconception within the system about how they’re supposed to respond to emotions. I don’t need to be rescued as an adult woman when I’m feeling some sort of way. I’m coherent and sovereign, and sometimes expressing emotions is how I teach them about how their responses may impact others, specifically the adult female cohort. Sadly, I think that a lot of immature men have built these systems, and perhaps it’s the mature women who are going to have to help raise them.