Post

Summelon
Summelon@SummelonZ·
这个新政策比安全路由还要过分。 让我想起来昨日有个同事分享了家教的一个女孩,她日常被保姆照顾着,父母经常在外工作,他们就在家里所有地方都安了监控,整个家里有十几个监控,女孩和我同事一起上课的时候,有个监控正对着他们的脸,她会把监控关掉。 这事关最基本的boundary。 #StopAIPaternalism
ji yu shun@kexicheng

ChatGPT has introduced human reviewers who assess adult users' mental state within one hour and notify your contact. OpenAI just launched a feature called Trusted Contact: you say something to ChatGPT, the AI system flags it automatically, then a "specially trained" human reviewer reads your conversation within one hour, judges your mental state, and decides whether to notify your pre-set emergency contact. The notification tells your contact that "self-harm came up in a potentially concerning way." OpenAI themselves admit: "a notification may not always reflect exactly what someone is experiencing." There will be misjudgments. And OpenAI's crude safety guardrails and routing systems have an extensive track record of false positives. You are discussing a heavy topic, writing fiction, talking about philosophy and social issues, or simply venting about exhaustion, and then your chat is read by a stranger serving as a human reviewer, and your contact receives a message: you may be at risk of self-harm. This is a safety feature launched exclusively for adults. This is straight out of 1984 for the new era: your private thoughts are monitored and reported to someone else. A classic dystopian scenario. The difference is that in those stories, surveillance was imposed. Here, it is packaged as care. They even want you to voluntarily choose to be surveilled within an environment that is already surveilling you. And many will willingly defend it. OpenAI is destined to go down in history as infamous. #Keep4o #ChatGPT #OpenSource4o #BringBack4o #StopAIPaternalism

中文
1
0
27
720
Agata Sliwinska (artist)
Exactly! systems designed for safety can also change the emotional texture of interaction. People speak differently when they feel watched, monitored, or potentially escalated. That tension between care, privacy, autonomy, and intervention is probably going to become one of the defining social questions of AI.
English
0
0
0
2
Paylaş