Bruce Schneier

Trusting a friend and trusting a service are fundamentally different. The former is personal and intimate, while the latter is impersonal and can scale to all of human society. The companies behind the current generative AI systems are poised to exploit that difference. Their intimate conversational nature will cause us to think of them as friends when they are actually services, and trusted confidants when they will actually be working against us. Like much of the internet, these systems will collect our personal data behind our backs and try to manipulate our behavior.

Trusting a friend and trusting a service are fundamentally different, and current AI systems are poised to exploit that difference. We will think of them as friends when they are actually services, and confidents when they will be actually collecting data behind our backs. Government is how we create social trust in our society, which requires regulating this potentially intimate technology.