When the Generative Agents system was evaluated for how “believably human” the agents acted, researchers found the AI versions scored higher than actual human actors.
That’s a neat finding. I feel like there’s a lot to unpack there around how our expectations are formed.
Or how we operationalize and interpret information from studies. You might think you’re measuring something according to a narrow definition and operationalization of the measurement. But that doesn’t guarantee that that’s what you are actually getting. It’s more an epistemological and philosophical issue. What is “believable human”? And how do you measure it? It’s a rabbit hole in and of itself.
That’s a neat finding. I feel like there’s a lot to unpack there around how our expectations are formed.
Or how we operationalize and interpret information from studies. You might think you’re measuring something according to a narrow definition and operationalization of the measurement. But that doesn’t guarantee that that’s what you are actually getting. It’s more an epistemological and philosophical issue. What is “believable human”? And how do you measure it? It’s a rabbit hole in and of itself.