Discussion about this post

User's avatar
Sergey Kornilov's avatar

"Her legal team argued that these platforms were designed the same way slot machines are designed, with features engineered to trigger compulsive behavior and keep users locked in. Infinite scrolling, autoplay videos, algorithmic recommendations that feed you more of what gets a reaction, push notifications timed to pull you back in, and beauty filters that warp how a young person sees their own face. Every single one of those features was a deliberate engineering decision. And every single one of those decisions was made to keep users on the platform longer so the company would sell more ads.¹"

We all knew that, though - that's the foundation of behavioral design oriented towards engagement. I do get that the courtroom requires a different evidentiary standard than a blog post or a Netflix documentary, so I'm glad this is happening. But, again, we/you/they could just ask any behavioral scientist if this is the case, because it is absolutely the case both formally and informally (whatever language is used internally will still surface strategic language/choices regarding the optimized reward). And variable ratio reinforcement schedules in gambling are already regulated = because the design itself arguably constitutes a form of manipulation, yes.

These companies employ said scientists, of course, because who else would be designing that? Pre-LLM (pre-bro-with-LLM-era), anyway. Nowadays the tech sector is rediscovering its own science, and quite frankly they had collectively likely ran many more true A/B behavioral experiments than the entirety of behavioral researchers.

I'm really, really glad there is now precedent.

Thank you for bringing this up / writing this up.

Paul Stregevsky's avatar

Anyone who reads Careless People by the fired Meta executive Sarah Wynn-Williams, understands that the rot starts at the top. Zuckerberg denied under oath that Facebook's algorithms, lax moderation, tolerance of misinformation, and marketing tools for wanna-be tyrants made a difference in who got elected. He was shocked---shocked!--that anyone would suggest so. https://www.amazon.com/Careless-People-Cautionary-Power-Idealism/dp/B0DZ8KM7RR/

1 more comment...

No posts

Ready for more?