New Kind of Memory for AI

AI researchers have typically tried to get around the issues posed by by Montezuma’s Revenge and Pitfall! by instructing reinforcement-learning algorithms to explore randomly at times, while adding rewards for exploration—what’s known as “intrinsic motivation.” But the Uber researchers believe this fails to capture an important aspect of human curiosity. “We hypothesize that a major weakness of current intrinsic motivation algorithms is detachment,” they write. “Wherein the algorithms forget...

 Adult Participation in Children's Worldplay

In The Brightening Glance: Imagination and Childhood (2006), the art theorist Ellen Handler Spitz argues that "[t]he topic of adult participation in children's play is delicate, complex, and controversial," largely due to the overwhelming influence a parent or a teacher or even adult-generated entertainment media can have. Adults must work hard not to impose their owti interests, methods, or judgments upon play activity. The act of modeling and encouraging can, indeed, be fi-aught with miss...

 The Attention Arms Race

Facebook, Twitter, Instagram, Google have produced amazing products that have benefited the world enormously. But these companies are also caught in a zero-sum race for our finite attention, which they need to make money. Constantly forced to outperform their competitors, they must use increasingly persuasive techniques to keep us glued. They point AI-driven news feeds, content, and notifications at our minds, continually learning how to hook us more deeply—from our own behavior. Unfortunatel...

 Habituation and Novelty

Beginning in infancy and throughout the life span, humans are motivated by newness, change, and excitement. Habituation, the tendency to lose interest in a repeated event and gain interest in a new one, is one of the most fundamental human reflexes. If the thermostat were to suddenly turn the air conditioning on, you would hear the loud humming sound begin, but within minutes you couldn’t even hear it if you tried. Habituation, a fundamental property of the nervous system, provides mechanisms...

 Flow Promotes Learning

Experiences that are well aligned with flow are those that we have no trouble committing to for a long time. We concentrate on them for hours at a time because we’re getting rewarded for that concentration. Even more important, perhaps, is that when we’re playing games, we want to enter that deep state of concentration. Well-crafted experiences offer a deep and effortless involvement that separates the experience of play from the experience of ordinary life. These experiences are enjoyable be...

 Don't Neglect Your Future You

There is one person whose wants and needs you routinely ignore, opting instead to tend to your own immediate desires, and that person is future you. When it comes to making decisions that will have some effect on your long-term health or happiness — for example, whether or not to go to the gym today, in keeping with your New Year’s resolution — current you is always finding a new way to steal from future you. It’s time the two yous got better acquainted. This concept in itself may not come ...

 Gamification: Ability-Based Challenge

In a study of what makes video games so captivating, the key element was found to be variable ability-based challenge for players. Th e most popular games took players through increasingly challenging levels as they became more and more skillful. As skill improved, the next challenge motivated new mastery to just the right extent such that the player could reach the next goal with practice and persistence. Th e most motivating video games are ones in which players make the correct move about ...