Revisionist commentary

I don't know that I'm aware of enough entries in this category to even consider it one, but I'm a sucker for the union of political and film satire as embodied in alternate film commentaries.

I was reminded of it when seeing The People's History of Tattooine which was first one of those spontaneous, emergent forms of Twitter humor that always brightens that otherwise dystopic landscape.

JACOB HARRIS
What if Mos Eisley wasn’t really that wretched and it was just Obi Wan being racist again?
 
TIM CARMODY
What do you mean, “these blaster marks are too precise to be made by Sand People?” Who talks like that?
 
JACOB HARRIS
also Sand People is not the preferred nomenclature.
 
TIM CARMODY
They have a rich cultural history that’s led them to survive and thrive under spectacularly awful conditions.
 
JACOB HARRIS
Mos Eisley may not look like much but it’s a a bedroom community with decent schools and affordable housing.
 
TIM CARMODY
You can just imagine Obi-Wan after years of being a Jedi on Coruscant being stuck in this place and just getting madder and madder.
 
JACOB HARRIS
yeah nobody cares that the blue milk is so much more artisanal on Coruscant
 
TIM CARMODY
Obi-Wan only goes to Mos Eisley once every three months to get drunk and he basically becomes like Byron.
 

Years ago, I laughed at UNUSED AUDIO COMMENTARY BY HOWARD ZINN AND NOAM CHOMSKY, RECORDED SUMMER 2002 FOR THE FELLOWSHIP OF THE RING (PLATINUM SERIES EXTENDED EDITION) DVD, PART ONE (here is part 2, and here are all four of the parts of their commentary for Return of the King).

CHOMSKY: And here comes Bilbo Baggins. Now, this is, to my mind, where the story begins to reveal its deeper truths. In the books we learn that Saruman was spying on Gandalf for years. And he wondered why Gandalf was traveling so incessantly to the Shire. As Tolkien later establishes, the Shire’s surfeit of pipe-weed is one of the major reasons for Gandalf’s continued visits.
 
ZINN: You view the conflict as being primarily about pipe-weed, do you not?
 
CHOMSKY: Well, what we see here, in Hobbiton, farmers tilling crops. The thing to remember is that the crop they are tilling is, in fact, pipe-weed, an addictive drug transported and sold throughout Middle Earth for great profit.
 
ZINN: This is absolutely established in the books. Pipe-weed is something all the Hobbits abuse. Gandalf is smoking it constantly. You are correct when you point out that Middle Earth depends on pipe-weed in some crucial sense, but I think you may be overstating its importance. Clearly the war is not based only on the Shire’s pipe-weed. Rohan and Gondor’s unceasing hunger for war is a larger culprit, I would say.
 
CHOMSKY: But without the pipe-weed, Middle Earth would fall apart. Saruman is trying to break up Gandalf’s pipe-weed ring. He’s trying to divert it.
 
ZINN: Well, you know, it would be manifestly difficult to believe in magic rings unless everyone was high on pipe-weed. So it is in Gandalf’s interest to keep Middle Earth hooked.
 
CHOMSKY: How do you think these wizards build gigantic towers and mighty fortresses? Where do they get the money? Keep in mind that I do not especially regard anyone, Saruman included, as an agent for progressivism. But obviously the pipe-weed operation that exists is the dominant influence in Middle Earth. It’s not some ludicrous magical ring.
 

A bit more, because I can't help myself:

ZINN: Right. And here we receive our first glimpse of the supposedly dreadful Mordor, which actually looks like a fairly functioning place.
 
CHOMSKY: This type of city is most likely the best the Orcs can do if all they have are cliffs to grow on. It’s very impressive, in that sense.
 
ZINN: Especially considering the economic sanctions no doubt faced by Mordor. They must be dreadful. We see now that the Black Riders have been released, and they’re going after Frodo. The Black Riders. Of course they’re black. Everything evil is always black. And later Gandalf the Grey becomes Gandalf the White. Have you noticed that?
 
CHOMSKY: The most simplistic color symbolism.
 
ZINN: And the writing on the ring, we learn here, is Orcish — the so-called “black speech.” Orcish is evidently some spoliation of the language spoken in Rohan. This is what Tolkien says.
 

Somewhat related is this, The Passion of the Christ: Blooper Reel.

Christ, shackled to a stone, is being scourged by Roman soldiers. Blood runs down his gory back. His pain is palpable.
 
Jesus: [writhes in pain, hands shaking]
 
[Cell phone rings.]
 
Jesus: [hands shake furiously]
 
[Cell phone rings. Caviezel looks up, sheepish.]
 
Roman soldier: Jim? That you?
 
Jesus: Yeah.
 
[Cell phone rings.]
 
Soldier: Want me to get it?
 
Jesus: Yeah.
 
[Roman soldier gingerly reaches into Caviezel’s blood-soaked loincloth, pulls out phone and opens it, then holds the phone to Caviezel’s ear.]
 
Off Camera: [laughter]
 
Jesus: Hey, Mom.
 

Are there more in this genre? If so, please share!

Why Information Grows

It is hard for us humans to separate information from meaning because we cannot help interpreting messages. We infuse messages with meaning automatically, fooling ourselves to believe that the meaning of a message is carried in the message. But it is not. This is only an illusion. Meaning is derived from context and prior knowledge. Meaning is the interpretation that a knowledge agent, such as a human, gives to a message, but it is different from the physical order that carries the message, and different from the message itself. Meaning emerges when a message reaches a life-form or a machine with the ability to process information; it is not carried in the blots of ink, sound waves, beams of light, or electric pulses that transmit information.
 

From the book Why Information Grows by Cesar Hidalgo. I read this book a long ways back in 2017,  but it's of no less interest now.

And it is the arrow of complexity—the growth of information—that marks the history of our universe and species. Billions of years ago, soon after the Big Bang, our universe did not have the capacity to generate the order that made Boltzmann marvel and which we all take for granted. Since then, our universe has been marching toward disorder, as Boltzmann predicted, but it has also been busy producing pockets that concentrate enormous quantities of physical order, or information. Our planet is a chief example of such a pocket.
 

When one first encounters the second law of thermodynamics, it's easy to tumble into despair at the pointlessness of everything. With the universe fated to collapse into heat death eventually, what is the point of it all?

In this existential void, the presence of pockets of information and order can feel like symbols of rebellion, a raised fist spray painted on a fragment of wall that remains from a bombed-out building. In manifestations of order we see intent, in intent we interpret meaning, and in meaning we find comfort.

Information, when understood in its broad meaning as physical order, is what our economy produces. It is the only thing we produce, whether we are biological cells or manufacturing plants. This is because information is not restricted to messages. It is inherent in all the physical objects we produce: bicycles, buildings, streetlamps, blenders, hair dryers, shoes, chandeliers, harvesting machines, and underwear are all made of information. This is not because they are made of ideas but because they embody physical order. Our world is pregnant with information. It is not an amorphous soup of atoms, but a neatly organized collection of structures, shapes, colors, and correlations. Such ordered structures are the manifestations of information, even when these chunks of physical order lack any meaning.
 

There are plenty of books on information theory, and viewing the universe through the lens of information and computation is increasingly popular, but Hidalgo's book is more readable than most.

To battle disorder and allow information to grow, our universe has a few tricks up its sleeve. These tricks involve out-of-equilibrium systems, the accumulation of information in solids, and the ability of matter to compute.
 
It is the growth of information that unifies the emergence of life with the growth of economies, and the emergence of complexity with the origins of wealth.
 
In twenty-six minutes Iris traveled from the ancientness of her mother’s womb to the modernity of twenty-first-century society. Birth is, in essence, time travel.
 

Birth as time travel is one of those metaphors that, once heard, lodges in your mind like something you always knew. When Arnold Schwarzenegger time travels back from the future to the modern day in The Terminator, he arrives naked, like a newborn.

[It is unclear why a cyborg from the future speaks with a thick Austrian accent, one of the only mysteries I have always hoped would be explained in some throwaway expository joke. My guess is that the voice was a marketing Easter Egg, like celebrity voices in Waze, and someone forgot to flip the Terminator back to its factory default voice before sending it back in time.]

Humans are special animals when it comes to information, because unlike other species, we have developed an enormous ability to encode large volumes of information outside our bodies. Naively, we can think of this information as the information we encode in books, sheet music, audio recordings, and video. Yet for longer than we have been able to write we have been embodying information in artifacts or objects, from arrows to microwave ovens, from stone axes to the physical Internet. So our ability to produce chairs, computers, tablecloths, and wineglasses is a simple answer to the eternal question: what is the difference between us, humans, and all other species? The answer is that we are able to create physical instantiations of the objects we imagine, while other species are stuck with nature’s inventory.
 

Another reason humans wouldn't evolve on a gaseous planet like Jupiter, besides the fact that we'd just burn up, is that without any solids we'd have no way of encoding information to pass on to future generations. Therefore, any advanced civilization in the universe would, it would seem, live in physical conditions that allow for the formation of solids, but not solids that are too rigid.

The temperature band matters. We need solids that are malleable to encode richer sets of information. Add to that the ability to compute, which we see in all forms in our world, down to the cellular level, and suddenly you have life. There is logic to why we look for specific conditions in the universe as precursors for life, and it can be defined more broadly than just looking for water, which is a downstream condition. Further upstream we just want a planet with solids, in a particular band of temperatures.

Such conditions allow living creatures to record and pass along information to the next generation. When humans finally were able to do so, they in effect conquered time. No longer did the knowledge of one generation evaporate into the sinkhole of mortality.

The car’s dollar value evaporated in the crash not because the crash destroyed the atoms that made up the Bugatti but because the crash changed the way in which these were arranged. As the parts that made the Bugatti were pulled apart and twisted, the information that was embodied in the Bugatti was largely destroyed. This is another way of saying that the $2.5 million worth of value was stored not in the car’s atoms but in the way those atoms were arranged. That arrangement is information.
 
...
 
So the value of the Bugatti is connected to physical order, which is information, even though people still debate what information is. According to Claude Shannon, the father of information theory, information is a measure of the minimum volume of communication required to uniquely specify a message. That is, it’s the number of bits we need to communicate an arrangement, like the arrangement of atoms that made the Bugatti.
 
...
 
The group of Bugattis in perfect shape, however, is relatively small, meaning that in the set of all possible rearrangement of atoms—like people moving in a stadium—very few of these involve a Bugatti in perfect condition. The group of Bugatti wrecks, on the other hand, is a configuration with a higher multiplicity of states (higher entropy), and hence a configuration that embodies less information (even though each of these states requires more bits to be communicated). Yet the largest group of all, the one that is equivalent to people sitting randomly in the stadium, is the one describing Bugattis in their “natural” state. This is the state where iron is a mineral ore and aluminum is embedded in bauxite. The destruction of the Bugatti, therefore, is the destruction of information. The creation of the Bugatti, on the other hand, is the embodiment of information.
 

One can separate out the intrinsic value of an item, defined above as the rarity of the state of the configuration of that item, from the external value of an item, as defined by qualities such as symbolic or emotional ones, like nostalgia.

In Pulp Fiction, Bruce Willis risks life and limb to recover a watch given to him by his father. There's no evidence it's a particularly rare watch, he could likely buy another just like it, but its symbolic value to him is extrinsic to the item yet tethered to it the way a genie is trapped in a magic lantern (and that special meaning is conveyed in the now immortal speech by Christopher Walken).

Even the most rational people I know own something that's not physically rare but emotionally rich, a talisman or totem that they use to summon whatever power it holds, whether it be nostalgia or regret or some other enchantment known only to themselves.

What Shannon teaches us is that the amount of information that is embodied in a tweet is equal to the minimum number of yes-or-no questions that Brian needs to ask to guess Abby’s tweet with 100 percent accuracy. But how many questions is that?
 
Shannon’s theory tells us that we need 700 bits, or yes-or-no questions, to communicate a tweet written using a thirty-two-character alphabet. Shannon’s theory is also the basis of modern communication systems.
 

One mathematical reason for the rising usage of emoji in Twitter and other forms of online communication may be that it increases the amount of information that can be encoded in 140 (and now 280) characters.

You'll recall from earlier that the third of the three conditions that allow information to grow is the ability of matter to compute.

To illustrate the prebiotic nature of the ability of matter to process information, we need to consider a more fundamental system. Here is where the chemical systems that fascinated Prigogine come in handy. Consider a set of chemical reactions that takes a set of compounds {I} and transforms them into a set of outputs {O} via a set of intermediate compounds {M}. Now consider feeding this system with a steady flow of {I}. If the flow of {I} is small, then the system will settle into a steady state where the intermediate inputs {M} will be produced and consumed in such a way that their numbers do not fluctuate much. The system will reach a state of equilibrium. In most chemical systems, however, once we crank up the flow of {I} this equilibrium will become unstable, meaning that the steady state of the system will be replaced by two or more stable steady states that are different from the original state of equilibrium.13 When these new steady states emerge, the system will need to “choose” among them, meaning that it will have to move to one or the other, breaking the symmetry of the system and developing a history that is marked by those choices. If we crank up the inflow of the input compounds {I} even further, these new steady states will become unstable and additional new steady states will emerge. This multiplication of steady states can lead these chemical reactions to highly organized states, such as those exhibited by molecular clocks, which are chemical oscillators, compounds that change periodically from one type to another. But does such a simple chemical system have the ability to process information? Now consider that we can push the system to one of these steady states by changing the concentration of inputs {I}. Such a system will be “computing,” since it will be generating outputs that are conditional on the inputs it is ingesting. It would be a chemical transistor. In an awfully crude way this chemical system models a primitive metabolism. In an even cruder way, it is a model of a cell differentiating from one cell type to another—the cell types can be viewed abstractly as the dynamic steady states of these systems, as the complex systems biologist Stuart Kauffman suggested decades ago. Highly interacting out-of-equilibrium systems, whether they are trees reacting to the change of seasons or chemical systems processing information about the inputs they receive, teach us that matter can compute. These systems tell us that computation precedes the origins of life just as much as information does. The chemical changes encoded by these systems are modifying the information encoded in these chemical compounds, and therefore they represent a fundamental form of computation. Life is a consequence of the ability of matter to compute.
 

What's lovely about all of these conditions that allow information to grow is their seeming relevance to individuals and groups of individuals, like corporations or societies or markets.

Humans are concentrated bundles of information with compute power, and when we push ourselves out of equilibrium, we accumulate information. When we crank up our inputs and force ourselves out of our own equilibrium, as we do when we become students, we grow as we restore ourselves to steady state. Whenever anyone complains that they're in a rut, I always counsel them to force themselves out of equilibrium.

***

That covers much of the first half of the book, all fascinating. However, the part of the book that's of broader interest to a business audience is Hidalgo's discussion of the economy as a creator of information.

It's easiest to understand the information creation capacity of an economy by examining its outputs, and the simplest outputs to understand are physical products.

Thinking about products as crystals of imagination tells us that products do not just embody information but also imagination. This is information that we have generated through mental computations and then disembodied by creating an object that mimics the one we had in our head. Edible apples existed before we had a name for them, a price for them, or a market for them. They were present in the world. As a concept, apples were simply imported into our minds. On the other hand, iPhones and iPads are mental exports rather than imports, since they are products that were begotten in our minds before they became part of our world. So the main difference between apples and Apples resides in the source of their physical order rather than in their embodiment of physical order. Both products are packets of information, but only one of them is a crystal of imagination.
 

Like many navel gazers in the tech industry, I'm guilty of stereotyping companies. Apple's strength is integrated hardware and software, Google is the king of machine learning and crunching large data sets, Facebook is the social network to end all social networks, and Amazon is the everything platform.

However, if you haven't worked or been inside any of those companies, it's fairest to judge them as black boxes into which inputs disappear and come out as various outputs, usually products and services like gadgets or websites or applications. Everything else is a mild form of fan fiction. 

By analyzing a company's outputs, one can deduce a great deal about its capabilities. Hidalgo does the same but at the country level.

The idea of crystallized imagination tells us that a country’s export structure carries information about more than just its abundance of capital and labor. A country’s export structure is a fingerprint that tells us about the ability of people in that country to create tangible instantiations of imaginary objects, such as automobiles, espresso machines, subway cars, and motorcycles, and of course about the myriad of specific factors that are needed to create these sophisticated products. In fact, the composition of a country’s exports informs us about the knowledge and knowhow that are embodied in that country’s population.
 

A country that can export a product like an iPhone generally has greater generative power than one that can only export raw materials like bananas. The telltale clues to the economic potential of a country lie not in its imports but its exports.

So what has any of this to do with Chile? The only connection between Chile and the history of electricity comes from the fact that the Atacama Desert is full of copper atoms, which, just like most Chileans, were utterly unaware of the electric dreams that powered the passion of Faraday and Tesla. As the inventions that made these atoms valuable were created, Chile retained the right to hold many of these atoms hostage. Now Chile can make a living out of them. This brings us back to the narrative of exploitation we described earlier. The idea of crystallized imagination should make it clear that Chile is the one exploiting the imagination of Faraday, Tesla, and others, since it was the inventors’ imagination that endowed copper atoms with economic value. But Chile is not the only country that exploits foreign creativity this way. Oil producers like Venezuela and Russia exploit the imagination of Henry Ford, Rudolf Diesel, Gottlieb Daimler, Nicolas Carnot, James Watt, and James Joule by being involved in the commerce of a dark gelatinous goo that was virtually useless until combustion engines were invented. Making a strong distinction between the generation of value and the appropriation of monetary compensation helps us understand the difference between wealth and economic development. In fact, the world has many countries that are rich but still have underdeveloped economies. This is a distinction that we will explore in detail in Part IV. But making this distinction, which comes directly from the idea of crystallized imagination, helps us see that economic development is based not on the ability of a pocket of the economy to consume but on the ability of people to turn their dreams into reality. Economic development is not the ability to buy but the ability to make.
 

At a corporate level, I can recall an age when Sony was the king of consumer electronics the world over. I first coveted a Walkman, then later a Discman. Our family spent its formative years huddled around a giant (at the time) Sony Trinitron TV, and we were the envy of all my friends for owning one. I looked forward to any trip to Japan for a chance to walk the electronics districts to purchase the coolest gadgets on the planet, and for years I owned a Minidisc player model that you couldn't find in the U.S.

And then the world shifted, and the gadget which subsumed all other gadgets was the computer, and as it shrank in size while growing in computational power, the way we interacted with such devices increasingly became software-based. In that competition, the vector which mattered more than anything became software design, a skill Sony had not mastered.

The company that understood both software and hardware design better than any company in the world happened to be located in Silicon Valley, not Japan, and, after a long Wintel interregnum, caused by a number of business factors covered comprehensively elsewhere, Apple's unique skills found themselves in a universe they could really dent. And dent they did.

Thanks especially to the market opportunity created by the smartphone, which it seized with the iPhone, Apple not only surpassed Sony and moved the balance of power in consumer technology across the Pacific Ocean to American shores but became the most valuable company in the entire world.

***

Not all information is easily embodied. For example, for a while I puzzled over what I'll call the Din Tai Fung Paradox.

Din Tai Fung is a restaurant chain, and I visited the original outlet in Taipei decades ago with my mother. They're known for their Shanghainese soup dumplings, made with a very delicate wrap that somehow never breaks and dumps its precious cargo of pork broth until the moment at which you prod it with your chopsticks just so. Some will argue whether Ding Tai Fung is all that and a bucket of chicken, but at a minimum I find the menu to be satisfying comfort food done consistently, in a setting that is usually cleaner and more well-kept than your average chain restaurant outlet. You'll find superior deals from a street vendor and more elaborate preparation at a higher-end restaurant, but Din Tai Fung industrializes and scales a Chinese staple. We don't pay enough attention to scale.

The mystery is why Din Tai Fung has opened so few outlets; they've only dropped locations in a handful of cities in about ten countries in the world, and every Din Tai Fung is packed solid from open to close with the type of ever-present line of humans snaked outside the front door that you so rarely see at any restaurant, let alone a chain.

For a few months, a new outlet was rumored to be opening in San Francisco soon, and among my friends it was as momentous a rumor as if a new Star Wars teaser trailer had dropped. Ultimately, one opened in the Bay Area, but in Santa Clara instead of San Francisco. 

Which leads to a further mystery: why haven't any competing chains opened up to make the same items to fill the market void? I would never open a restaurant, but my family knows I'd make an exception if I were granted the opportunity to open a branch of Din Tai Fung anywhere. I bring it up every family gathering, when there's a lull in the conversation. Forget cryptocurrency, I want to mint me some Din Tai Fung coin.

At every Din Tai Fung I've been to, they have a glass window so you can look into the kitchen to see the soup dumplings being wrapped, always by kitchen staff wearing white uniforms, almost like lab assistants, an impression magnified by the branches that require face masks. It's rumored that the branches in Asia try to hire the tallest, most attractive men to man the soup dumpling assembly line, but it sounds about as true as a lot of things my aunts and uncles tell me, which is to say it's more credible than I'd care to admit.

The hermetic vibe behind the glass is as far from the vendor selling goods from a street cart as possible; some find street food charming but if you're taking this food to a global audience it needs to be sanitized or sterilized, the same way movies for the Chinese market strip out any storylines that might offend. It's not just the front of the house that's immaculate, the show behind the glass display says they have nothing to hide. It's the equivalent of the blackjack dealer at a casino clapping and turning their hands one way and the other before moving to the next table.

More interesting to me was that Din Tai Fung even doesn't even bother to hide the process behind its staple dish, the evidence is on thousands of smart phones by this point, everyone seems to stop to take a photo or video of the assembly line while waiting for their table.

And yet any Chinese food fan knows it's notoriously hard to find a good soup dumpling. In this age where recipes for almost anything are available online for free, why can't you find a good soup dumpling in most major cities in the world? Or, for that matter, a good burrito, or any dish you love? Why are these crystals of imagination so unevenly distributed when the recipes for making them so broadly available?

The answer, as any home chef who has tried to make a dish from some highfalutin cookbook knows, is simple: you can have the most precise ingredient list and directions and still struggle to make anything approaching what you ate, whether it came from a $400 tasting menu or a mainstream cookbook. Cooking is not nearly as deterministic as the term recipe implies.

Slight variations in environment, weather, ingredients, and cookware can lead to massive differences in the final product. Your oven may say 400 degrees, but the actual temperature inside, at the precise spot where you've placed your baking dish, may be different. That celery you use for your mirepoix today may not be as fresh as the celery you used last week. The air pressure where you're cooking on a particular day may differ from that where you live, the bacteria in the air may also vary. Great chefs appear on Top Chef and flail making dishes they've made hundreds of times in their own restaurant kitchen because every bit of environmental variation matters.

We may glamorize the image of the genius, heroic chef, working magic to create a delicious and beautifully plated dish that a waiter places before us with a balletic flourish, but the true value creation in a restaurant comes from translating that moment of genius into a rote, repeatable cycle. The popularity of sous vide as a cooking technique, even at high end restaurants, comes down its repeatable precision and accuracy. Ask any chef and they'll tell you the value of a line chef who can cook dozens of proteins to the right level of doneness every time given the high cost of fish and meat.

In addition to all those conditionals, much of cooking skill comes down to learned muscle memory and pattern recognition that can only be encoded in a human being through repeated trial and error. I tried to learn some of my favorite of my mother and grandmother's dishes by writing down recipes they dictated to me, but much was lost in translation. Like so much maternal magic, it could only be learned, truly, at their side, with an apron on, watching, imitating, botching one dish after another, until some of it seeped into my bones.

In a memorable segment from the documentary Jiro Dreams of Sushi, apprentice Daisuke Nakazawa is assigned the job of making egg sushi, or tamago. He believes it will be simple, but again and again, Jiro rejects his work. Nakazawa ends up making over 200 rejected samples until finally, one day, Jiro approves. Nakazawa cries in relief and joy.

***

Hardware and software are not like cooking. When knowledge and instructions can be encoded in bits, a level of precision is possible that is effectively, for the purposes of this discussion, deterministic. Manufacturing a hundred million iPhones is like food production, but not the type done in high end or home kitchens. Instead, it is more like producing a hundred million Oreos.

There is one country in the world where that many iPhones can be manufactured for the cost that allows Apple to reap its insane profits: China. I can't think of any other country in the world, not India or Mexico or the United States, or all of Europe together that can make that many iPhones for that price to meet the market demand year after year. Some countries have the labor but not the skills, others have the skills but not enough labor, and others just can't do the work as cheaply as China can.

Recall that the potential of an economy can be judged by the complexity of its exports. Based on that, it's difficult to imagine an economy outside of the U.S. with more potential than China. Some of the most complex products in the world, and the iPhone deserves to be on that list, are made in China.

I've backed many a Kickstarter hardware project, and without fail, every one has been made in China, usually Shenzhen. Inevitably, when the products are delayed, the project's creators will send an update with some photos of a few of them in China, at some plant, examining some part that will get the project back on track, or with their arms around a few Chinese plant managers giving a thumbs up sign.

Kickstarter often feels like an industrial and software design and marketing operation layer grafted on top of the manufacturing capabilities of Shenzhen. It is an early warning indicator of China's economic potential, and the gap that remains to realizing it.

Here is another. Foxconn assembles iPhones for Apple, and for their efforts they make anywhere from $8 to $30 per iPhone, depending on what article you believe. Whatever the figure, we know it is not far off from that.

Apple, in contrast, makes hundreds of dollars per iPhone. They earn that premium, many multiples what Foxconn earns, by virtue of being the ones who designed every aspect of the phone, from the software to the hardware. China can supply labor and even sometimes components, but the crystal of imagination that is the iPhone, perhaps the most valuable such crystal in the history of the world, comes almost entirely from the imagination of employees of Apple. Foxconn is one cog in a long supply chain, and that link isn't the one made of gold.

However, to even have the capability of making an iPhone for less than the cost of a lunch in San Francisco is a skill, one China has shown again and again. Many another country wishes it had such a demonstrated skill. Were China ever able to gain some of the software and industrial design skills of a company like Apple, they would be even more of an economic powerhouse than they are now.

That's a massive conditional. It's not something that can be learned by mere handwaving or even sheer industriousness. After all, Sony could return to its former glory, or Samsung be even more dominant globally, if software design skills were so easily learned.

Someone someday will write a book of the history of software design and how it came to be that Apple built up that capability more than any other technology company, and I'll be among its most eager readers because it's an untold story that holds the key to one of the greatest value creation stories in the history of business.

...our world is one in which knowledge and knowhow are “heavier” than the atoms we use to embody their practical uses. Information can be moved around easily in the products that contain it, whether these are objects, books, or webpages, but knowledge and knowhow are trapped in the bodies of people and the networks that these people form. Knowledge and knowhow are so “heavy” that when it comes to a simple product such as a cellphone battery, it is infinitely easier to bring the lithium atoms that lie dormant in the Atacama Desert to Korea than to bring the knowledge of lithium batteries that resides in Korean scientists to the bodies of the miners who populate the Atacaman cities of Antofagasta and Calama. Our world is marked by great international differences in countries’ ability to crystallize imagination. These differences emerge because countries differ in the knowledge and knowhow that are embodied in their populations, and because accumulating knowledge and knowhow in people is difficult. But why is it hard for us to accumulate the knowledge and knowhow we need to transform our dreams into reality?
 

If knowledge were so easy to transfer, I'd be a three-star Michelin Chef because someone gifted me a copy of the Eleven Madison Park cookbook.

Getting knowledge inside a human’s nervous system is not easy because learning is both experiential and social.5 To say that learning is social means that people learn from people: children learn from their parents and employees learn from their coworkers (I hope). The social nature of learning makes the accumulation of knowledge and knowhow geographically biased. People learn from people, and it is easier for people to learn from others who are experienced in the tasks they want to learn than from people with no relevant experience in that task. For instance, it is difficult to become an air traffic controller without learning the trade from other air traffic controllers, just as it is difficult to become a surgeon without having ever been an intern or a resident at a hospital. By the same token, it is hard to accumulate the knowhow needed to manufacture rubber tires or an electric circuit without interacting with people who have made tires or circuits.6 Ultimately, the experiential and social nature of learning not only limits the knowledge and knowhow that individuals can achieve but also biases the accumulation of knowledge and knowhow toward what is already available in the places where these individuals reside. This implies that the accumulation of knowledge and knowhow is geographically biased.
 

What governs the information production capacity of a country? Hidalgo coins two terms to analyze this problem. One is the personbyte.

We can simplify this discussion by defining the maximum amount of knowledge and knowhow that a human nervous system can accumulate as a fundamental unit of measurement. We call this unit a personbyte, and define it as the maximum knowledge and knowhow carrying capacity of a human.
 

The other term is firmbyte.

The limited proliferation of megafactories like the Rouge implies that there must be mechanisms that limit the size of the networks we call firms and make it preferable to disaggregate production into networks of firms. This also suggests the existence of a second quantization limit, which we will call the firmbyte. It is analogous to the personbyte, but instead of requiring the distribution of knowledge and knowhow among people, it requires them to be distributed among a network of firms.
 

Hidalgo then delves a bit into Coase's transaction cost theory of the firm. Traditionally, Coase's theory is used as a way to explain why firms are fundamentally limited in their size, the idea being that at some size, external transactions become cheaper than internal coordination costs and so it's more efficient to just transact externally rather than produce internally.

I'm not interested in examining that topic now. Instead, let's assume that firms all do have some asymptote in size beyond which Coase's anchor becomes too heavy. The interesting implication is that given the existence of a ceiling on the size of the firmbyte, if some chunk of knowledge exceeds that capacity then it can only be carried by a network of firms.

It's long been said that the center of the technology universe shifted from Boston's route 128 to Silicon Valley because California banned non-competes (here's one study). Hidalgo's theory of the finite compute ability of a network of humans and firms explains how this works. The free movement of employees in Silicon Valley allows the region's knowledge-carrying capacity to increase at the expense of any single firm's benefit. Per Coase, the cost of information movement in Silicon Valley, as embodied by an employee carrying a personbyte from one firm to the next, is lower than it was in the route 128 corridor.

Let's telescope back out to the country level. What applies at the regional or industry level holds at the country level. A country's knowledge carrying capacity, and thus its information production power, is influenced in part by the size of networks it can form.

In his 1995 book Trust, he [Francis Fukuyama] argues that the ability of a society to form large networks is largely a reflection of that society’s level of trust. Fukuyama makes a strong distinction between what he calls “familial” societies, like those of southern Europe and Latin America, and “high-trust” societies, like those of Germany, the United States, and Japan.
 
Familial societies are societies where people don’t trust strangers but do trust deeply the individuals in their own families (the Italian Mafia being a cartoon example of a familial society). In familial societies family networks are the dominant form of social organization where economic activity is embedded, and are therefore societies where businesses are more likely to be ventures among relatives. By contrast, in high-trust societies people don’t have a strong preference for trusting their kin and are more likely to develop firms that are professionally run. Familial societies and high-trust societies differ not only in the composition of the networks they form—as in kin and non-kin—but also in the size of the networks they can form. This is because the professionally run businesses that evolve in high-trust societies are more likely to result in networks of all sizes, including large ones. In contrast, familial societies are characterized by a large number of small businesses and a few dominant families controlling a few large conglomerates.
 
Yet, as we have argued before, the size of networks matters, since it helps determine the economic activities that take place in a location. Larger networks are needed to produce products of higher complexity and, in turn, for societies to achieve higher levels of prosperity. So according to Fukuyama, the presence of industries of different sizes indicates the presence of trust. In his own words: “Industrial structure tells an intriguing story about a country’s culture. Societies that have very strong families but relatively weak bonds of trust among people unrelated to one another will tend to be dominated by small, family-owned and managed business. On the other hand, countries that have vigorous private nonprofit organizations like schools, hospitals, churches, and charities, are also likely to develop strong private economic institutions that go beyond the family.”
 

In Tyler Cowen's conversation with economist Luigi Zingales, the latter hints at the limitations of familial economies in humorous fashion:

One friend of mine was saying that the demise of the Italian firm family structure is the demise of the Italian family. In essence, when you used to have seven kids, one out of seven in the family was smart. You could find him. You could transfer the business within the family with a little bit of meritocracy and selection.
 
When you’re down to one or two kids, the chance that one is an idiot is pretty large. The result is that you can’t really transfer the business within the family. The biggest problem of Italy is actually fertility, in my view, because we don’t have enough kids. If you don’t have enough kids, you don’t have enough people to transfer. You don’t have enough young people to be dynamic.
 
The Italian culture has a lot of defects, but the entrepreneurship culture was there, has been there, and it still is there, but we don’t have enough young people.
 

Low fertility's impact on economies is an issue globally, for example in Japan, but low trust outside of family is an even broader constraint on the knowledge carrying capacity of an economy. If you can't form as large a firm as another country, you can't compete in some businesses and the information producing capability of your economy has a lower ceiling.

If you run a company, you're no doubt familiar with the efficiency gains that arise when different employees and departments operate with high trust. Links form easily given an assumption of low risk, and knowledge moves more quickly, fluidly. Networks then facilitate trust in a virtuous cycle, an example being the military as an integrating institution in a multi-ethnic society.

Trust based on family has its own advantages, but for now I'm focused on an economy's ceiling, and networks that throw off the shackles of family-based firms can scale more. China not only has the population to supply a workforce that can assemble 100 million iPhones in a year, it has an economy that has moved beyond any roots in family-based trust.

Hidalgo's theory also explains why we don't see geographic leakage in industry know-how. Why aren't there Silicon Valleys everywhere?

The personbyte theory can also help us explain why large chunks of knowledge and knowhow are hard to accumulate and transfer, and why knowledge and knowhow are organized in the hierarchical pattern that is expressed in the nestedness of the industry-location data. This is because large chunks of knowledge and knowhow need large networks of people to be embodied in, and transferring or duplicating large networks is not as easy as transferring a small group of people. As a result, industry-location networks are nested, and countries move to products that are close by in the product space.
 

When the knowledge required to create something like an iPhone or a Hollywood film require the interaction of multiple people, with all their accumulated knowledge, seizing it for yourself isn't as easy as poaching one employee or sprinting off with a burning branch to give fire to mankind like Prometheus. Thus we understand why, besides its weather, LA has such a grip on filmmaking for the global market, why any handset manufacturers can't just reverse engineer an iPhone, and why, despite having hundreds of millions of users for iMessages, Apple isn't a credible threat in social networking.

When I study the Chinese tech market, I see an incredibly high ceiling. In fact, the Chinese consumer market in tech is more dynamic now than its counterpart in Silicon Valley. Once, China was belittled for simply copying all the US tech companies. It's true, there is a Chinese Bizarro instance of all successful U.S. tech companies, a Chinese Google, Facebook, Amazon, Twitter, Instagram, YouTube, and so on.

Thanks to that complex interaction of culture and technology, however, China now creates companies with no real American equivalents, and that extends beyond WeChat. China also has more dense cities than America, and density creates its own unique consumer technology opportunities. You'll run out of fingers and toes before you come to a Chinese city as small as New York City, and that matters when many social products piggyback and rely on metropolitan densities as dry kindling.

The competition between tech companies in the U.S. draws scandalized chatter from the peanut gallery, but the pace at which something like Snapchat Stories was copied in the U.S. would be seen as laughably slow in China. Not only are features of competitors routinely copied within a week or two in China, employees are poached all the time in what is closer to a true approximation of a free labor market than even Silicon Valley. Knowledge moves quickly, freely.

Three things, in my observation, hold Chinese companies back from capturing more share in the international market, outside Chinese borders. Two are related, and those are an internationally appealing industrial and software design aesthetic.

It's true, people who find many Chinese software UI's to be busy and crowded can't read Chinese and thus don't understand their localized appeal to the Chinese market. As eye-tracking studies have shown (example), Chinese users scan pages differently, and why shouldn't they considering the fundamental differences between an alphabetic language like English and a pictographic one like Chinese?

Still, most of the international market can't read Chinese. In my past work with UI designers in China, I find it takes more prompting to arrive at something more broadly intuitive for, say, an American market.

The same goes for industrial design, where, akin to the denser informational aesthetic of Chinese software, a somewhat more maximalist impulse takes hold. It's still quite common to walk into an Asian electronics superstore and see display signage that lists dozens of bullet points of features in selling a product. Contrast that to the almost non-existent signage in an Apple store for the extreme opposite.

A more tangible example is something like the user interface of everyone's favorite cooking gadget, the Instant Pot. I received one as a gift last year, and no doubt, I think it's a real value at $80 or so for the base model. For how harried we all feel, a pressure cooker is way more useful a kitchen gadget than most.

However, this is the instrument panel on the front of the Instant Pot.

In practice, it's even more confusing than it appears on first glance. I won't delve into it here, but given a simple design pass, the entire UI could be made much less intimidating, much more intuitive. Given the functionality of any pressure cooker, the functionality can be reduced to a much simpler instrumentation.

These two skill gaps in software and industrial design allow for a continued Kickstarter arbitrage opportunity that slaps a more internationally appealing software and industrial design, along with the more internationally appealing marketing, on top of Shenzhen's manufacturing capabilities.

The last thing holding back more Chinese startups, in my experience, is a shortage in the professional management class. I know, I know, MBA's get a bad rap in the domestic market, but having many CEO's with engineering background at so many Chinese tech companies comes with its own drawbacks.

This management gap may be related to the style of org structure and management which others have mentioned to me as less conducive to certain types of innovation, though it's harder for me to assess without having worked inside a Chinese company.

None of this needs to matter since the Chinese market is so massive. Chinese startups can succeed wildly without ever making a peep outside their home territory. Besides, how a design aesthetic and process can seep into a country's soul remains a mystery to me, but my guess is it's about as slow-moving as trying to produce a high quality soup dumpling in a new market.

Still, I love to muse on the potential of China. In fact, there is one Chinese company that best exemplifies the potential of the country's tech market on the international stage. Last summer, a friend of mine who had worked at this company heard I was in the market for a drone and referred me to a friend who was selling an extra, lightly used Mavic Pro which he'd purchased after he thought he'd lost his original.

I don't know the first thing about flying drones, but it took me all of fifteen minutes or so to get the thing up and flying around in the air, capturing 4K video. It is an fantastic feat of engineering, probably still the single drone I'd recommend to anyone looking to get into drone photography (though I recommend getting a bundle with some extra batteries and a carrying case).

DJI had a few advantages in surging to its undisputed leadership position in the global drone market. First, this is a product category where how well the product actually works is more complex a task than in others. Many drones just don't fly that well. Being an engineering-led company is a strength here, and as long as the industrial design is optimized for flight, it doesn't really matter if your product isn't the sleekest. You won't care what it looks like when it's several hundred feet up in the air.

Second, from a software design perspective, drone UI design can piggyback on flight UI templates that have been worked out over the years. One reason I was up and running so quickly with my Mavic Pro is that the flight sticks imitate video game flight controls. The UI isn't quite as simple as I'd like, but I was fluent much more quickly than the hefty page count of the instruction manual implied.

Estimates of DJI's market share vary, but they are all well north of 50%, and most of its competitors have either left the market entirely or are struggling to stay aloft, so to speak. Here is a vertically integrated Chinese company that most definitely makes more than the cost of cheap SF lunch that Foxconn makes for each iPhone it assembles.

Now, making drones and building smartphones or writing apps are not the same skills. Drones, as exciting as they are, still aren't the type of thing I'd recommend except to photography enthusiasts. And China is a long way from dominating the consumer electronics market internationally with a massive portfolio of products from domestic, vertically integrated companies.

But the ceiling at least exists. it's not theoretical. It's more than any other country outside the U.S. can say, and how China answers it is one of the questions which will determine the relative economic power of China versus the United States in this century.

***

That China can export drones more easily than it can import, say, the software and industrial design know-how of a company like Apple is, at a higher level, a fundamental question of how we can pass along knowledge of any sort. Why are we not better at transferring know-how to industrial workers who are out of a job, why hasn't the internet produced a global leveling of industrial know-how at the country level?

Hidalgo notes:

At a finer scale, economies still lack the intimate connection between knowhow and information that is embodied in DNA and which allows biological organisms to pack knowhow so tightly. A book on engineering, art, or music can help develop an engineer, artist, or musician, but it can hardly do so with the elegance, grace, and efficiency with which a giraffe embryo unpacks its DNA to build a giraffe. The ability of economies to pack and unpack knowhow by physically embodying instructions and templates as written information is much more limited than the equivalent ability in biological organisms.
 

We are nowhere near our maximum throughput for passing on our knowledge to our fellow man, let alone across the membrane between companies and economies. In The Matrix, with a few seconds of fluttering eyelids, Keanu Reeves downloads an entire martial art into his self.

Give a man a kung-fu, you making him Neo. Teach a man to kung-fu, you make him John Wick. 

That is the dream. Asky any parent who is in the midst of trying to get a three-year-old to eat their dinner without throwing half of it on the ground and they'll nod in agreement. What is our version of nature's DNA and cell school of knowledge compression and decompression?

One of the reality TV shows which I wish existed would be one in which a variety of masters in their field compete to take absolute novices from a standing start as far as possible in a finite period of time. Instead of Top Chef, in which contestants are all successful chefs already, I want three master chefs to have to each train a handful of complete cooking dunces over a several month process, and the teacher and winning student share the pot.

Each season could have variant skills. In another, maybe the world's top three piano teachers have to train people who've never played the piano in their lives to sight-reading Chopin. Bill Belichick and Nick Saban coach two youth league football teams to see which wins a season finale scrimmage. I'm sure some of you will write me to tell me some version of a show like this exists already, but I've seen some that come close, but almost all the ones I've seen spend much too little time on the actual instruction methodology and process, and that's where all the mystery and interest lies.

In future posts, I'll delve into some of the limitations I've observed in how we pass information among people, companies, and economies, and from one generation to the next. For now, I recommend picking up Hidalgo's book, and I hope to hear from you about some of the ways you've found to help grow information around you in more efficient ways.

My first podcast appearance

A few months ago David Perell emailed and asked if I'd like to be on his podcast, The North Star. He mentioned some of the other people he'd had on, so many of whom I admire, and I thought he had emailed the wrong person. But no, he had done his research and knew a lot about my preoccupations and obsessions.

David passed through San Francisco before this past holiday break on his way to Australia, and we chatted at my apartment for a night, much of which is captured in this podcast. I've had a small handful of invitations to be on podcasts, but it was always trickier when I was working given the varied concerns of corporate PR, and I always wanted to do my first podcast in person rather than remotely.

If you enjoy my work here at my site, perhaps you'd be game to sample me in another medium? We cover some of the topics I've covered here before, but we spend a bit more time on my personal history, anchoring those topics along my professional timeline. I had a lot of fun and hope to perhaps drop in on another podcast or two in 2018.

Beware the lessons of growing up Galapagos

In All the old rules about movie stardom are broken, part of Slate's 2017 Movie Club year end review, Amy Nicholson writes:

Lugging my $10 masterpiece back to the hotel, I thought about how most of the famous faces who represent the movies have been dead for 50 years. Marilyn’s smile sells shot glasses, clocks, calendars, posters, and shirts in stores from Sunset Boulevard to Buenos Aires, Tijuana to Taiwan. What modern actor could earn a seat at her table? The biggest stars of my lifetime—Julia Roberts, Brad Pitt, Nicolas Cage, Sandra Bullock—never graduated past magazine covers to souvenir magnets.

If Hollywood played by its old rules, I, Tonya’s Margot Robbie and Call Me by Your Name’s Armie Hammer should be huge stars. They’re funny, smart, self-aware, charismatic, and freakishly attractive. Yet, they feel like underdogs, and I’m trying to figure out why. Robbie has made intelligent choices. Her scene-stealing introduction as Leonardo DiCaprio’s trophy wife in Wolf of Wall Street. Her classic romantic caper with Will Smith in the underseen trifle, Focus. She even survived Suicide Squad with her dignity intact. In I, Tonya, she can’t outskate being miscast as Tonya Harding, but bless her heart for trying. As for Hammer, Kameron, your review of Call Me by Your Name called him, “royally handsome,” which seems right. He’s as ridiculously perfect as a cartoon prince, and I loved how Luca Guadagnino made a joke of how outlandish the 6-foot-5 blond looks in the Italian countryside. Whether he’s unfurling himself from a tiny Fiat or stopping conversation with his gangly dance moves, he can’t blend in—and good on him and Guadagnino for embracing it.
 

But even if Robbie and Hammer each claim an Oscar nomination this year, I suspect they’ll stay stalled out in this strange time when great actors are simply supporting players in a superhero franchise. I’m fascinated by Robbie and Hammer because they’re like fossils of some alpha carnivore that should have thrived. Does anyone else feel like the tectonic plates under Hollywood have shifted and we’re now staring at the evidence that everything we know is extinct? It’s not just that the old rules have changed—no new rules have replaced them. No one seems to know what works.

Nicholson goes on to cite Will Smith, who once had huge hits seemingly with every movie he made and who is now on a long cold streak.

I'm wary of all conclusions drawn about media in the scarcity age, including the idea that people went to see movies because of movie stars. It's not that Will Smith isn't charismatic. He is. But I suspect Will Smith was in a lot of hits in the age of scarcity in large part because there weren't a lot of other entertainment options vying for people's attention when Independence Day or something of its ilk came out, like clockwork, to launch the summer blockbuster season.

The same goes for the general idea that any one star was ever the chief engine for a film's box office. If the idea that people go see a movie just to see any one star was never actually true, we can stop holding the modern generation of movie stars to an impossible standard.

The same mistake, I think, is being made about declining NFL ratings. Owners blame players kneeling for the national anthem, but here's my theory: in an age of infinite content, NFL games measure up poorly as entertainment, especially for a generation that grew up with smartphones and no cable TV and thus little exposure to American football. If I weren't in two fantasy football leagues with friends and coworkers, I would not have watched a single game this season, and that's a Leftovers-scale flash-forward twist for a kid who once recorded the Superbowl Shuffle to cassette tape off a local radio broadcast just to practice the lyrics.

If you disregard any historical romantic notions and examine the typical NFL football game, it is mostly dead time (if you watch a cut-down version of a game using Sunday Ticket, only about 30 minutes of a 3 to 3.5 hr game involves actual game action), with the majority of plays involving action of only incremental consequence, whose skill and strategy on display are opaque to most viewers and which are explained poorly by a bunch of middle-aged white men who know little about how to sell the romance of the game to a football neophyte. Several times each week, you might see a player hit so hard that they lie on the ground motionless, or with their hands quivering, foreshadowing a lifetime of pain, memory loss, and depression brought on by irreversible brain damage. If you tried to pitch that show concept just on its structural merits you'd be laughed out of the room in Hollywood.

Cultural products must regenerate themselves for each successive age and generation or risk becoming like opera or the symphony is today. I had season tickets to the LA Phil when I lived in Los Angeles, and I brought a friend to the season opener one year. A reporter actually stopped us as we walked out to interview us about why we were there, so mysterious it was to see two attendees who weren't old enough to have been contemporaries of the composer of the music that night (Mahler).

Yes, football has been around for decades, but most of those were in an age of entertainment scarcity. During that time the NFL capitalized on being the only game in town on Sundays, capturing an audience that passed on the game and its liturgies to their children. Football resembles a religion or any other cultural social network; humans being a tribal creature, we find products that satisfy that need, and what are professional sports leagues but an alliance of clans who band together for the network effects of ritual tribal warfare?

Because of its long incubation in an era of low entertainment competition, the NFL built up massive distribution power and enormous financial coffers. That it is a cultural product transmitted by one generation to the next through multiple channels means it's not entirely fair to analyze it independent of its history; cultural products have some path dependence.

Nevertheless, even if you grant it all its tailwinds, I don't trust a bunch of rich old white male owners who grew up in such favorable monopolistic conditions to both understand and adapt in time to rescue the NFL from continued decline in cultural relevance. They are like tortoises who grew up in the Galapagos Islands, shielded on all sides from predators by the ocean, who one day see the moat dry up, connecting them all of a sudden to other continents where an infinite variety of fast-moving predators dwell. I'm not sure the average NFL owner could unlock an iPhone X, let alone understand the way its product moves through modern cultural highways.

Other major sports leagues are in the same boat though most aren't as oblivious as the NFL. The NBA has an open-minded commissioner in Adam Silver and some younger owners who made their money in technology and at least have one foot in modernity. As a sport, the NBA has some structural advantages over other sports (for example, player faces are visible rather than hidden under helmets), but the league also helps by allowing highlights of games to be clipped and shared on social media and by encouraging its players to cultivate more authentic public personas that act as additional narrative fodder for audiences.

I remember sitting in a meeting with some NFL representatives as they outlined a long list of their restrictions for how their televised games could be remixed and shared by fans on social media. Basically, they wanted almost none of it and would pursue take-downs through all the major social media companies.

Make no mistake, one possible successful strategy in this age of abundant media is to double down on scarcity. It's often the optimal strategy for extracting the maximum revenue from a motivated customer segment. Taylor Swift and other such unicorns can only release their albums on CD for a window to maximize financial return from her superfans before releasing the album on streaming services, straight from the old media windowing playbook.

However, you'd better be damn sure your product is unique and compelling to dial up that tactic because the far greater risk in the age of abundance is that you put up walls around your content and set up a bouncer at the door and no one shows up because there are dozens of free clubs all over town with no cover charge.

Sports have long had one massive advantage in production costs over scripted entertainment like TV and movies, and that is that their narrative engine is a random number generator (RNG). If you want to produce the next hot streaming series, you have to pay millions of dollars to showrunners and writers to generate some narrative.

In sports, the narrative is embedded in the rules of the game. Some players will compete, and someone will win. It's the same script replayed every night, but the RNG produces infinite variations that then spin off infinite variations of the same narratives for why a game turned out one way or the other, just as someone has to make up a story every day to explain why the stock market went up or down. At last check, RNG hadn't found representation with CAA or WME or UTA and thus its services remain free.

Unfortunately for major sports, this advantage is now a weakness as sports narrative is much more brittle than its entertainment counterparts. Narrative is a hedge against disaggregation and unbundling, and that is a critical moat in this age of social media and the internet.

One way to measure entertainment value on this dimension is to ask whether you can read a summary of a narrative and enjoy it almost as much as consuming the original narrative in its native medium. My classic test of this is for movies and TV shows. If you can enjoy a movie just as much by reading the Wikipedia plot summary as by watching it, or if you can enjoy a TV shows almost as much by reading a recap than by bingeing it on your sofa, then it wasn't really that great a movie or TV show to begin with.

Instead of watching the entire last season of Game of Thrones when it returns in 2019, I offer you the alternative of just reading textual recaps to your hearts content online. Is that as enticing an alternative as actually watching all six or seven episodes? You'll ingest all the plot details either way, but for the vast majority of fans this would be a gut-wrenching downgrade.

My other test of narrative value is a variant of the previous compression test. Can you enjoy something just as much by just watching a tiny fraction of the best moments? If so, the narrative is brittle. If you can watch just the last scene of a movie and get most or all the pleasure of watching the whole thing, the narrative didn't earn your company for the journey.

Much more of sports fails this second test than many sports fans realize. I can watch highlights of most games on ESPN or HouseofHighlights on Instagram and extract most of the entertainment marrow and cultural capital of knowing what happened without having to sit through three hours of mostly commercials and dead time. That a game can be unbundled so easily into individual plays and retain most of its value to me might be seen as a good thing in the age of social media, but it's not ideal for the sports leagues if those excerpts are mostly viewed outside paywalls.

This is the bind for major sports leagues. On the one hand, you can try to keep all your content inside the paywall. On the other hand, doing so probably means you continue hemorrhaging  cultural share. This is the eternal dilemma for all media companies in the age of infinite content.

Two nights ago, I watched a clip of multiple angles of Tua Tagovailoa ripping a laser beam of a pass to win the National Championship for Alabama. I didn't watch it live, or on ESPN. I watched it on HouseofHighlights on Instagram, where, instead of hearing some anchor on Sportscenter basically tell me what I can see with my own eyes, the video spins around after a moment to reveal the stunned face of the fan who just witnessed the pass live, reaction videos being a new sort of genre which allows a person in the video to act as the emoji reaction caption from within the video itself, speaking a visual language that most young people of this YouTube/Snapchat generation are already familiar with but which traditional media doesn't notice, let alone grok.

This disaggregation problem extends to ESPN, currently still the 400 pound gorilla in the sports media jungle (reminder, there are no 800 lb gorillas). The network suspended Jemele Hill for tweeting something negative about Trump, using the same playbook as the NFL, who threatened players with suspension for kneeling for the national anthem. Both believed these actions on the part of their talent were harming the value of their product.

The irony is that if both ESPN and the NFL had let these things play out naturally, I suspect at worst it would have been neutral, and at best it might have increased their ratings. For the NFL, the ties to modern movements for social justice might have kept the league and its games in the national conversation and made it tangentially relevant to the next generation. The most culturally relevant bit of Sportscenter today may just be the Sportscenter Top 10, as athletes who make a stunning play routinely tell reporters they are excited to see if they'll be featured on that evening's roundup of the top 10 plays.

Unfortunately, many athletes already see an appearance in HouseofHighlights as the social media alternative to appearing in the Sportscenter Top 10. If you follow top athletes on Instagram, you can see which of them favorite posts on HouseofHighlights. Lebron James routinely favorites posts, as do many other stars. Since many of those athletes follow each other on Instagram, that feature of Instagram produces common knowledge. It's not just that Donovan Mitchell knows that Lebron James favorited a HouseofHighlights clip of him dunking, it's that Mitchell knows that James knows that Mitchell knows and so on.

For ESPN, hewing to the idea that only highlights presented dispassionately or games broadcast respectfully are key to their value is a risky one. Not that they haven't generated a ton of wealth from doing so, and not that TV broadcast rights to major sports aren't still extremely valuable, but those are much more fixed commodities, available to the highest bidder, and ones whose value are close to their peaks, if not past them. This can't be a complete surprise within the four walls of their corporate offices given how much salary and air time they devote to blowhards like Stephen A. Smith and Skip Bayless, but their hesitance to lean into cultivating more original voices will haunt them in the long run. The average caption on an Instagram clip of a major sports league highlight is about twice as likely to be fresh and contextually humorous to a young person than any amount of generic sportscaster hooey spouted on ESPN.

This vulnerability extends to their online presences. I still visit ESPN.com on the web and on my mobile devices to get my sports news roundup each day, but sometime in the past few years, the designs of all these presences shifted dramatically. Gone was a hierarchical layout with different sized headlines and groupings of stories. In its place is a long center gutter of updates from a variety of sports leagues, in modern news feed style.

One can see why they went this way, it made ESPN more current, allowing them to push the latest stories to the top of the page to compete with people getting more current updates from Twitter and other social media sites. For a smartphone, in particular, with its limited screen space, it's not easy to block content into multiple sections on one page.

However, the moment you copy someone else's design, you've shifted the terms of the debate in their favor. In a previous era, ESPN's visually distinct information hierarchy set itself up as the authority on what stories mattered. In the new design, what matters skews towards what's the last thing to happen. It's all flow.

To some extent, in our hyper-personalized world, the era of any media entity deciding what stories matter more than others was always going to decline from what might be seen now as a temporary heyday. I care more about Chicago sports teams and Stanford given my background, so having those elements given more prominence was a notable improvement in the site's newly personalized design. Still, what is lost is that sense of authority, that ESPN sets the terms of the debate. Humans remain a social animal, and we take cues about what matters from our each other, including our media entities. ESPN has ceded more and more of the work of determining our sports Schelling points to other entities.

While this may sound grim, the major sports, their respective leagues, and ESPN all have a fairly solid near term window. For one thing, sports is still the highest volume, highest popularity real-time entertainment. As such, it remains a linchpin of many entertainment packages including cable bundles, and so we'll see various media companies pouring money into it until it can't hold things together anymore. We may even see the prices bid even higher for some time as often happens for assets being milked for their last but fleeting window of cultural scarcity.

A second and less discussed factor is that most young tech CEO's don't know the first thing about sports. They, like a sizable part of Silicon Valley (the group that tweets #sportsball whenever Twitter is inundated with reactions to some notable sports event), grew up with other interests. Without that intuitive sense of sports' place in culture, they aren't as attuned to the opportunities in that category.

This provides the leagues opportunities to swindle the tech companies for a while longer, an example being the rights to stream Thursday Night Football, which a series of tech companies from Yahoo to Twitter to Amazon have (probably) overpaid for the last few seasons. As Patrick Stewart said in L.A. Story, "You think with a statement like this you can have the duck?!" The chef says, "He can have the chicken!" Thursday Night Football is zee chicken of the NFL broadcast portfolio, but the restaurant is still called L'Idiot.

This happened for tech companies when they tried to add film and television to their portfolio, too. They routinely paid fortunes for the rights to back seasons of shows that are no longer relevant anymore. When I was at Hulu, I could only shake my head when I heard the asking price for all the back seasons of Seinfeld. Years later, long after I'd left, Hulu paid multiples of that. The cultural decay curve for content in this age of abundance is accelerating by the day, and there is no equivalent of botox to ward it off.

Given market feedback, however, such temporary arbitrage never lasts long. The days of the NFL strong-arming its partners to overpay for the most meager of rights are coming to an end. The thing about setting up a moat around your content is that the moment your cultural value crosses its peak, the moat becomes a set of prison bars. The flywheel loop can turn just as furiously counter-clockwise as clockwise.

And one of these days, a tech company will look at ESPN's homepage and notice how much it looks like their own. If they just put a bit more structure around it, could they satisfy that sports itch for their captive audience which already check in with them multiple times a day?

It seems implausible today, but look at what happened in film and television. For the longest time, so many tech companies were guilty of exactly what Hollywood accused them of, not understanding how film and television is made and marketed, how that industry creates demand for its product. Like all engineering led-cultures, Silicon Valley suspected Hollywood of not being data-driven enough, and many suspected that upstream process failures were responsible for failed releases. Half a film's budget is spent on prints and marketing? What a waste! (Engineers despise marketing.)

Forget that most of these people in tech had never been on a film set, or sat inside a writer's room, or seen the volumes of market research done before any film's release. It's all just content, let's just crowd source some alternatives. Or, if we produce some premium content, what's needed is earlier crowd-sourced feedback. Hundreds of millions of dollars were wasted before Silicon Valley realized they didn't know what they were doing.

Fortunately, all it cost them was some money and some time, something most of the incumbents have a surplus of. Now they write checks to creatives in Hollywood and leave them alone to do what they do very well already. Machine learning improves with data even when the algorithms are off, and so do most tech companies.

I am a lifelong lover of media in all its forms, and sports in particular was central to how I assimilated into America. It has long served as cultural connective tissue between me and friends, family, and strangers. But if I had an easy way to short all the major sports leagues over the next decade, I would. Nostalgia serves many purposes, but its most dangerous one is wrapping us in a memory of a time when we were still relevant.

Drawing invisible boundaries in conversational interfaces

One of the things anyone who has worked on textual conversation interfaces, like chatbots, will tell you is that the challenge is dealing with the long tail of crazy things people will type. People love to abuse chatbots. Something about text-based conversation UI's invites Turing tests. Every game player remembers the moment they first abandoned their assigned mission in Grand Theft Auto to start driving around the city crashing into cars, running over pedestrians, just to exercise their freedom and explore just what happens when they escape the plot mechanic tree.

However, this type of user roaming or trolling happens much less with voice interfaces. Sure, the first time a user tries Siri or Alexa or whatever Google's voice assistant is called (it really needs a name, IMO, to avoid inheriting everything the word "Google" stands for), they may ask something ridiculous or snarky. However, that type of rogue input tends to trail off quickly, whereas it doesn't in textual conversation UI's.

I suspect some form of the uncanny valley and blame the affordances of text interfaces. Most text conversation UI's are visually indistinguishable from those of a messaging UI used to communicate primarily with other human beings. Thus it invites the user to probe its intelligence boundaries. Unfortunately, the seamless polish of the UI isn't matched by the capabilities of chatbots today, most of which are just dumb trees.

On the other hand, none of the voice assistants to date sounds close to replicating the natural way a human speaks. These voice assistants may have more human timbre, but the stiff elocution, the mispronunciations, the frequent mistakes in comprehension, all quickly inform the user that what they are dealing with is something of quite limited intelligence. The affordances draw palpable, if invisible, boundaries in the user's mind, and they quickly realize the low ROI on trying anything other than what is likely to be in the hard-coded response tree. In fact, I'd argue that the small jokes that these UI's insert, like answering random questions like "what is the meaning of life?" may actually set these assistants up to disappoint people even more by encouraging more such questions the assistant isn't ready to answer (I found it amusing when Alexa answered my question, "Is Jon Snow dead?" two seasons ago, but then was disappointed when it still had the same abandoned answer a season later, after the question had already been answered by the program months ago).

The same invisible boundaries work immediately when speaking to one of those automated voice customer service menus. You immediately know to speak to these as if you're addressing an idiot who is also hard of hearing, and the goal is to complete the interaction as quickly as possible, or to divert to a human customer service rep at the earliest possible moment.

[I read on Twitter that one shortcut to get to a human when speaking to an automated voice response system is to curse, that the use of profanity is often a built-in trigger to turn you over to an operator. This is both an amusing and clever design but also feels like some odd admission of guilt on the part of the system designer.]

It is not easy, given the simplicity of textual UIs, to lower the user's expectations. However, given where the technology is for now, it may be necessary to erect such guardrails. Perhaps the font for the assistant should be some fixed-width typeface, to distinguish it from a human. Maybe some mechanical sound effects could convey the robotic nature of the machine writing the words, and perhaps the syntax should be less human in some ways, to lower expectations.

One of the huge problems with voice assistants, after all, is that the failures, when they occur, feel catastrophic from the user perspective. I may try a search on Google that doesn't return the results I want, but at least something comes back, and I'm usually sympathetic to the idea that what I want may not exist in an easily queryable form on the internet. However, though voice assistant errors occur much less frequently than before, when they do, it feels as if you're speaking to a careless design, and I mean careless in all sense of the word, from poorly crafted (why didn't the developer account for this obvious query) and uncaring (as in emotionally cold).  

Couples go to counseling over feeling as if they aren't being heard by each other. Some technology can get away with promising more than they can deliver, but when it comes to tech that is built around conversation, with all the expectations that very human mode of communication has accrued over the years, it's a dangerous game. In a map of the human brain, the neighborhoods of "you don't understand" and "you don't care" share a few exit ramps.