How Does Complexity Produce Simplicity Behind "Emergence"? | Yunqi Science Chat --- The term "emergence" has become something of a buzzword in recent years. From the sudden "awakening" of large language models to the spontaneous order seen in flocks of birds, emergence seems to describe a magical leap — where countless simple individuals, through interaction, produce complex intelligent behavior. But is emergence really that mysterious? In this episode of *Yunqi Science Chat*, we want to flip the question around: **not how simple produces complex, but how complex produces simple.** This reversal reveals a deeper truth about emergence: the complex behaviors we observe often stem from surprisingly simple underlying rules. The complexity is in the eye of the beholder; the simplicity is in the mechanism. ## The "Simple" Side of Emergence Take Conway's Game of Life, the classic cellular automaton. Each cell follows just two rules: a live cell with two or three neighbors survives; a dead cell with exactly three neighbors comes alive. That's it. Yet from these two rules emerge gliders, oscillators, self-replicating structures — even universal computers. The emergent complexity is staggering

At the recently concluded WAIC 2023, more vertical models made their debut. Faced with complex questions, AI could not only skillfully break down problems and provide answers, but also explain its own reasoning.

Now, more top scientists and engineers are working to make AI responses even more precise and concise. — But why is "simple" actually harder to achieve?

Behind the simple exterior lies complex internals. Researchers have named this self-organizing phenomenon "emergence" — a key driving force behind the continuous iteration of large models. In this edition of "Yunqi Science Chat," let's revisit "emergence" from its origins. This may offer fresh insight into "how to understand what large models are saying."

A colony of ants can cooperate to build bridges across gaps using their own bodies. Thousands of birds in flight can form complex aerial formations. Magnetism arises from the alignment of billions of electrons. Tiny water and air molecules create hurricanes... Nature is full of examples where complex behaviors spontaneously emerge from relatively simple elements.

To describe these puzzling self-organizing phenomena, researchers coined the term "emergence." Some emergent phenomena take the form of simple exteriors arising from complex interiors. The simplicity of the exterior and the complexity of the interior are not contradictory — in fact, they complement each other. Temperature, density, and pressure are all relatively easy to measure, but they actually originate from the motion and arrangement of an extraordinarily large number of atoms and molecules. Even if we could track each particle individually, it would make no sense to talk about the temperature of a single molecule. Only the overall distribution of velocities — a collective property — determines temperature, density, and pressure.

How does complexity produce simplicity? This is a major question in modern science. It seems almost like magic: a collection of atoms collectively does what a single atom cannot do on its own. Other types of emergence involving extreme complexity also arise and propagate from simple elements — life, for instance, which emerged from simple, prebiotic chemistry on the early Earth.

Strong vs. Weak Emergence Emergence carries different meanings depending on what it's being used to describe. Sometimes "emergence" simply means "happening" or "appearing," but in more technical contexts, the concept is usually divided into "weak" and "strong."

Weak emergence corresponds to situations where the whole only appears to transcend the sum of its parts, but with sufficient knowledge, the whole can be reduced to the sum of its parts. Weak emergent systems are difficult to track and predict because of their complexity, not because they are fundamentally novel. Some philosophers even argue that all apparent emergence is weak emergence — largely an illusion created by human perspective and the limitations of our knowledge.

Strong emergence applies to systems where the whole truly is greater than the sum of its parts, meaning we cannot understand or predict the properties of strongly emergent systems based solely on understanding their individual components. Evidence of strong emergence might include the appearance of new physical laws, such as time asymmetry or superconductivity. Some consider chemistry itself an example of strong emergence, since chemical properties don't seem fully derivable from subatomic particles.

Over the past decade, many disciplines have devoted considerable research to emergence.

Emergence Across Disciplines

01 Emergence in Physics

Phase transitions of matter are an example of emergent behavior in physics, and one of the most easily observable properties. Ice, water, and water vapor all share the same chemical properties, yet their physical properties are radically different. In recent years, condensed matter physicists have discovered numerous novel, unique, and mysterious phases of matter, including soft matter, superconductors, topological phases, and even time crystals. Many of the properties of these phases do not seem predictable from their molecular composition.

Emergence can also describe the apparent relationship between general relativity and quantum field theory. We know that general relativity and quantum field theory are two highly successful yet mutually contradictory theories in physics. Some deeper alternative theories propose that spacetime does not exist at the most fundamental level, but rather emerges from the interactions of more basic components. Similarly, some theorists believe that three-dimensional space may emerge from quantum interactions on two-dimensional surfaces.

02 Emergence in Biology

In living organisms, complexity is self-evident. Many questions in biology can be traced back to how complex systems develop from simpler components: life emerges from chemistry; multicellular organisms emerge from single-celled entities; communities emerge from individuals; minds emerge from interconnected neurons.

Biological evolution is studied as an emergent phenomenon, and recent research is working to determine whether some gene changes filtered by natural selection are not entirely random, but instead emerge through large-scale mutational mechanisms.

The concept of emergence helps biologists explore questions across vastly different scales, from molecules in the genome to entire ecosystems. Scientists are working to develop new methods to simulate and predict the behavior of active systems ranging from collective molecular motion to animal groups.

03 Emergence in Chemistry

Chemistry can be used to study and understand emergence. First, because chemistry has a relatively uncontroversial, well-defined set of theories and phenomenological descriptions backed by empirical support. Second, through quantum chemical formulations, chemistry has established a well-defined scientific connection to quantum mechanics, providing us with powerful material to illuminate the relationship between quantum chemistry and fundamental physics. Third, unlike biology, chemistry does not grapple with the difficult problems surrounding the nature of life or consciousness, so we can focus on how chemical entities interact with fundamental physical particles.

Chemistry assumes various properties and processes that transcend atoms and molecules themselves. Chemical reactions are one such example. In the philosophy of chemistry, chemical reactions have been studied primarily in terms of the forms of explanation they provide to chemists. However, in terms of their relationship to fundamental physics, they have not been widely examined from a philosophical perspective. To some extent, this contains an implicit assumption that we should understand the relationship between atoms and molecules and their quantum mechanical constituents, without needing to study the relationship between chemical reactions and physics.

But this is not the case. While chemical reactions do, in one sense, merely describe chemical transformations between atoms and molecules, they can also be considered processes containing rich and diverse information from chemistry, quantum mechanics, thermodynamics, and more. How do all these sciences fit together, and what does this mean for the relationship between chemistry and physics? Such questions may lead to new approaches for understanding reduction and emergence in chemistry.

Top-Down and Bottom-Up

Many fields discuss emergence at different scales. Top-down modeling approaches (starting from observable complex systems like galaxies or societies) often end up diverging from bottom-up modeling approaches (starting from single genes or subatomic particles).

In physics, the disconnect between the bottom-up discoveries of quantum mechanics and the top-down observations of general relativity clearly shows that we lack a unified theory of physics. Philosophers and scientists are still working to bridge various insights and their attendant weaknesses — both top-down and bottom-up approaches can give us clues to understanding some of the biggest and smallest questions in the universe.

As a scientific concept, emergence has its critics, who argue that it carries too little information to be of much use. But at the very least, emergence helps explain why scientists can discover hierarchies of physical laws and processes operating at different scales in nature.

This article is republished with permission from the WeChat public account "Principia" (ID: principia1687) Writer: Xiaoyu Editor: YY

#References:

https://www.templeton.org/news/what-is-emergence

https://www.templeton.org/discoveries/emergence-research

https://www.nature.com/articles/s42004-022-00667-7

https://www.quantamagazine.org/emergence-how-complex-wholes-emerge-from-simple-parts-20181220/

---