GenAI and the Meeting of the Minds

URL copied!

Categories: AI and MLPerspectiveTechnology

At a recent Hitachi Energy conference, I saw a very interesting presentation by Hitachi partner nVidia—the fabless semiconductor company whose GPUs are key drivers of the GenAI revolution. The speaker described nVidia not as a GPU company but rather as a “simulation” company. He described a spectrum of simulation technologies NVidia supports ranging from “physics-based” to “data-based.”

As a person who was educated as a physicist, several light bulbs clicked on for me in this description. What the speaker meant, of course, was that simulations or video games can either be based on ‘algorithms’—that is, a set of physical or un-physical laws (for fantasy worlds, for example)—or they can use extrapolations based on data.

When we as developers write code, we establish a set of ‘laws’ or rules for a computer to follow. Learned behavior, on the other hand, abstracts a set of patterns or probabilities from the data encountered. The latter is the nature of large language models—they are not programmed; rather they are trained based on a selection of natural language text, photographs, music, or other sources of information.

The models essentially ‘draw their own conclusions’ in a learning process. (Or, more strictly speaking, the models are the artifacts embodying the learning that took place when an algorithm processed the training data.)

Again, this stuck with me very forcefully as an analogy of the human learning process and of the way physics and science work.

There is a famous anecdote about the physicist Galileo, who was born in the 16th Century, observing the swaying of a chandelier during a church service in the town of Pisa Italy (of leaning tower fame). There was a breeze that occasionally set the chandeliers in motion with larger or smaller oscillations.

Galileo observed that regardless of how high the chandelier was blown by the wind, once it started to fall, a given chandelier always took the same amount of time to complete an oscillation. In other words, the time the chandelier took to swing back and forth depended only on the length of the chain holding it, not on the height when it was released.

This is quite an extraordinary observation, and the fact that this phenomenon apparently was not noticed (or at least recorded and acted on) for the first 300,000 years or so of human history indicates the degree of insight and curiosity Galileo had.

Note that Galileo did not have a watch he could use to record the time—they had not been invented yet, and could not have been until this ‘pendulum effect’ had been discovered. Galileo timed those initial oscillations using his pulse—though he later refined his observations using, I presume, the water clocks or sand glasses that were known in his time.

Why is this interesting? Because Galileo, like other discoverers, used observations or ‘data’ to infer patterns. From the data, he was able to make a prediction—namely, that the period of a pendulum depends only on the length of the pendulum, and not on its height of oscillation, or (as was later found) its weight.

Why is this important, and how does it relate to GenAI? There are two broad branches of Physics, called “experimental” and “theoretical”. The goal of experimental physics is to make observations and determine what happens. The goal of theoretical physics is to explain why something happens—specifically, to discover the underlying principles that manifest themselves in observations, or that predict what will be observed.

What is interesting to me in the context of GenAI is that there is a middle ground between these two areas of physics that is sometimes called phenomenology. The term phenomenology is used in different contexts, but back when I was a graduate student in high energy particle physics (theoretical physics, by the way) the word ‘phenomenology’ was used to describe predictions that we did not yet have the theory to explain.

In other words, we knew that something happened or would happen, but we didn’t yet have a satisfactory explanation for “why.”

Galileo, in his pendulum observations in the church and subsequently in his ‘lab’, was doing what today we would call experimental physics. That is, he was making observations about what happened, and describing what he saw.

In my limited historical research, I didn’t find a record that he did so, but we can imagine that Galileo could have taken his observations one step further and made quantitative predictions about the behavior of pendulums. That is, based on his experimental results, he could have discovered that for small oscillations, the period of a pendulum was proportional to the square root of the pendulum's length.

However, even if he had produced such a quantitatively accurate predictive model, history does not record that Galileo ever really understood WHY the pendulum rule he discovered was true. A satisfying qualitative explanation had to wait for roughly 100 years for Dutch scientist Christiaan Huygens’ work on harmonic motion in 1673. A full quantitative explanation required Sir Isaac Newton to first invent calculus and lay out his three laws of motion. (For the theoretical basis of simple harmonic motion, such as a pendulum, see here for example.)

So how does this history relate to GenAI?

We can readily imagine our current-generation GenAI models acting like Galileo—observing what happens, identifying patterns, and making extrapolations and predictions based on those patterns. We can even imagine them doing the curve fitting and other math required to turn those fresh observations into mathematical models.

It’s more difficult to imagine a current-generation GenAI model acting like a Huygens or a Newton and inferring from first principles WHY something happens unless the model already contains that information and simply retrieves it.

I don’t believe reasoning from first principles is impossible for GenAI, and people are working hard on enabling it. Approaches such as “chain of thought” and “train of thought” come close. But ‘theory’ is not the strong suit of current-generation (2024) GenAI technology. Current LLMs are “phenomenologists”, not “theorists”, which is in no way intended to underrate their value.

Why do we care about the theory? If we can predict “what” will happen, do we really care “why”?

This is a good question, and it rapidly gets metaphysical, hinging on the nature of consciousness. Moreover, what constitutes a “satisfying explanation” and “first principles” gets really philosophical fast. But in a practical sense, we can see that both theory and phenomenology have value, each in a different context.

Phenomenology has ‘rough and ready’ practical value. Astronomers and, earlier, astrologers could predict the phase of the moon and the progression of the seasons long before they understood that the Earth orbits the Sun, and the Moon orbits the Earth. These purely phenomenologically-based predictions had a profound impact on human history, including the invention of agriculture which, in turn, led to the creation of cities and civilization.

But it is the nature of the human mind to try to discern the reasons behind what it observes. People developed theories—initially what we’d now term religious or mythological—to explain why the Sun and Moon behave as they do. They did this many centuries before the discovery of calculus and the law of gravity by Newton; the increasingly refined observations made by Kepler and, earlier, Galileo; and Copernicus’ hypothesis that the earth obits the Sun. It is in the nature of humans to keep asking “why” until a satisfying ‘theory’ is presented to explain the observations.

Watch: Getting GenAI Ready with GlobalLogic

Besides being intellectually satisfying to us humans, the value of theory is that, by reducing observed behavior to an outcome of basic principles, it lets us solve problems and see connections that phenomenology alone does not.

For example, the theory of simple harmonic motion outlined in the Feynman lecture above not only explains the motion of pendulums (Galileo’s observations), but also the vibration of plucked strings on musical instruments and the movement of weights on springs. When we generalize this slightly, driven harmonic motion (a pendulum pushed by the wind or by the escapement mechanism of a clock) also leads to insights in the area of “resonance”.

This, in turn, helps us understand diverse phenomena such as the structure of Saturn's rings and the behavior of physical structures like bridges under the influence of an external force, such as the wind.

By uniting our understanding of multiple observations, a theory helps us discover the underlying connection between phenomena that initially appeared distinct. This process of forming a theory is not confined to physics but is something all of us do in everyday life. We have a theory of the motivations behind our spouse’s or friend’s behavior; as infants, we form the theory that an object continues to exist even when we don’t see it; as students or engineers we form a theory of what it takes to get a good grade or promotion.

We also form ‘theories’ every day in the software space, when we develop an “architecture” or algorithm that produces a (hopefully) simple system that solves not just one but multiple problems.

We also abstract out commonalities between diverse systems—for example, logging, observability, and security—and structure them as “cross-cutting concerns” rather than re-inventing them afresh for every system. In general, people consistently synthesize observations and try to discern the underlying cause behind them. It’s our nature.

The human brain functions using a combination of observation, phenomenologically-based prediction, and abstraction or “theory” to understand what it observes and expects. Currently (in 2024), GenAI is strongest in the first two aspects—observation and phenomenologically-based prediction.

To deliver on the ‘holy’ (or ‘unholy’) grail of artificial general intelligence, AI-based systems need to not only predict but also be able to form abstractions and ‘theories’ based on their observations and predictions. They will need to combine a ‘Galileo brain’ with a ‘Sir Isaac Newton’ brain.

I expect that we will indeed see such a ‘meeting of minds’ in GenAI, even though we’re not fully there today. We have ourselves as examples that these two modes of thought can co-exist in a single entity. We also know first-hand the power of intelligence that not only predicts “what,” but also understands “why.”

You might also enjoy: