Van Eyck was a precursor of augmented reality

Using digital technology, a researcher has unravelled the secrets of the use of perspective by the Flemish painter Jan Van Eyck, a technique previously believed to be specific to the Italian Renaissance artists.

The history of lines is anything but linear. The importance of proportions and depth in artistic representation has fluctuated widely from one century and culture to the next. During the Renaissance, the geometric precision of perspective became an essential feature of painting and fresco work, not to mention sculpture and architecture. The topic was famously addressed by the art historian Erwin Panofsky,  a seminal figure of the discipline, in his 1927 essay Perspective as Symbolic Form.

Artist-mathematicians?

“At the beginning of the Italian Renaissance, Brunelleschi1  and Alberti2 described perspective in art as a geometrical transcription of the laws of optics,” explains Gilles Simon, senior lecturer at Université de Lorraine and researcher at the Lorraine Research Laboratory in Computer Science and its Applications (LORIA).3  “Their concept was based on the works of Euclid,  with the addition of a projection plane between the object being represented and the eye of the viewer.”

Accurate perspective is structured according to a number of mathematical rules, such as the presence in an artwork of baselines converging upon a single vanishing point – a technique that originated with the masters of the Quattrocento and seemed to have been unknown to artists elsewhere prior to encountering the influence of the Italian Renaissance.

 

Van Eyck was a precursor of augmented reality
Detail of the Ghent Altarpiece, completed in 1432 by Jan Van Eyck and kept in Saint Bavo’s Cathedral in Ghent.  Wikimédia commons

Algorithms for specifying vanishing points

“When I went to see the Ghent Altarpiece, painted by Van Eyck, I was much impressed by the perspective of the fountain in the Adoration of the Mystic Lamb panel,” Simon recounts, “and I decided to dig deeper.” At the LORIA, Simon specialises in the detection of baselines and vanishing points in photographs and videos. The algorithms that he perfects are used, for example, to correct the shapes of objects that have been distorted by the camera angle, or to guide automated systems.

 

Van Eyck was a precursor of augmented reality
Manual reconstruction (A) and using artificial vision (B) of the vanishing lines of the Arnolfini Portrait (1434, 82.2 × 60 cm, National Gallery).  Jan Van Eyck/National Gallery, London/Wikimedia Commons

In fact, the identification of what does or does not constitute a vanishing point remains highly subjective. Any and every art historian can add or exclude certain points, perhaps unwittingly. “I integrated uncertainty in the measuring of the edge lines in order to produce a probabilistic map of possible vanishing points,” Simon explains. “I also used an old digital method for establishing the most significant probability peaks.”

A “perspective machine”

The researcher’s analysis reveals that the Arnolfini Portrait comprises four horizontal sections, each with a centric point evenly spaced along an inclined axis traced longitudinally across the painting. Within each section, the perspective conforms perfectly to the geometric principles that were thought to have been known only to a few Italian masters.

While this configuration was not found in the Adoration of the Mystic Lamb, all five of the paintings studied revealed a “fishbone” pattern that no one before Simon had identified. His research was made public at SIGGRAPH, an international conference held on 9-13 August, 2021, and published in the event’s journal.
At SIGGRAPH, Simon also presented a 3D reconstitution of the multiple perspective effects in the Arnolfini Portrait, and explained how Van Eyck achieved them. It seems that the painter used a sort of “perspective machine” with four equidistant eyeholes, one for each section, arranged vertically.

 

Van Eyck was a precursor of augmented reality
3D reconstruction of the view axis and Arnolfini’s room. A – C: Parallax effects visible in the painting. D: 3D model obtained. The reverse rays used for the reconstruction are represented by dashed lines.  Université de Lorraine

Anticipating augmented reality

While Brunelleschi was already using a wooden panel with an eyehole by about 1420, Van Eyck nonetheless remains one of the pioneers in the use of optical systems to depict perspective and take human stereoscopic vision into account. This approach can be considered a forerunner of augmented reality, and would be simplified 70 years later by Leonardo da Vinci.

Expanding on his discovery, Simon is now applying his method to works by other artists, and is expecting new revelations on the use of perspective. He also points out that his technique could help authenticate the origin of certain paintings.

Simon’s algorithms are difficult for non-specialists to understand, but he hopes to develop an interface that will allow art historians to use them. “Few of them are interested in digital techniques,” the researcher laments, “but I hope that work like mine will encourage them to use our tools. It has been three full decades since we began proposing solutions that could help them solve their problems of form and geometry.”

Footnotes

  • 1.Filippo Brunelleschi (1377-1446) is best known as the architect of the dome of the Cathedral of Santa Maria del Fiore in Florence.
  • 2.Leon Battista Alberti (1404-1472), also an architect, notably designed the facades of the Rucellai Palace and of Santa Maria Novella, again in Florence.
  • 3.CNRS / University of Lorraine / INRIA.

In the Know

Important news once a day. NASA to Nano. Medicine to Muons. Environment to Energy.

 
 


The material in this press release comes from the originating research organization. Content may be edited for style and length. Want more? Sign up for our daily email.