Select a result to preview

Mastering Visual Literacy

#clippings

This visual summary is based on the Syntactic Theory of Visual Communication by Paul Martin Lester, Ph.D..
Should you want to get your own copy of my illustrations, you can download them from here.

Lester's article is extremely interesting and relevant to the topics of visual thinking and communication, but it is not an easy read. In exploring the syntactic theory of visual communication, I have attempted to distill these complex concepts into a more digestible format. This theory, articulated by Lester, delves into how we interpret visual messages and the rules that govern their syntax.

We Are Taught How to Read Stories, But Not How to Read Pictures

From an early age, we are taught to read text but not images. Even though we start with drawings as children, we are gradually guided towards letters and words. As we progress through education, there's a noticeable divide: text is emphasized, while images and visual thinking tools are often sidelined. To play on the slogan from George Orwell's Animal Farm: "Pictures are good, but text is better!"

Before children learn to read and write, they do not know the difference between a line drawing and a letter.First learn letter-pictures Then word-pictures Then sentence-pictures Dog in the fog Bird on the perch. Pig in the pen. Ant on the plant. Frog on the log. Mouse in the house. Sun in the sky. Bee on the tree. Duck in the truck. We are taught to read stories, but we are never taught how to read images.We are taught not think of words and pictures in the same way. Pictures play a subservient role to the words.We learn to read stories, but not how to read pictures. Four legs good,two legs better

Click and hold to enlarge. SHIFT + wheel to zoom. ESC to reset.

We Are Becoming a Visually Mediated Society

We are shifting towards a visually mediated society. Reading is increasingly overshadowed by visual consumption, which is less mentally demanding. Words are easily forgotten, but pictures stay in our minds for decades. This shift has been ongoing for a long time, as evidenced by concerns from as far back as 1955 about the impact of visual media on literacy (see: Why Johnny Can't Read). The concern at the time was that an overload of images and visual media might impede reading skills. Lester highlights that visual messages follow their own syntax, which may be lost on those who are text-oriented. Thus, the new generation is also reading, but they are reading something different.

We are becoming a visually mediated society. Reading is losing to watching because viewing requires little mental processing. Too many mediated images and not enough words?!?nothing worthwhile to read not required to make a living parents aren't reading either reading something else, not recognized by other cultures or maybe Visual messages, with their own rules of syntax, are being read, but this language means nothing to those who can only read words.๐ŸŽจ๐Ÿ“„โš–๏ธ๐Ÿ‘“ ๐Ÿšซ๐Ÿ” ๐Ÿ“š๐Ÿค” We may forget the details of the 1989 Tiananmen Square uprising, but the image of a lone protester standing defiantly before a line of Chinese tanks is unforgettable. You remember it not only because it is a highly emotional image,but because you have thought about the image in your mind with words words,words,words Words are easily forgotten, but pictures stay in our minds. More than any other technological innovation,computers are responsible for the explosion in images. 1955

Click and hold to enlarge. SHIFT + wheel to zoom. ESC to reset.

The Syntax of Symbols

There is a clear distinction between text and images. Text is sequential and discursive, meaning it's organized in a linear narrative. In contrast, images are holistic, offering a comprehensive view at a glance. Pictures lack formal grammar and a standardized visual alphabet, making them challenging to "read" in the traditional sense. Susan Sontag argues that without narration, understanding through images is limited. However, as we consider this, we must also acknowledge that text, because it is sequential, cannot be understood without grammar and syntax. Without these elements, readers would have no way of deciphering the connections between the serial flow of signals. One could argue that the notion of grammar and syntax is a side effect or necessity stemming from the limitations of serial communication.

The syntax of symbols Pictures are presentational not discursive X no formal grammar thus not a language without a language, cannot be read Words have a narrative structure "Only that which narrates can make us understand." Susan Sontag no visual alphabet no recognized syntax A visual alphabet can be defined Flows open lines Fields N spatial organization Forms closed shapes The mind may store images symbolically within the brain in the form of geons in order to make recognition quick + simple geons are like visual phonemes But these are too abstract to be practical as an alphabet for images "Photography is the only 'language' understood in all parts of the world, and bridging all nations and cultures." ---Helmut Gernsheim Photographs quote rather than translate from reality. holistic simultaneous narrative,train of thought,sequential Her basic visual alphabetic letter is called the "coloreme." Recognition by Components, a theory of human image understanding Irving Biederman 1987 by Dave Gray "Pictures are not a language in the verbal sense. Pictures have no lexicon nor syntax in a formal grammarian's sense. But they do have form, structure, convention and rules." -- Sol Worth

Click and hold to enlarge. SHIFT + wheel to zoom. ESC to reset.

Semiotic Approach to Visual Communication

Semiotics, the study of signs and symbols, provides insight into how images function as a form of communication. Images are essentially collections of signs that convey meaning through viewer interpretation. While visuals can be powerful, they communicate most effectively when paired with verbal or written explanations.

Semiotics is divided into three domains:

  1. Pragmatics: Studies the origins and uses of signs.
  2. Semantics: Explores the significance of signs across cultures.
  3. Syntactics: Focuses on combining signs to form messages.

Pragmatics and semantics are important but not unique to visual communication. Syntactics asserts that a sign by itself means nothing; meaning depends on other signs. The right combination of words and pictures can create a very effective synergy. For instance, research on newspaper reading shows that people first notice the photograph, then the caption, and finally the headline before delving into the article. This interplay of text and image enhances comprehension and impact. Since thinking always involves communicationโ€”whether to ourselves or othersโ€”a thoughtful orchestration of text and images in communication enhances our ability to see connections and find solutions.

According to Wilson Hicks, an early picture editor for Life magazine, "It is not correct to say that either medium [words and pictures] supplements the other. The right verb is complements."

Semiotic approach to visual communication Images are a collection of signs that are linked together in some way by the viewer Pragmatics Semantics Syntactics ๐Ÿ–๏ธ๐ŸŒž๐Ÿน ๐Ÿ‘Œ okey money middle-finger ๐Ÿ›‘ โ€ผ๏ธ + ๐Ÿ˜ study of the origin,the common uses and communicative effects of signs significance of signs in various cultures Combining signs to form messages A sign by itself means nothing. Meaning depends on other signs. I delight in photographs. I delight in words. I delight in mixing both To see what happens if they blend.Suzanne Langer The text loads the image, burdening it with a culture, a moral, and imagination.It is not correct to say that either medium [words and pictures] supplements the other. The right verb is complements. Even pride of authorship are mingled.--- Wilson Hicks The combination of the two symbolic systems is one of the most powerful communicative strategies known + Semiotic: the study of signs and symbols and their use or interpretation Pragmatics and semantics are important but not unique to visual communication, so we'll focus on syntactics. Semiotics 1+1=3

Click and hold to enlarge. SHIFT + wheel to zoom. ESC to reset.

Tenets of the Syntactic Theory of Visual Communication

This brings us to the conclusion of Lester's article, where he articulates his theory in three main tenets:

Tenets of the Syntactic Theory of Visual Communication Mediated words and pictures have equal importance in the communication process.I Images are remembered by thinking about them in words.III At one time words were icons. It took 1,250 generations for words to change from iconic to symbolic signs.Words are signs of lines,curves, shapes, and color,rooted in images. With Gutenberg's press,words gained dominance over images, leading to a decline in visual literacy as text became standardized.Images are a collection of signs and as such,become a language when read in the mind When words and images hold equal importance across all forms of communication, different cultures will find it easier to understand one another.๐Ÿ“ท ๐Ÿ–ผ๏ธ = ๐Ÿชง ๐Ÿ—ฃ๏ธ ๐Ÿง  ๐Ÿ—ฃ๏ธ โž• ๐Ÿ–ผ๏ธ = โš–๏ธ โžก๏ธ ๐ŸŒ ๐ŸŒ ๐ŸŒ ๐ŸŒŽ โžก๏ธ ๐Ÿ‘ซ ๐Ÿค Sumerian Cuneiform

Click and hold to enlarge. SHIFT + wheel to zoom. ESC to reset.

Tenet 1: Mediated Words and Pictures Have Equal Importance

Words and images share a deep connection. Words originated from visual symbols, and over time, text gained prominence. With Gutenberg's press, words gained dominance over images, leading to a decline in visual literacy as text became standardized. Just consider how a printed page from Gutenbergโ€™s press compares to a codex page from a visual stimulation standpoint.

However, both mediums are crucial in communication, each contributing unique elements.

Tenet 2: Mediated Words and Pictures Are Both Symbolic Representations

Both words and images are symbolic. They represent ideas and concepts that are understood through cultural and contextual knowledge.

Tenet 3: Images Are Remembered by Thinking About Them in Words

We remember images by verbalizing them. Concrete nouns like "ball," "book," "bottle," "baby," etc., are recalled much better than abstract concepts such as "freedom," "peace," "ethics," or "love." Illustrations can help make abstract concepts more memorable by translating them into tangible (concrete) forms.

Six Takeaways to improve your thinking and note-taking

  1. Text and Visuals Complement Each Other: Both play a reinforcing role in note-taking and communication. Aim for a cohesive design that aligns visuals with captions and text for maximum impact.
  2. Deliberate Design: As we move towards a more visually-oriented society, balancing the use of words and images will facilitate better cross-cultural understanding and communication.
  3. Visuals as Information Compression: Images can condense complex ideas into a single glance. Use visuals to summarize and reorganize information efficiently. (I demonstrate how I organize concepts using their visual summaries into a narrative at the end of my video Book on a Page Summary of Atomic Habits by James Clear and in Excalidraw Writing Machine)
  4. The Importance of Narration: Adding verbal summaries to visuals is essential for making them truly effective. Use tools like Back-of-the-Card Notes in Obsidian-Excalidraw or slide notes or captions in other tools, to integrate visuals with text.
  5. Transforming Abstract to Concrete: Creating illustrations involves converting abstract ideas into concrete forms, which aids memory and understanding. For more on the craft of creating concept visuals, check out my video Mastering Concept Visualizations: A Simple Workflow for Creating Effective Visuals.
  6. Invest in Visual Skills: Given the emphasis on writing in traditional education, investing time in learning illustration can provide greater value. Consider exploring visual thinking courses to enhance your skills. Visit the Visual Thinking Workshop to learn more.

Text and visuals both (should) play a mutually reinforcing role in note-taking complementing and reinforcing each other's impact.Text and visuals Text and visuals Text and visuals Text and visuals Text and visuals Compression of ideas: Images act as a powerful form of information compression, conveying complex concepts in the blink of an eye.Compression of ideas Compression of ideas Compression of ideas Compression of ideas Compression of ideas Narration is essential. Adding verbal summaries, titles and captions to illustrations strengthens their value and aids in recall.Narration is essential Narration is essential Narration is essential Narration is essential Narration is essential N North Sharpen your tools. Because traditional education emphasizes writing,investing time in learning illustration can be better "value for money" Sharpen your tools Sharpen your tools Sharpen your tools Sharpen your tools Sharpen your tools Deliberate design: Aim for tight alignment between visuals, captions,titles, and text for maximum impact and coherence in your materials.Deliberate design Deliberate design Deliberate design Deliberate design Deliberate design So What? Abstract to concrete: We remember the concrete much better than the abstract. Illustrations help transform the abstract into the concrete.Abstract to concrete Abstract to concrete Abstract to concrete Abstract to concrete Abstract to concrete

Click and hold to enlarge. SHIFT + wheel to zoom. ESC to reset.

By embracing both text and visuals, we can enhance our ability to communicate complex ideas effectively and enrich our understanding of the world around us.

Finally, if you want to explore this topic further, check out my video on the topic: