Connected & Protected
24/7 Support
HomeBlogTeaching AI to see the world more like we do
AI & Machine Learning
#AI visual perception
#human-like AI
#AI robustness
#visual representations in AI
#machine learning
#AI generalization
#trustworthy AI systems
#artificial intelligence research
#neural networks
#computer vision
#AI alignment
#human perception
#AI perception
#visual representation in AI
#human-AI alignment

Teaching AI to see the world more like we do

Our new paper analyzes the important ways AI systems organize the visual world differently from humans.

G
Google DeepMind News
Content Author
Content Specialist

Andrew Lampinen and Klaus Greff are leading researchers in AI and machine learning, specializing in visual perception and the alignment of AI systems with human cognitive processes.

Expertise: Artificial Intelligence, Machine Learning, Visual Perception, Cognitive Science, Deep Learning
Published: November 11, 2025
Updated: Jan 1, 2026
12 min read

Quick Answer

This post discusses new research on aligning AI visual representations with human perception, improving AI robustness and generalization for better reliability in tasks.

TL;DR

Recent research reveals that AI systems often perceive the visual world differently than humans. By reorganizing AI visual representations, we can enhance their robustness and alignment with human knowledge, leading to more intuitive AI applications.

Key Takeaways

  • 1AI systems currently struggle to interpret visual data like humans do.
  • 2Reorganizing visual representations can improve AI's reliability and generalization.
  • 3This research is a step towards building more trustworthy AI technologies.
Teaching AI to see the world more like we do
November 11, 2025 Research

Teaching AI to see the world more like we do

Andrew Lampinen, Klaus Greff

Share
A conceptual diagram illustrating AI and human alignment. Nine images (e.g., a giraffe, a car, and a tent) are organised near colourful dot clusters, with lines grouping related concepts, such as a giraffe with a sea turtle and a car with an airplane.

Listen to article 10 minutes

add
remove

New research shows that reorganizing a model’s visual representations can make it more helpful, robust and reliable

“Visual” artificial intelligence (AI) is everywhere. We use it to sort our photos, identify unknown flowers and steer our cars. But these powerful systems do not always “see” the world as we do, and they sometimes behave in surprising ways. For example, an AI system that can identify hundreds of car manufacturers and models might still fail to capture the commonalities between a car and an airplane, i.e. both are large vehicles made primarily of metal.

To better understand these differences, today we’re publishing a new paper in Nature analyzing the important ways AI systems organize the visual world differently from humans. We present a method for better aligning these systems with human knowledge, and show that addressing these discrepancies improves their robustness and ability to generalize.

This work is a step towards building more intuitive and trustworthy AI systems.

Why AI struggles with the “odd one out”

When you see a cat, your brain creates a mental representation that captures everything about the cat, from basic concepts like its color and furriness to high-level concepts like its "cat-ness." AI vision models also produce representations, by mapping images to points in a high-dimensional space where similar items (like two sheep) are placed close together, and different ones (a sheep and a cake) are far apart.

To understand the differences in how human and model representations are organized, we used the classic "odd-one-out" task from cognitive science, asking both humans and models to pick which of three given images does not fit in with the others. This test reveals which two items they "see" as most simila

Acronis
Related Product

Acronis Advanced Backup - Server

by Acronis$17.14/mo

Acronis Cyber Protect Cloud unites backup and next-generation AI-based anti-malware, antivirus, and endpoint protection management in one solution.

Learn More
r.

Sometimes, everyone agrees. Given a tapir, a sheep, and a birthday cake, both humans and models reliably pick the cake as the odd one out. Other times, the right answer is unclear, and people and models disagree.

Interestingly, we also found many cases where humans strongly agree on an answer, but the AI models get it wrong. For the third example below, most people agree the starfish is the odd one out. But most vision models focus more on superficial features like background color and texture, and choose the cat instead.

Three examples of the "odd one out" task. Three images of subjects in the natural world are shown in three rows. The first row shows an easy task where humans and models align. The second row shows an example where humans and AI models disagree. The third row shows an example where humans tend to agree, but models make a different choice.

This example illustrates a systematic misalignment between humans and AI, which we observed across many different vision models, from image classifiers to unsupervised models.

The overall problem can be seen in a two-dimensional projection (PCA) of an AI’s internal map.

Below, on the left, we show a vision model's internal map which appears unstructured, with representations for different categories like animals, food, and furniture all mixed together. The structure on the right is the improved representation map after we applied our alignment method where categories are clearly organized.

Two maps showing a vision model’s representations of many different categories of objects. Before alignment (left) there is no visible organization. After alignment (right) the representations are meaningfully organized by category.

A multi-step alignment method

Cognitive scientists have collected the THINGS dataset containing millions of human odd-one-out judgements, which we could have used to help solve the visual alignment problem. Unfortunately, this dataset only uses a few thousand images — not enough information to directly fine tune powerful vision models, which immediately overfit on this small set of images and forget many of their prior skills.

To address this, we proposed a three-step method:

  1. We started with a powerful pretrained vision model (SigLIP-SO400M) and carefully trained a small adapter on top of it, using the THINGS dataset. By freezing the main model and carefully regularizing the adapter training, we created a teacher model that doesn’t forget its prior training.
  2. This teacher model then acts as a stand-in for human-like judgments, which we used to generate a massive new dataset, called AligNet, of millions of human-like odd-one-out decisions using a million different images — far more than we could collect from real people.
  3. Finally, we used this new dataset to fine tune other AI models (the "students"). Because of the diversity of our dataset, overfitting is no longer an issue and the students can be trained fully and can more deeply restructure their internal maps.

As shown in the diagram below, the student’s representations change from an unstructured jumble to a clearly-structured organization where high-level concepts such as animals (blue) and food items (green) are separated from other types of objects.

Diagram of our three-step model-alignment method.

Human knowledge is organized according to different levels of similarity. When we align models with human knowledge, the model’s representations change according to these levels of similarity. This reorganization follows the hierarchical structure of human knowledge known from cognitive science.

During alignment, we see that representations move apart or together in proportion to their ”conceptual distance” in the human-category hierarchy. For example, two dogs (same subordinate category) will move closer together (decrease in distance), while an owl and a truck (different superordinate categories) will move further apart (increase in distance

).

A line graph shows the change in relative distances between human and AI representations. The representations of very similar categories tend to get closer together, while representations of less similar pairs of objects tend to move further apart.

We can conclude that our method organizes the representational map of the AI student according to human conceptual hierarchies, without being explicitly supervised to do so.

Testing our aligned models

We tested our aligned models on many cognitive science tasks — including tasks like multi-arrangement, arranging many images by their similarity — and a new odd-one-out dataset, called Levels, that we collected. In every case, our aligned models showed dramatically improved human-alignment, agreeing substantially more often with human judgments across a range of visual tasks.

Our models even learned a form of ‘human-like’ uncertainty. In testing, model-decision-uncertainty strongly correlated with how long it took humans to make a choice – a common proxy measure for uncertainty.

We also found that making models more human-aligned also makes them better vision models overall. Our aligned models performed much better at various challenging tasks, such as learning a new category from a single image (“few-shot learning”), or making reliable decisions, even when the type of images being tested changed (the “distribution shift”).

Two bar graphs showing that our aligned models (dark blue) outperform the original ones (light gray) at cognitive science tasks involving odd-one-out and multi-arrangement (top) and AI tasks involving few-shot learning and distribution shift (bottom).

Toward more human-aligned, reliable models

Many existing vision models fail to capture the higher-level structure of human knowledge. This research presents a possible method for addressing this issue, and shows that models can be aligned better with human judgments and perform more reliably on various standard AI tasks.

While more alignment work remains to be done, our work illustrates a step towards more robust and reliable AI systems.

Acknowledgements

We’d like to thank the paper’s lead author Lukas Muttenthaler, and our collaborators Frieda Born, Bernhard Spitzer, Simon Kornblith, Michael C. Mozer, Klaus-Robert Müller and Thomas Unterthiner.

Gemini Robotics: 1.5 brings AI agents into the physical world

September 2025
Google DeepMind

Image editing in Gemini just got a major upgrade

August 2025 Models

Originally published on November 11, 2025 by Google Deep Mind.

Expert Analysis for Orange County Businesses

How this impacts SMBs in Southern California

Tech News Roundup: Teaching AI to see the world more like we do

The recent research revealing how AI systems can be trained to better align with human visual perception highlights a significant opportunity for small and medium businesses (SMBs) in Orange County and Southern California. As AI becomes increasingly integrated into various business operations—from customer service to quality control—understanding these advancements can help local businesses leverage AI technologies more effectively. By adopting AI tools that "see" and interpret data in a human-like manner, SMBs can enhance their operational efficiency, improve customer interactions, and gain deeper insights from their visual data.

At The Network Company, we recognize the potential of AI to transform business processes. Our AI services are designed to help local businesses harness this technology effectively, ensuring that their AI systems align with their unique operational needs. Furthermore, the integration of AI can be fortified with our cybersecurity solutions to protect against any vulnerabilities that may arise from using advanced technologies. For those looking to secure their data, our cloud backup and BCDR services provide essential safety nets, ensuring business continuity in the face of unforeseen challenges. Explore our managed IT services to find out how we can support your transition into a more AI-driven future.

Read the full article: Original Source Link

Frequently Asked Questions

How does AI perceive images differently than humans?

AI uses high-dimensional mapping to categorize images, lacking the nuanced understanding that humans possess.

What improvements can be made to AI systems?

Reorganizing visual representations within AI can enhance their robustness and make them more intuitive.

Content Quality

Last Reviewed:December 27, 2025
Fact-Checked:December 27, 2025
Sources:7 verified sources
Word Count:1,285 words

Article Tags

AI visual perception
human-like AI
AI robustness
visual representations in AI
machine learning
AI generalization
trustworthy AI systems
artificial intelligence research
neural networks
computer vision
AI alignment
human perception
AI perception
visual representation in AI
human-AI alignment
G

About Google DeepMind News

Content Author

Andrew Lampinen and Klaus Greff are leading researchers in AI and machine learning, specializing in visual perception and the alignment of AI systems with human cognitive processes.

Expertise: Artificial Intelligence, Machine Learning, Visual Perception, Cognitive Science, Deep Learning

Ready to Transform Your Business?

Discover how our expert IT solutions can help your business thrive.