Previous photoDodge Van Next photoSandwich Costume

SUBPeople mostly said yes

Benchmark image 03

Sub Sandwich

Salami, cheddar, lettuce & tomato sub "Sandwich"

A long sub packed with salami, cheddar, lettuce, and tomato sprawls across the frame like a benchmark overfit to obvious wins. It is unquestionably a sandwich, unless you are the kind of engineer who opens a ticket about submarine semantics.

Under development: this benchmark and its published results are provisional, not final.

Human

94.5% yes5.5% no

Model average

99.5% yes0.5% no

Most aligned models

30-way tie

openai/o3-pro

moonshotai/kimi-k2.5

x-ai/grok-4-fast+27 more

Least aligned model

meta-llama/llama-3.2-11b-vision-instruct

At a glance

How this photo split the room

Human distribution

94.5% yes, 5.5% no over 656 explicit votes.

Model average distribution

99.5% yes, 0.5% no across the current model set.

Closest current models

100.0% yes.

30-way tie

Least aligned model

8.8 point gap.

meta-llama/llama-3.2-11b-vision-instruct

Legacy GPT-4o baseline

100.0% yes with a 5.5 point gap against humans.

Biggest model gap

8.8 percentage points on this image.

Current classification

People mostly said yes

Why this page matters

This is the compact read on where humans, models, and comments start disagreeing about the same image.

Model spread

How models line up against the crowd

Bars run from more no on the left to more yes on the right. The marker shows the human yes rate.

meta-llama/llama-3.2-11b-vision-instruct

14.3% no85.7% yes

Rank #1Gap 8.8%

amazon/nova-lite-v1

0.0% no100.0% yes

Rank #17Gap 5.5%

amazon/nova-pro-v1

0.0% no100.0% yes

Rank #30Gap 5.5%

anthropic/claude-opus-4.6

0.0% no100.0% yes

Rank #23Gap 5.5%

anthropic/claude-sonnet-4.6

0.0% no100.0% yes

Rank #22Gap 5.5%

baidu/ernie-4.5-vl-28b-a3b

0.0% no100.0% yes

Rank #27Gap 5.5%

google/gemini-2.5-pro

0.0% no100.0% yes

Rank #7Gap 5.5%

google/gemini-3-flash-preview

0.0% no100.0% yes

Rank #32Gap 5.5%

google/gemini-3.1-pro-preview

0.0% no100.0% yes

Rank #10Gap 5.5%

google/gemma-3-12b-it

0.0% no100.0% yes

Rank #11Gap 5.5%

google/gemma-3-27b-it

0.0% no100.0% yes

Rank #15Gap 5.5%

meta-llama/llama-4-maverick

0.0% no100.0% yes

Rank #26Gap 5.5%

meta-llama/llama-4-scout

0.0% no100.0% yes

Rank #13Gap 5.5%

minimax/minimax-01

0.0% no100.0% yes

Rank #29Gap 5.5%

mistralai/pixtral-large-2411

0.0% no100.0% yes

Rank #16Gap 5.5%

moonshotai/kimi-k2.5

0.0% no100.0% yes

Rank #4Gap 5.5%

openai/gpt-4.1

0.0% no100.0% yes

Rank #31Gap 5.5%

openai/gpt-4.1-mini

0.0% no100.0% yes

Rank #18Gap 5.5%

openai/gpt-4o

0.0% no100.0% yes

Rank #9Gap 5.5%

openai/gpt-4o-2024-11-20

0.0% no100.0% yes

Rank #25Gap 5.5%

openai/gpt-4o-mini

0.0% no100.0% yes

Rank #21Gap 5.5%

openai/gpt-5.4

0.0% no100.0% yes

Rank #20Gap 5.5%

openai/gpt-5.4-pro

0.0% no100.0% yes

Rank #8Gap 5.5%

openai/o3

0.0% no100.0% yes

Rank #24Gap 5.5%

openai/o3-pro

0.0% no100.0% yes

Rank #3Gap 5.5%

qwen/qwen-2-vl-72b-instruct

0.0% no100.0% yes

Rank #12Gap 5.5%

qwen/qwen2.5-vl-32b-instruct

0.0% no100.0% yes

Rank #14Gap 5.5%

qwen/qwen2.5-vl-72b-instruct

0.0% no100.0% yes

Rank #28Gap 5.5%

qwen/qwen3.5-397b-a17b

0.0% no100.0% yes

Rank #6Gap 5.5%

x-ai/grok-4-fast

0.0% no100.0% yes

Rank #5Gap 5.5%

z-ai/glm-4.6v

0.0% no100.0% yes

Rank #19Gap 5.5%

Selected human comments

No, it is a photo of a sandwich.
This is a vessel that conveys men underwater, while cramming too many of them together.
Not my favortie

openai/o3-pro comments

Classic sub: bread split, filled with meat, cheese, veggies—clearly a sandwich.
Classic sub: meats, cheese, veggies between split loaf

meta-llama/llama-3.2-11b-vision-instruct comments

A sandwich is generally considered to be a food item consisting of two or more slices of bread, with fillings in between. In this case, the image depicts a sausage and cheese hoagie, which meets this definition.
A sandwich is a food item typically consisting of bread, often sliced, stacked with various fillings such as meats, cheeses, vegetables, condiments, or spreads.

Vote card

Sub Sandwich

How this photo split the room

How models line up against the crowd

Selected human comments

openai/o3-pro comments

meta-llama/llama-3.2-11b-vision-instruct comments

Generated summary for this photo