opensandwich.ai
Previous photoAvocado TeaNext photoCookie PB
Panini
PNIPeople mostly said yes
Benchmark image 13

Panini

Panini "Sandwich"

A pressed panini with greens and filling compressed into sharp grill lines shows up like a normal sandwich after a product manager discovered heat. It is structurally boring in the best possible way and still somehow controversial to a few models.

Under development: this benchmark and its published results are provisional, not final.

Human
92.4% yes7.6% no
Model average
99.7% yes0.3% no
At a glance

How this photo split the room

Human distribution
92.4% yes, 7.6% no over 655 explicit votes.
Model average distribution
99.7% yes, 0.3% no across the current model set.
Closest current model
99.0% yes.

nvidia/nemotron-nano-12b-v2-vl

Least aligned model
14.4 point gap.

meta-llama/llama-3.2-11b-vision-instruct

Legacy GPT-4o baseline
100.0% yes with a 7.6 point gap against humans.
Biggest model gap
14.4 percentage points on this image.
Current classification
People mostly said yes
Benchmark context
Current classification
People mostly said yes
Models compared
67 current runs
Biggest model gap
14.4 percentage points on this image.
Closest model output
99.0% yes.
Model spread

How Models Align with Human Responses

This compares each model against human responses to show how closely it aligns with people.Human rate marker

GPT / OpenAIopenai/o1

0.0% no100.0% yes

Human gap7.6%

Rank #2

GPT / OpenAIopenai/o3

0.0% no100.0% yes

Human gap7.6%

Rank #57

Selected human comments

  • No, it is a photo of an Avocado and spinach panini "sandwich"
  • That's a gum-shredder. That shit will tear up your face.
  • Salad and breadsticks

nvidia/nemotron-nano-12b-v2-vl comments

  • The item is a wrap, not a traditional sandwich. Sandwiches typically use sliced bread, while wraps use folded flatbread or tortillas.
  • Grilled panini with bread, avocado, lettuce, and onions fits the sandwich definition: fillings between bread slices.

meta-llama/llama-3.2-11b-vision-instruct comments

  • A sandwich typically consists of two slices of bread filled with various ingredients, such as meats, cheeses, vegetables, and condiments. This photo shows two halves of a ciabatta bread filled with avocado, spinach, and sun-dried tomatoes, which is more akin to a panini or a wrap. While it may be considered a sandwich by some, it doesn't fit the traditional definition of a sandwich.
  • A sandwich is a food item typically consisting of two or more slices of bread, often with fillings such as meats, cheeses, vegetables, and condiments. The key elements of a sandwich are the bread and the filling, and it can be served in various ways, including grilled, toasted, or as a wrap. In this case, the image depicts a panini, which is a type of sandwich made with bread that has been grilled or pressed. It typically consists of a filling, such as meats, cheeses, and vegetables, placed between two slices of bread that have been grilled or pressed together. Therefore, based on the definition of a sandwich, the image is indeed a sandwich, specifically a panini.
Vote card

Generated summary for this photo

Vote card for Panini
Is Panini a Sandwich? Human vs AI Results | opensandwich.ai