Gemini Pro

Our best model for general performance across a wide range of tasks

Try Gemini Advanced Build with Gemini

Natively multimodal, with an updated long context window of up to two million tokens — the longest of any large-scale foundation model.

Natively multimodal, with an updated long context window of up to two million tokens — the longest of any large-scale foundation model.

Better understanding across modalities

Gemini 1.5 Pro can perform highly sophisticated reasoning tasks using text, images, audio, and video. Here, it uses a hand-drawn picture to pinpoint a scene in a Buster Keaton movie.

Reasoning about vast amounts of information

Watch Gemini 1.5 Pro analyze and summarize the 402-page transcript from Apollo 11’s mission to the moon.

Problem-solving with longer blocks of code

See Gemini 1.5 Pro reason across 100,000 lines of code and give helpful solutions, modifications, and explanations.

Capability	Benchmark	Description	Gemini 1.0 Pro	Gemini 1.0 Ultra	Gemini 1.5 Pro (Feb 2024)	Gemini 1.5 Flash	Gemini 1.5 Pro (May 2024)
General MMLU Representation of questions in 57 subjects (incl. STEM, humanities, and others)
General	MMLU	Representation of questions in 57 subjects (incl. STEM, humanities, and others)	Gemini 1.0 Pro 71.8%	Gemini 1.0 Ultra 83.7%	Gemini 1.5 Pro (Feb 2024) 81.9%	Gemini 1.5 Flash 78.9%	Gemini 1.5 Pro (May 2024) 85.9%
Code Natural2Code Python code generation. Held out dataset HumanEval-like, not leaked on the web
Code	Natural2Code	Python code generation. Held out dataset HumanEval-like, not leaked on the web	Gemini 1.0 Pro 69.6%	Gemini 1.0 Ultra 74.9%	Gemini 1.5 Pro (Feb 2024) 77.7%	Gemini 1.5 Flash 77.2%	Gemini 1.5 Pro (May 2024) 82.6%
Math MATH Challenging math problems (incl. algebra, geometry, pre-calculus, and others)
Math	MATH	Challenging math problems (incl. algebra, geometry, pre-calculus, and others)	Gemini 1.0 Pro 32.6%	Gemini 1.0 Ultra 53.2%	Gemini 1.5 Pro (Feb 2024) 58.5%	Gemini 1.5 Flash 54.9%	Gemini 1.5 Pro (May 2024) 67.7%
Reasoning GPQA (main) Challenging dataset of questions written by domain experts in biology, physics, and chemistry
Reasoning	GPQA (main)	Challenging dataset of questions written by domain experts in biology, physics, and chemistry	Gemini 1.0 Pro 27.9%	Gemini 1.0 Ultra 35.7%	Gemini 1.5 Pro (Feb 2024) 41.5%	Gemini 1.5 Flash 39.5%	Gemini 1.5 Pro (May 2024) 46.2%
Reasoning Big-Bench Hard Diverse set of challenging tasks requiring multi-step reasoning
	Big-Bench Hard	Diverse set of challenging tasks requiring multi-step reasoning	Gemini 1.0 Pro 75.0%	Gemini 1.0 Ultra 83.6%	Gemini 1.5 Pro (Feb 2024) 84.0%	Gemini 1.5 Flash 85.5%	Gemini 1.5 Pro (May 2024) 89.2%
Multilingual WMT23 Language translation
Multilingual	WMT23	Language translation	Gemini 1.0 Pro 71.7	Gemini 1.0 Ultra 74.4	Gemini 1.5 Pro (Feb 2024) 75.2	Gemini 1.5 Flash 74.1	Gemini 1.5 Pro (May 2024) 75.3
Image MMMU Multi-discipline college-level reasoning problems
Image	MMMU	Multi-discipline college-level reasoning problems	Gemini 1.0 Pro 47.9%	Gemini 1.0 Ultra 59.4%	Gemini 1.5 Pro (Feb 2024) 58.5%	Gemini 1.5 Flash 56.1%	Gemini 1.5 Pro (May 2024) 62.2%
Image MathVista Multi-discipline college-level reasoning problems
	MathVista	Mathematical reasoning in visual contexts	Gemini 1.0 Pro 46.6%	Gemini 1.0 Ultra 53.0%	Gemini 1.5 Pro (Feb 2024) 54.7%	Gemini 1.5 Flash 58.4%	Gemini 1.5 Pro (May 2024) 63.9%
Audio FLEURS (55 languages) Automatic speech recognition (based on word error rate, lower is better)
Audio	FLEURS (55 languages)	Automatic speech recognition (based on word error rate, lower is better)	Gemini 1.0 Pro 6.4%	Gemini 1.0 Ultra 6.0%	Gemini 1.5 Pro (Feb 2024) 6.6%	Gemini 1.5 Flash 9.8%	Gemini 1.5 Pro (May 2024) 6.5%
Video EgoSchema Video question answering
Video	EgoSchema	Video question answering	Gemini 1.0 Pro 55.7%	Gemini 1.0 Ultra 61.5%	Gemini 1.5 Pro (Feb 2024) 65.1%	Gemini 1.5 Flash 65.7%	Gemini 1.5 Pro (May 2024) 72.2%

Research Assistant Understand the key attributes of a research paper’s methodology.

Plant care How do I best care for this plant?

Which shape comes next? Given a series of shapes, guess which comes next.

Game Character Brainstorming Create a character design based on a provided context.

Cook Helper Get recipe ideas based on an image of the ingredients you have on hand.

Barista Bot Order common coffee drinks from this virtual barista.

May 2024 Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context

December 2023 Gemini 1.0: A family of highly capable multimodal models

Get the latest updates

Sign up for news on the latest innovations from Google DeepMind.

Email address

Please enter a valid email (e.g., "name@example.com")

I accept Google's Terms and Conditions and acknowledge that my information will be used in accordance with Google's Privacy Policy.

Sign up