Google is bringing a new tool to macOS that lets users chat instantly with its Gemini Mac app in any desktop window following a single keypress.
By doing so, the company is launching a direct competitor to Apple Intelligence and ChatGPT on the Mac desktop.
A Major Upgrade For The Gemini Mac AppBy default, long-pressing the Fn key launches a new Intelligent dictation tool that automatically transcribes everything you say, stripping out any “ums” and “ahs,” and places the result directly into your document.
However, you can also opt in to what the company calls “Screen-aware reasoning,” that lets Gemini understand what’s on your screen.
In this example, the user points Gemini at a desktop folder including a list of dietary requirements, a selection of restaurant menus and a company expenses policy and asks Gemini to draft an email highlighting recommended options.
Google is bringing a new tool to macOS that lets users chat instantly with its Gemini Mac app in any desktop window following a single keypress. By doing so, the company is launching a direct competitor to Apple Intelligence and ChatGPT on the Mac desktop.
A Major Upgrade For The Gemini Mac App
By default, long-pressing the Fn key launches a new Intelligent dictation tool that automatically transcribes everything you say, stripping out any “ums” and “ahs,” and places the result directly into your document.
However, you can also opt in to what the company calls “Screen-aware reasoning,” that lets Gemini understand what’s on your screen.
In an example video, Google demonstrates how the user can speak long, complex instructions, optionally referring to files on the local computer, and have Gemini synthesize a response directly into a document or email. In this example, the user points Gemini at a desktop folder including a list of dietary requirements, a selection of restaurant menus and a company expenses policy and asks Gemini to draft an email highlighting recommended options.