Galaxy AI | |
---|---|
![]() | |
![]() Galaxy AI features displayed on various Samsung devices | |
Developer(s) | Samsung Electronics |
Initial release | January 17, 2024 [1] |
Stable release | |
Operating system | Android 16 with One UI 8 Android 15 with One UI 7.0 Android 14 with One UI 6.1 |
Available in | 20 languages, including Arabic, Chinese (China mainland, Hong Kong), English (Australia, India, United Kingdom, United States), French (Canada, France), German, Hindi, Indonesian, Italian, Japanese, Korean, Polish, Portuguese (Brazil), Russian, Spanish (Mexico, Spain, United States), Thai and Vietnamese. [3] |
Type | Artificial intelligence |
License | Proprietary |
Website | Galaxy AI(US) |
Galaxy AI is a collection of artificial intelligence (AI) features developed by Samsung Electronics for use in Galaxy-branded mobile devices. First released with the Samsung Galaxy S24 series in January 2024, the system integrates both on-device and cloud-based processing to support features such as language translation, image editing, and content search. These tools operate within various Samsung applications and are intended to assist with everyday tasks. [4] [5]
Galaxy AI integrates Samsung’s own AI models with external technologies, including Google's Gemini AI, to provide a variety of context-sensitive functions. These include tools for language translation, media editing, and task automation. They are available within specific Samsung applications. [6] [7]
Galaxy AI includes multiple tools that apply artificial intelligence to specific user tasks, such as communication, notetaking, photography, and productivity. Each tool is categorized by function and operates within Samsung’s software environment.
Provides translation-related features within the default Phone app on supported Galaxy devices. It includes Live Translate, which enables two-way voice and text translation during calls, and Text Call, which converts speech into real-time text and generates responses. These tools aim to support communication across different languages and offer alternatives to voice-based interaction. [8] [9] [10] Text Call does not involve AI processing and is available on all devices supporting One UI 6.1 or later.
A feature integrated into the Samsung Keyboard that supports tasks such as translation, sentence composition, and text correction. It offers tools for adjusting phrasing, grammar, and tone across supported apps, including messaging and email platforms. Suggested replies may also be generated based on context. [11] [12] [13]
A translation feature on Galaxy devices running One UI 6.1 or later, offering real-time spoken and on-screen translations for two-way face-to-face conversations. It supports over a dozen languages and includes a screen-flip view so each speaker can read translations in their own language. Offline use is available with downloaded language packs. [14]
A daily summary interface introduced in One UI 7 and updated in One UI 8. It presents scrollable cards with updates such as weather, calendar events, smart home status, and hydration reminders. One UI 8 added a “Listen Brief” feature using on-device text-to-speech. Now Brief also serves as a visual output surface for Gemini Live, displaying AI-generated summaries and follow-up suggestions in card format. These cards are dynamically updated based on the user’s schedule and app usage, and are accessible via the Now Bar. [15] [16]
A customizable toolbar introduced in One UI 7 and updated in One UI 8, offering quick access to live activities, device routines, and app shortcuts. Now Bar includes real-time widgets such as Now Brief cards, and acts as the primary interface for launching Gemini Live. A Gemini Live status indicator (e.g. “listening” or “on hold”) may appear on the lock screen, showing session status and offering limited session controls. [15] [16] [17] [18]
A multimodal AI feature included in the Galaxy AI suite, powered by Google Gemini. It enables interaction through voice, camera input, and screen sharing, supporting tasks such as object recognition, text translation, and content analysis. The assistant works with supported applications, with direct integration for Samsung apps such as Calendar, Samsung Notes, and Reminders. Responses generated by Gemini Live may appear as Now Brief cards, and the session status can be monitored and managed through Now Bar. [19] [20] [21] [22]
A feature in Samsung Notes that helps summarize content from meetings or lectures into structured formats. It can identify recurring phrases or key points and format them using built-in organization tools. The output may be used for reviewing or sharing, depending on the user’s needs. [14] [23]
A function within the Samsung Voice Recorder app allows recorded speech to be converted into text. It supports additional features such as basic summarization and translation, depending on the content and system configuration. These tools are intended to improve audio processing efficiency within the app. [23]
A feature that enables certain actions—such as search, translation, or event creation—based on selected text or content across compatible apps. It recognizes contextual elements and presents available options within supported Samsung and third-party applications. [24] [25] [26]
A software-based imaging system applies scene recognition and automated adjustments to improve visual output on supported devices. It can modify parameters such as color balance, brightness, contrast, and noise levels. Manual adjustment tools are also available for users who prefer direct control. [27] [28] [29]
A low-light photography function that uses noise reduction and exposure control to support clearer image and video capture in dark settings. It may also apply motion blur reduction depending on the scene and hardware capabilities. [30] [31]
A gesture-based search function that lets users select on-screen content for related web lookup. It can recognize elements such as products, landmarks, and text, and provides search suggestions within the current interface. This is intended to reduce app switching during contextual queries. [14] [32]
A content-based suggestion feature that analyzes what is displayed on screen to offer possible user actions. Examples include suggesting wallpaper settings or creating short video clips from selected media. The feature works within certain Samsung apps and may vary depending on device capabilities. [33] [34] [35] [36]
A web summarization feature within the Samsung Internet browser that processes textual content to generate condensed versions. It can also translate supported content and is limited to handling text-based information. The function is intended to assist users in reviewing lengthy web content. [37] [38]
An image generation function that creates visual outputs from sketches, photos, or text-based prompts. It applies algorithmic filters to modify or complete the input and is compatible with tools such as the S Pen and voice commands. On the Galaxy S25 Ultra, the integrated S Pen can be used to sketch or refine inputs directly. Processing is supported by the ProVisual Engine including ProScaler, which enhances image processing through multi-frame capture, sharpness enhancement, and low-light optimization. The feature is available in apps including Samsung Gallery, Samsung Notes, and the Edge Panel. [39] [40] [41]
A portrait creation feature that generates stylized images from photos or sketches using AI-based image processing. Users can apply effects such as lighting or background adjustments through touch or S Pen input. The function integrates with the Best Face tool, which captures multiple images in succession and enables the selection of preferred facial expressions. Technical features such as Auto HDR and the ProVisual Engine contribute to improved detail and lighting balance, producing higher-quality inputs for AI portrait generation. The feature is accessible in the Samsung Gallery app. [40] [42] [43] [44]
An image editing function that allows users to remove objects, expand backgrounds, or resize content using automated generation tools. Modified areas are filled in algorithmically based on surrounding visual context. Related software options such as Expert RAW and Enhance-X offer additional processing functions, including sharpening, noise reduction, and camera shift correction. Hardware specifications also affect the use of generative editing; for example, the Galaxy S25 Ultra includes a 200MP wide lens, a 50MP ultra-wide lens, and both 10MP and 50MP telephoto lenses with up to 5× optical zoom, which can provide higher-resolution source material for editing. [45] [46] [47] [48] [49]
A post-processing feature that allows users to remove background noise or specific audio elements—such as voices, wind, or crowd sounds—from recorded videos. It uses AI-based audio separation to isolate and reduce unwanted sound components. While primarily software-driven, supporting systems such as the ProVisual Engine improve visual clarity and reduce noise in source video, indirectly enhancing audio separation accuracy. The feature is available in the Samsung Gallery app and can be accessed during video editing. [50]
A video editing function that detects and selects portions of footage based on visual or contextual patterns, enabling the assembly of shorter clips without manual editing. It is supported by AI-powered video analytics that assess scene composition and motion. High-resolution recording modes, such as 8K video capture, provide additional flexibility for cropping and reframing segments during editing. Optical Zoom systems included in the S25 series also contribute to framing inputs. [51] [52]
A post-processing function that generates slow-motion playback by interpolating additional frames between existing ones. It is activated during video playback in the Gallery app by tapping and holding the screen, without the need for prior selection of a specific recording mode. AI frame interpolation, analyzes consecutive frames and predicts intermediate frames, allowing smooth slow-motion effects even for standard recordings captured at 30 or 60 frames per second. Native high-frame-rate recording, available up to 960fps, enables feature such as Super Slo-Mo. Instant Slo-Mo may be used with Log video, which captures a flat profile for dynamic range, and Galaxy Log, Samsung’s AI-based grading tool. These functions allow additional control in post-production. [53] [54] [55] [56]
Two input functions within the Galaxy device interface that handle voice and visual recognition tasks. Bixby processes spoken commands to operate certain features or access tools, and can be launched by voice or a hardware button. Bixby Vision identifies visual elements through the camera, such as objects or text, and displays related information within supported apps. [57] [58] [59]
A health monitoring function in the Samsung Health app that generates an Energy score based on factors such as sleep quality, activity, and heart rate variability. The score is intended to reflect a user's general condition for daily activity, and is derived from data collected by other Galaxy devices, although only a watch or a smart ring can track sleep. [60] [61] [62]
Two visual customization functions that modify wallpaper appearance using AI-based processing. Generative Wallpaper creates images from user-provided keywords or themes, operating locally on the device. Photo Ambient adjusts wallpaper based on environmental factors such as lighting and time, using preset visual filters. [63] [64] [65] [66]
These features leverage on-device AI for privacy-sensitive tasks while utilizing cloud-based AI for complex processing needs. [67]
Galaxy AI was introduced with the Galaxy S24 series in January 2024 and later extended to other Galaxy models through software updates. AI features are available at no cost on compatible devices until the end of 2025, with functionality varying by model. [68]
Galaxy S series
Galaxy Z series
Galaxy Tab series
Galaxy A series
Galaxy A series phones have limited AI features.
Galaxy Wearables
Future software updates may add Galaxy AI support to additional devices, according to Samsung. [69]
Galaxy AI processes sensitive data locally on the device to limit external transmission, while cloud-based computing is used selectively for intensive tasks. According to Samsung, user data is not stored or used to train AI models without explicit permission. The company also outlines principles related to fairness, transparency, and accountability in AI development. [70] [ better source needed ]
{{cite news}}
: CS1 maint: url-status (link)