话题指南
人工智能与机器学习
探索 Apple Intelligence、Foundation Models、Core ML、Vision，以及交付私密而强大的机器学习功能的方法。
这一话题连接 Apple 的模型框架与实际产品决策，涵盖端侧与云端模型、工具调用、评估、计算机视觉、模型转换，以及真实 App 所面对的隐私和性能约束。
- Session
- 76
- 2026
- 38
- 2025
- 17
- 2024
- 21
这一话题涵盖什么
- Foundation Models 与 Apple Intelligence
- Core ML、Vision 与模型优化
- 评估、隐私与 Agent 体验
WWDC 2026
38 场 Session- Apple Intelligence Group LabJoin us online for a deep dive into WWDC26 with Apple engineers and designers to ask questions, get advice, and follow the discussion about the week's biggest Apple Intelligence announcements. Conducted in…
- Best practices for integrating visual intelligence in your appGain insight on how visual intelligence can transform content discovery in your app. Explore how to define entities, process images, and handle multiple result types effectively. Learn best practices for…
- Bring an LLM provider to the Foundation Models frameworkExtend the Foundation Models framework by implementing a LanguageModelExecutor for new models. Explore how to interface with the LanguageModelSession's transcript, manage session state effectively, and…
- Bringing Cyberpunk 2077 to MacGo behind the scenes and learn from CD PROJEKT RED how Cyberpunk 2077 came to Mac, setting a new standard for AAA gaming on macOS. Explore how the team leveraged Apple's robust hardware, software, and…
- Build AI-powered scripts with the fm CLI and Python SDKExplore all the new ways to leverage Apple Foundation Models on macOS. The Foundation Models SDK for Python lets you integrate with popular tooling and evaluation packages in the Python ecosystem. Find out how…
- Build agentic app experiences with the Foundation Models frameworkLearn how to take your intelligence features further with Foundation Models framework primitives for dynamic context and agentic workflows. We'll walk through engineering shared context, setting up privacy…
- Build intelligent Siri experiences with App SchemasBring your app's content and actions to Siri with App Intents. Model your data using App Entities, adopt App Schemas to enable powerful system actions, and support natural language interactions powered by…
- Build real-time neural rendering pipelines with MetalDiscover how to integrate machine learning into your real-time rendering pipeline using Metal 4. We'll explore practical adoption patterns and best practices for achieving production-quality results with…
- Build with the new Apple Foundation Model on Private Cloud ComputePrivate Cloud Compute lets you access powerful, frontier-class models while protecting user privacy. Explore how it works and how to access it using the Foundation Models framework. Discover best practices for…
- Code-along: Make your app available to SiriDive deep into an Xcode project showing how you can make your app available to Siri. Learn how to adopt App Schemas to let people ask questions about calendar events and take natural language actions like…
- Coding Intelligence, Machine Learning & AI Group LabJoin us online for a deep dive into WWDC26 with Apple engineers and designers to ask questions, get advice, and follow the discussion about the week's biggest announcements for coding intelligence, machine…
- Create UI prototypes using agents in XcodeLearn how to prototype your app using agents in Xcode. Explore techniques for using AI to prototype interactions, iterate on layouts, and generate creative solutions to design challenges. You'll learn how to…
- Create high-quality images using Image PlaygroundEnable high-quality image creation in your app using Image Playground. With a new generative model that runs on Private Cloud Compute, users can make images in virtually any style, including photorealistic, in…
- Create robust evaluations for agentic appsLearn how to leverage advanced features of the Evaluations framework to build robust evaluations for your app. Explore evaluating flows with tool calling and dynamic conditions, and how to define what correct…
- Debug and profile agentic app experiences with InstrumentsExplore the enhanced FoundationModels instrument in Xcode to inspect behavior and optimize the performance of agentic flows. Learn how to inspect prompts, analyze latency, and trace control flow in advanced…
- Design immersive environments for visionOS apps and the spatial webLearn how you can create photoreal visionOS environments for your apps, websites, and SharePlay experiences. Discover the design principles that make environments feel truly immersive and find out how you can…
- Discover new capabilities in the App Intents frameworkLevel up your App Intents adoption with advanced features to make it faster, more flexible, and more relevant. Find out how ValueRepresentation and RelevantEntities make your content more discoverable and…
- Dive into Core AI model authoring and optimizationDive into the complete custom model deployment workflow for Apple silicon with the new Core AI framework. Discover powerful techniques for authoring models using custom Metal kernels, alongside platform-aware…
- Explore advanced App Intents features for Siri and Apple IntelligencePolish how your app works with Siri using advanced App Intents APIs. Learn techniques that let people accomplish more with just their voice, help Apple Intelligence find your content, and provide context for…
- Explore distributed inference and training with MLXScale your machine learning workloads across multiple Macs using MLX. Learn how to tackle interconnect efficiency, large model inference, request batching, and distributed training challenges. Discover how a…
- Explore numerical computing in Swift with MLXBring NumPy-style computing natively to Swift with MLX Swift. Discover how to eliminate cross-language friction in your machine learning workflows by handling image processing, tensor operations, and neural…
- Improve your prompts by hill-climbing with EvaluationsLearn comparative evaluation techniques to guide your prompt engineering and select the right model for your app. Explore how to baseline performance, expand your evaluation strategy, and convert results to…
- Inside Apple Intelligence and Xcode: Special PresentationStep inside Steve Jobs Theater to discover the latest Apple Intelligence and Xcode advancements. Learn how to accelerate your development with new agentic coding workflows in Xcode 27, and discover how App…
- Integrate on-device AI models into your app using Core AIDiscover a curated collection of popular open-source models — including Qwen, Mistral, SAM3, and more — optimized for Apple silicon using the new Core AI Framework. Learn how to download, run, and benchmark…
- LLM search using Core SpotlightLevel up basic search into a retrieval-augmented system using SpotlightSearchTool and LanguageModelSession. Explore Core Spotlight integration, delegate-based hydration patterns, and how metadata quality…
- Machine Learning & AI Group LabJoin us online for a deep dive into WWDC26 with Apple engineers and designers to ask questions, get advice, and follow the discussion about the week's biggest machine learning and AI announcements. Conducted…
- Meet Core AIDiscover Core AI, Apple's new framework for on-device AI model deployment. Tour the ecosystem, from Python libraries for converting, authoring, and optimizing models, to a Swift API for simple plug-and-play…
- Meet the Evaluations frameworkLearn how to evaluate model-driven experiences using the Evaluations framework. In a probabilistic world, unit tests alone won't suffice. Discover how to define metrics, automatically grade outputs, and…
- Meet the Music Understanding frameworkDiscover Music Understanding, a new framework that lets your app analyze audio across six dimensions, on device: key, rhythm, structure, pace, instrument activity, and loudness. And use the Music Understanding…
- Optimize custom machine learning operations with Metal tensorsUnlock powerful machine learning performance with the Metal Tensor API and Metal Performance Primitives (MPP) Tensor Ops library. Discover how to create portable operations that take advantage of Neural…
- Run local agentic AI on the Mac using MLXRun AI agents locally with privacy, low latency, and offline access. Dive into how MLX advancements and Mac hardware make powerful agentic workflows possible entirely on-device. You'll explore code agents such…
- Secure your app: mitigate risks to agentic featuresExplore how to evaluate threats from indirect prompt injection, such as data exfiltration and unintended actions. Discover system safeguards and security best practices for using App Intents and the Foundation…
- Speedrun your game port with agentic codingKickstart your game's journey to Apple platforms with new agentic skills in Game Porting Toolkit 4 that can dramatically accelerate the process of porting your game. Explore how to work alongside your AI…
- Translate your app using agents in XcodeFind out how Xcode and coding agents help you translate String Catalogs using the context of your app. We'll walk through strategies for reviewing translated output and iterating on your localizations, so you…
- Validate your App Intents adoption with AppIntentsTestingMeet AppIntentsTesting, a new framework for validating your App Intents through the same infrastructure used by Siri, Shortcuts, and Spotlight. Discover how to execute intents, inspect results, and test…
- What’s new in ShortcutsExplore techniques to build powerful shortcuts using your app's content. New automations unlock additional ways to integrate your app with the system. Refine how your App Entity is presented to LLMs using the…
- What’s new in image understandingUnlock powerful image understanding with the latest Vision framework and Foundation Models framework updates. The new tap-to-segment request lets you segment images in new ways, and Vision now supports…
- What’s new in the Foundation Models frameworkExplore what's new in the Foundation Models framework. Learn how to access Private Cloud Compute, integrate third-party and open source models, and work with vision capabilities. Discover context management…
WWDC 2025
17 场 Session- Bring advanced speech-to-text to your app with SpeechAnalyzerDiscover the new SpeechAnalyzer API for speech to text. We'll learn about the Swift API and its capabilities, which power features in Notes, Voice Memos, Journal, and more. We'll dive into details about how…
- Code-along: Bring on-device AI to your app using the Foundation Models frameworkDevelop generative AI features for your SwiftUI apps using the Foundation Models framework. Get started by applying the basics of the framework to create an awesome feature. Watch step-by-step examples of how…
- Combine Metal 4 machine learning and graphicsLearn how to seamlessly combine machine learning into your graphics applications using Metal 4. We'll introduce the tensor resource and ML encoder for running models on the GPU timeline alongside your…
- Deep dive into the Foundation Models frameworkLevel up with the Foundation Models framework. Learn how guided generation works under the hood, and use guides, regexes, and generation schemas to get custom structured responses. We'll show you how to use…
- Design interactive snippetsSnippets are compact views invoked from App Intents that display information from your app. Now, snippets can allow your app to bring even more capability to Siri, Spotlight, and the Shortcuts app by including…
- Develop for Shortcuts and Spotlight with App IntentsLearn about how building App Intents that make actions available and work best with the new features in Shortcuts and Spotlight on Mac. We'll show you how your actions combine in powerful ways with the new…
- Discover machine learning & AI frameworks on Apple platformsTour the latest updates to machine learning and AI frameworks available on Apple platforms. Whether you are an app developer ready to tap into Apple Intelligence, an ML engineer optimizing models for on-device…
- Dive deeper into Writing ToolsWith Writing Tools, people can proofread, rewrite, and transform text directly within your app. Learn advanced techniques to customize Writing Tools for your app. Explore formatting options and how they work…
- Explore large language models on Apple silicon with MLXDiscover MLX LM – designed specifically to make working with large language models simple and efficient on Apple silicon. We'll cover how to fine-tune and run inference on state-of-the-art large language…
- Explore new advances in App IntentsExplore all the new enhancements available in the App Intents framework in this year's releases. Learn about developer quality-of-life improvements like deferred properties, new capabilities like interactive…
- Explore prompt design & safety for on-device foundation modelsDesign generative AI experiences that leverage the strengths of the Foundation Models framework. We'll start by showing how to design prompts for the on-device large language model at the core of Apple…
- Get started with MLX for Apple siliconMLX is a flexible and efficient array framework for numerical computing and machine learning on Apple silicon. We'll explore fundamental features including unified memory, lazy computation, and function…
- Get to know App IntentsLearn about the App Intents framework and its increasingly critical role within Apple's developer platforms. We'll take you through a ground-up introduction of the core concepts: intents, entities, queries…
- Meet the Foundation Models frameworkLearn how to tap into the on-device large language model behind Apple Intelligence! This high-level overview covers everything from guided generation for generating Swift data structures and streaming for…
- Optimize CPU performance with InstrumentsLearn how to optimize your app for Apple silicon with two new hardware-assisted tools in Instruments. We'll start by covering how to profile your app, then dive deeper by showing every single function called…
- Read documents using the Vision frameworkLearn about the latest advancements in the Vision framework. We'll introduce RecognizeDocumentsRequest, and how you can use it to read lines of text and group them into paragraphs, read tables, etc. And we'll…
- What’s new in BNNS GraphThe BNNS Graph Builder API now enables developers to write graphs of operations using the familiar Swift language to generate pre- and post-processing routines and small machine-learning models. BNNS compiles…
WWDC 2024
21 场 Session- Accelerate machine learning with MetalLearn how to accelerate your machine learning transformer models with new features in Metal Performance Shaders Graph. We'll also cover how to improve your model's compute bandwidth and quality, and visualize…
- Bring your app to SiriLearn how to use SiriKit and App Intents to expose your app's functionality to Siri and Apple Intelligence. Discover which intents are already available for your use, and how to adopt App Intent domains to…
- Bring your app’s core features to users with App IntentsLearn the principles of the App Intents framework, like intents, entities, and queries, and how you can harness them to expose your app's most important functionality right where people need it most. Find out…
- Bring your machine learning and AI models to Apple siliconLearn how to optimize your machine learning and AI models to leverage the power of Apple silicon. Review model conversion workflows to prepare your models for on-device deployment. Understand model compression…
- Build a great Lock Screen camera capture experienceFind out how the LockedCameraCapture API can help you bring your capture application's most useful information directly to the Lock Screen. Examine the API's features and functionality, learn how to get…
- Deploy machine learning and AI models on-device with Core MLLearn new ways to optimize speed and memory performance when you convert and run machine learning and AI models through Core ML. We'll cover new options for model representations, performance insights…
- Design App Intents for system experiencesApp Intents power system experiences in controls, Spotlight, Siri, and more. Find out how to identify the functionality that's best for App Intents, and how to use parameters to make these intents flexible…
- Discover Swift enhancements in the Vision frameworkThe Vision Framework API has been redesigned to leverage modern Swift features like concurrency, making it easier and faster to integrate a wide array of Vision algorithms into your app. We'll tour the updated…
- Explore machine learning on Apple platformsGet started with an overview of machine learning frameworks on Apple platforms. Whether you're implementing your first ML model, or an ML expert, we'll offer guidance to help you select the right framework for…
- Explore object tracking for visionOSFind out how you can use object tracking to turn real-world objects into virtual anchors in your visionOS app. Learn how you can build spatial experiences with object tracking from start to finish. Find out…
- Get started with Writing ToolsLearn how Writing Tools help users proofread, rewrite, and transform text in your app. Get the details on how Writing Tools interact with your app so users can refine what they have written in any text view…
- Introducing enterprise APIs for visionOSFind out how you can use new enterprise APIs for visionOS to create spatial experiences that enhance employee and customer productivity on Apple Vision Pro.
- Keep colors consistent across capturesMeet the Constant Color API and find out how it can help people use your app to determine precise colors. You'll learn how to adopt the API, explore its scientific and marketing potential, and discover best…
- Meet the Translation APIDiscover how you can translate text across different languages in your app using the new Translation framework. We'll show you how to quickly display translations in the system UI, and how to translate larger…
- Support real-time ML inference on the CPUDiscover how you can use BNNSGraph to accelerate the execution of your machine learning model on the CPU. We will show you how to use BNNSGraph to compile and execute a machine learning model on the CPU and…
- Support semantic search with Core SpotlightLearn how to provide semantic search results in your app using Core Spotlight. Understand how to make your app's content available in the user's private, on-device index so people can search for items using…
- Train your machine learning and AI models on Apple GPUsLearn how to train your models on Apple Silicon with Metal for PyTorch, JAX and TensorFlow. Take advantage of new attention operations and quantization support for improved transformer model performance on…
- Use HDR for dynamic image experiences in your appDiscover how to read and write HDR images and process HDR content in your app. Explore the new supported HDR image formats and advanced methods for displaying HDR images. Find out how HDR content can coexist…
- What’s new in App IntentsLearn about improvements and all-new features with App Intents, and discover how this framework can help you expose your app's functionality to Siri, Spotlight, Shortcuts, and more. We'll show you how to make…
- What’s new in Create MLExplore updates to Create ML, including interactive data source previews and a new template for building object tracking models for visionOS apps. We'll also cover important framework improvements, including…
- What’s new in DockKitDiscover how intelligent tracking in DockKit allows for smoother transitions between subjects. We will cover what intelligent tracking is, how it uses an ML model to select and track subjects, and how you can…