WWDC 2020, Day 4

One more day the number of sessions is overwhelming. There are so many that it’s hard to choose one. The sessions I have chosen to pay attention to on this third day of conference fall under the categories of The game developer’s toolkit, Augment Reality, What’s new in Machine Learning and Computer Vision or Swift Playgrounds “Swan’s Quest”.

Remember that all session videos are at https://developer.apple.com/videos/wwdc2020/

Bring keyboard and mouse gaming to iPad

This session is part of the collection The game developer’s toolkit.

Level up your iPad games and add in keyboard, mouse, and trackpad controls. Discover how to use the Game Controller framework to augment your existing titles, bring over games from other platforms, or dream up entirely new interaction experiences. Learn how to integrate keyboard and “delta” mouse coordinate events for player motion, and disable pointer system gestures like the Dock or Control Center to take full advantage of full screen gameplay.

Links
Bring keyboard and mouse gaming to iPad session video
Game Controller Documentation

Support performance-intensive apps and games

This session is part of the collection The game developer’s toolkit.

iOS and iPadOS provide powerful capabilities to help developers deliver breakthrough apps and games across all device generations. In certain instances, however, demanding apps with exceptional performance requirements may only be able to provide the best experience on devices with an A12 Bionic chip or higher. With Xcode 12, developers can now enable a setting for performance-intensive apps and games to indicate this requirement. We’ll walk you through the narrow circumstances for when to apply this setting and the app distribution trade-offs that must be carefully considered. Before selecting this approach, you should have deep experience in optimizing your apps.

Links
Support performance-intensive apps and games session video

What’s new in USD

This session is part of the collection Augment reality.

Discover proposed schema and structure updates to the Universal Scene Description (USD) standard. Learn how you can use Reality Composer to build AR content with interactive properties like anchoring, physics, behaviors, 3D text, and spatial audio that exports to USDZ. And, discover streamlined workflows that help you bring newly-created objects into your app. If you’re interested to learn more about USDZ as a distribution format, check out “Working with USD” And for more on creating AR content with Reality Composer, watch “The Artist’s AR Toolkit”

Links
What’s new in USD session video
Working with USD WWDC19 session
Reality Composer
Reality Composer App
Article: Creating 3D Content with Reality Composer
RealityKit Documentation
Download Reality Converter beta
AR Quick Look: View example 3D models using USDZ

Explore the Action & Vision app

It’s now easy to create an app for fitness or sports coaching that takes advantage of machine learning — and to prove it, we built our own. Learn how we designed the Action & Vision app using Object Detection and Action Classification in Create ML along with the new Body Pose Estimation, Trajectory Detection, and Contour Detection features in the Vision framework. Explore how you can create an immersive application for gameplay or training from setup to analysis and feedback. And follow along in Xcode with a full sample project. To get the most out of this session, you should have familiarity with the Vision framework and Create ML’s Action Classifier tools. To learn more, we recommend watching “Build an Action Classifier with Create ML”, “Explore Computer Vision APIs”, and “Detect Body and Hand Pose with Vision”. We also recommend exploring the Action & Vision sample project to learn more about adopting these technologies.

Links
Explore the Action & Vision app session video
Sample Code: Building a Feature-Rich App for Sports Analysis
Sample video for Action & Vision app
Create ML Documentation
Vision Documentation

Swan’s Quest, Chapter 3: The notable scroll

Swift Playgrounds presents “Swan’s Quest,” an interactive adventure in four chapters for all ages. Calling all musicians! In this chapter, our Hero has found a mysterious scroll of music, and only you can help decode it. (Don’t worry if you can’t read music, our clever Lizard is standing by to assist. It’s sure to be a note-worthy experience.) By learning a little theory, and mastering time to create tones of different lengths, you just might help our Hero face the music… and move onto the next part of their quest. Swan’s Quest was created for Swift Playgrounds on iPad and Mac, combining frameworks and resources which power the educational experiences in many of our playgrounds, including Sonic Workshop, Sensor Arcade, and Augmented Reality. To learn more about building your own playgrounds, be sure to watch “Create Swift Playgrounds content for iPad and Mac”.

Links
Swan’s Quest, Chapter 3: The notable scroll session video
Quest Create playground book
Swan’s Quest: The notable scroll playground book

Create Swift Playgrounds content for iPad and Mac

Learn how to create Swift Playgrounds books that work fluidly across both Mac and iPad and help people of all ages explore the fun of coding in Swift. We’ll walk you through how to customize content for each platform while considering platform settings, and help you take advantage of them in your playgrounds while still providing a smooth cross-platform experience. For more on Swift Playgrounds, check out “Build a SwiftUI view in Swift Playgrounds”.

Links
Create Swift Playgrounds content for iPad and Mac session video
Sample Code: Exploring Content Creation in Swift Playgrounds

What’s new in Core NFC

Core NFC helps you scan and write to NFC tags in your apps, helping people get more from objects like parking meters, scooter rentals, car charging stations, and more. Learn about Core NFC’s support for the ISO15693 protocol and new tag capabilities, and find out more about syntax improvements for Swift.

What’s new in Core NFC session video
Sample Code: Creating NFC Tags from Your iPhone
Core NFC Enhancements WWDC19 Session

Here’s a short video recap of the day.