

You already have the perfect tool in your pocket. But our thought is, can we use our iPhone or iPad and step in as a coach? We already have it with us, even when we go to the gym, but we want to use the camera and the sensors to actually, instead of us looking and observing what's on the device, have it observe what we are doing and give us some real-time feedback.


What do I mean by that? We already see that at plenty of sporting events, we have people using their phones to record and film it. The theme that we would like to set for today is that we use the phone as an observer and give feedback to our users. My name is Frank Doepke, and together with my colleague, Brent Dimick, we're going to explore the Action and Vision Application. Have a question? Ask with tag wwdc20-10099.Building a Feature-Rich App for Sports Analysis.By bringing Create ML, Core ML, and Vision API together, there's almost no end to the magic you can bring to your app. Whether you are building a fitness coaching app, or exploring new ways of interacting, consider the incredible features that you can build by combining machine learning with the rich set of computer vision features. To learn more, we recommend watching “Build an Action Classifier with Create ML,” “Explore Computer Vision APIs,” and “Detect Body and Hand Pose with Vision.” We also recommend exploring the Action & Vision sample project to learn more about adopting these technologies. To get the most out of this session, you should have familiarity with the Vision framework and Create ML's Action Classifier tools.
IN VISION APP FOR MAC FULL
And follow along in Xcode with a full sample project. Explore how you can create an immersive application for gameplay or training from setup to analysis and feedback. Learn how we designed the Action & Vision app using Object Detection and Action Classification in Create ML along with the new Body Pose Estimation, Trajectory Detection, and Contour Detection features in the Vision framework. It's now easy to create an app for fitness or sports coaching that takes advantage of machine learning - and to prove it, we built our own.
