Transcript for:
Google's AI Innovations & Pixel Devices

please welcome Rick osto good morning good morning welcome to everyone joining us on YouTube from around the world and right here in Google's beautiful Bay View campus in Mountain View a few months ago at Google IO we shared a broad range of breakthroughs to make AI more helpful for everyone we're obsessed with the idea that AI can make life easier and more productive for people it can help us learn it can help us express ourselves and it can help us be more creative now the most important place to get this right is right in the devices we carry with us every day so we're going to share Google's progress in bringing Cutting Edge AI to Mobile in a way that benefits the entire Android ecosystem we're going to discuss specific AI inovation coming to Google's pixel portfolio and we're going to answer the biggest question people have about AI what can AI do for me so I understand people's skepticism there have been so many promises so many coming soon and not enough real world helpfulness when it comes to AI which is why today we're getting real we have lots of live demos of products features and AI experiences that are starting to ship with Android and our new pixel devices and Gemini is the key to it all we're fully in the Gemini ERA with AI infused into almost everything we're doing at Google across our full Tech stack our integrated AI strategy means we're in control of where we're heading and we're innovating at every layer of the stack and it's all to bring you the most helpful AI for 25 years we've invested in worldclass technical infrastructure this resulted in the development of our tensor processing units custom designed to deliver Gemini helpfulness to people all over the world you'll see lots of new AI experiences today that put those tpus to work for you our technical expertise also enables us to build our own mobile s so inhouse and work with silicon Partners to optimize their chips to run state-of-the-art on device AI this hybrid infrastructure is what lets us run Gemini models at scale in the cloud and efficiently right on your device these models are the result of years of research and one of the biggest science and engineering efforts we've ever undertaken as a company Gemini models include our latest Gemini 1.5 Pro developer preview model which is now number one on the lmis chatboard arena leaderboard and with our Advanced AI models running in the cloud on our worldclass infrastructure we're able to deliver help through our incredible apps and services like never before all six of our products with more than two billion monthly users are now using Gemini models to help you so you you can get information faster in search you can get more done in docs you can get help in Gmail writing an email and you can start a chat with Gemini directly from the Chrome address bar as we announced just last week there's some exciting new ways Gemini is making your home smarter safer and easier to manage now taken together Google spent years building the world's most advanced Tech stack in the cloud and at the same time we're bringing all that helpfulness closer to the user with a mobile compute Tex stack that you can hold in your hand now this comes to life as a global ecosystem of android devices that brings breakthrough mobile experiences to billions of people this device layer includes our own pixel devices and we'll have a lot to tell you today about our updated pixel portfolio this Android ecosystem even has its own custom AI model Gemini Nano is the most efficient model for powering on device experiences which you'll hear more about today we're reimagining the entire OS layer putting Gemini right at the core of Android the world's most popular OS you can see how we're innovating with AI at every layer of the tech stack from the infrastructure and the foundation models to the OS and devices and the apps and services you use every day it's a complete endtoend experience that only Google can deliver and I want to talk about the work we're doing to connect it all together with an integrated helpful AI assistant for everyone it changes how people interact with their mobile devices and we're building it right into Android for years we've been pursuing our vision of a mobile AI assistant that you can work with like you'd work with a real life personal assistant but we've been lied by the bounds of what existing Technologies could do so we've completely rebuilt the entire assistant experience around our Gemini models creating a novel kind of mobile Computing help for the Gemini era the new Gemini assistant can go beyond understanding your words to understanding your intent so you can communicate more naturally it can synthesize large amounts of information in seconds and Tackle complex tasks it can draft messages for you brainstorm with you and give you ideas on how you can improve your work with your permission it can offer unparalleled personalized help accessing relevant information across your Gmail inbox your Google calendar and more and it can reason across personal information and Google's World Knowledge to provide just the right help and insight you need and it's only possible through advances we've made in Gemini models over the last 6 months it's the biggest Leap Forward since we launched Google Assistant now we're going to keep building responsibly and pushing to make sure Gemini is available to everyone on every phone and of course this starts with Android so here's Samir to tell you more [Music] [Applause] [Music] hi everyone at Google IO we talked about a once in a generation opportunity to reimagine what phones can do and how we're rebuilding Android with AI at the core as Rick said Gemini is a key part of this Vision we want to bring all the improvements of an AI powered OS to everyone that's why Gemini is being built for Android scale it already supports 45 languages in more than than 200 countries and territories and we're continuing to add more it's available on hundreds of phone models from dozens of device makers and I'm not just talking about Flagship devices with the latest processors we brought Gemini to existing devices as well which means your Android phone keeps getting better over time with Gemini supported on billions of devices globally it's by far the world's most widely available AI assistant but what I'm really excited about is our collaboration with Partners to tailor the Gemini experience for their unique Hardware like foldables Motorola has already brought Gemini to the external display of the Razer plus it's great when you want a quick summary of your recent emails but don't want to open your phone and get distracted by all the other notifications and with the Samsung Galaxy zold 6 you can use Gemini in split view to take advantage of the big immersive display for multitasking that helps you get more done and this isn't some future State on Android Gemini is available around the world right now far beyond English speakers and a single Market but beyond scale in order for Gemini to be your go-to trusted assistant for your most important tasks it's critical that your personal information is protected and private with your permission a truly capable AI assistant can help connect your relevant personal data with all the valuable knowledge that Google has organized and made accessible like create a daily workout routine based on my personal trainer's email or use my resume in Google Drive to write a new bio for work or even based on my friend's dietary restrictions listed in keep can we go out to eat seafood paa as Rick said earlier this is where our Decades of investment in AI and Google's full text stack make Gemini really special Gemini can handle these kinds of complex personal queries within Google's own secure cloud and for some of the most sensitive use cases like summarizing audio from a phone call or suggesting a helpful reply to an encrypted text message we've pioneered on device generative AI with Gemini Nano it's the first time a large multimodal AI model has been optimized for a mobile device so the data never leaves your phone with Gemini deeply integrated with Android we're well on our way to rebuilding the OS with AI at the core the new Gemini assistant brings the benefits of AI to billions around the world while helping keep your personal information secure and private Android is truly leading the way toward AI for everyone but now the fun part we're going to show you how the latest Gemini experiences on Android can help you be more productive creative and expressive here's Jenny to tell you more there are so many different ways that people around the world are already using Gemini to make everyday tasks easier people love the new Gemini assistant because it can help them do so much more from writing to br brainstorming to working through a tough problem even taking action using their favorite Google Apps and Gemini is getting a lot of love from students and teachers who are using it to make learning more fun and interactive working on the eighth draft of your essay ask Gemini to critique your argument so you can focus on the right areas to improve having a hard time with a math concept ask Gemini to walk you through the problem step by step learning about photosynthesis ask Gemini to explain it in ways a gamer will understand and we're just getting started constantly working to make Gemini even better Jess and Dave are going to take us through some of the new ways people can use Gemini on [Applause] Android thanks Jenny Gemini is multimodal which means it can go beyond text to images and videos and if you choose to use workspace extensions in Gemini it can now connect to even more of the apps you rely on like calendar tasks and keep let me show you how it works on this Samsung Galaxy s24 Ultra all of the demos we're doing today are live by the way so if I happen to come across this concert poster for Sabrina Carpenter I'll just open Gemini take a photo and ask check my calendar and see if I'm free when she's coming to San Francisco this year Gemini pulls relevant content from the image connects with my calendar and gives me the information I'm looking for oh looks like we had a little demo issue let me try one more time all right check my calendar and see if I'm free when she's coming to San Francisco this year let's see if the demo Spirits are with us today nope uhoh looks like uh looks like they're not with us all right let me let me uh let me uh try that one more time on another device sorry about this folks oops let me go back all right I'm going to take that photo one more time check my calendar and see if I'm free when she's coming to San Francisco this year all right there we go all right thank you demo spirits and now I'll ask Gemini to set a reminder at to check ticket prices tonight at 7 that's if she's free I mean sorry if if they haven't sold out already uh Gemini connects to my tax app and just like that the reminder is set oh and in honor of song of the summer add espresso to my shopping list Gemini knows my personal context coordinates for me across my apps and takes action better than ever and just like that my Google keep shopping list is up to [Applause] date Gemini can also understand what I show it on my screen like this video I'm watching on my motor roll razor plus I'm checking out this Korean food Vlog from one of my favorite YouTube creators to get ready for a trip to Soul this fall as I'm wrapping up the video I'll bring up Gemini like this press here and say create a list of the foods she eats in this video so here Gemini is connecting with YouTube to find relevant information from the video's captions and look just like that I have a scavenger hunt to make sure I can reference these later I'll add these foods to a new things to try and create list Korean sweet potatoes and strawberry milk if you know you know and there we go now I'll know just what to taste and of course every great adventure needs a great soundtrack so I'll ask Gemini to create One For Me Maybe create a playlist of K-pop music that would be great for walking around Soul Gemini can understand all the ways you may ask for a song or playlist so you can just describe the vibe you're going for the same way you talk to a friend no more having to remember precise titles or lyrics and there it created a playlist that I can play now or save for later we've all had those moment moments where you need to write something on your phone or get a head start on a draft Gemini really shines in those situations for example write a formal email to my landlord Teresa that my AC unit is broken make it sound urgent but still polite all right I'm excited to see what Gemini comes up with and here we go dear Teresa I hope this email finds you well I'm writing to report a serious issue all right uh this is a great first pass let's try another one draft a note to Professor Gelman I missed class because I was sick and request a few more days to work on my project what would normally take me minutes Gemini does in seconds all right let's take a look Dear Professor Gman I hope this email finds you well I'm writing to inform you that I was unfortunately absent from your class as you see gem does a great job drafting emails for me so I don't have to start from a blank page and it's so easy to move move these drafts to Gmail so I can then polish up and send Gemini is the perfect writing companion for moments like these and now back to you Jenny thanks Jess and Dave all of these are really great examples of how Gemini can help in your everyday life simply prompt Gemini with a task or a question and it will provide instant help but we believe a truly helpful personal AI assistant must do more more it needs to be able to communicate with you conversationally because sometimes conversation is the best way to work through something complex like exploring a concept by talking it through or tossing ideas back and forth to help you brainstorm or even acting as your anytime practice partner to help you prepare for an important conversation or an interview that's why I'm so excited about Gemini live the most natural way to interact with Gemini now you can have a free flowing conversation with Gemini you can interrupt when you think of something important or change topics as the conversation flows Gemini will be right there with you let me show you how it works and just like the demos that you just saw with Jess and Dave this is a totally live demo all right when I first go live with Gemini there will be 10 different voices for me to choose from let's meet a few great let's get going here's one of the voices I have but there's more to choose from swipe to give them a listen or just tap start to get chatting all right it's nice but I want to hear a couple more here's another voice I can use you can pick me now and always make a change later in settings I'm looking forward to discussing with you the world's most profound questions like why is pickle ball so popular that is profound uh let's let's try one more or maybe you'd like to listen to a voice like this a pretty great one if I do say so myself but don't worry there are more to explore all right let's go with this one for now so I'm going to start chatting you can always change my voice in settings later okay I'm here whenever you're ready hi Gemini how are you doing hi there I'm doing well thanks for asking it's always nice to hear from someone how can I help you today well my niece and nephew are coming over this weekend and I need a few ideas for something fun and educational we could do together uh I was thinking maybe something with chemistry something that's like a little bit magical that sounds like a fantastic idea how about doing a classic science experiment like making a homemade volcano it's super easy and there's a real sense of excitement when it erupts wait I can find a few other ideas too do you want to hear about them now I totally do and think magical all right let's brainstorm how about invisible ink you can write secret messages that only appear when you heat them up with a hairdyer or here's another one try making some homemade lava lamps with oil water and food coloring it looks super cool and trippy so what do you think those are cool I'm thinking the lava lamps actually let's do the invisible ink and like is there a way to like take it up a level sure we could try making the invisible ink change colors when it's heated up imagine writing a secret message that goes from clear to bright pink that'd be pretty cool right or maybe instead of using a haird dryer to reveal the message we could try making a special solution that makes it Glow under a black light oo I love the black light that's super cool um okay is this going to be messy at all or not so much the invisible ink itself isn't too messy but you'll probably need a few bowls or trays to mix everything the black light part shouldn't get messy either but you might want to cover your work area just in case okay that seems cool so one last question for you help me come up with some creative name ideas for this experiment absolutely how about spy training academy or maybe the secret message lab cool I love it all right thanks for your help Gemini this experience is so cool I love talking to Gemini in a free flowing conversation that can go in any direction Gemini live is available first in English to Gemini Advanced subscribers and everything we just showed you including live is beginning to roll out today and over the next few weeks on on Pixel Samsung and other Android phones I can't wait for you to try it across all these demos you can see how Gemini on Android helps you by pulling together real knowledge about the world with your own information and the apps and services that you use every day and this is only the beginning Gemini will keep getting better as we work to make the Gemini assistant even more capable and helpful let's take another look you got all the focus confence sttion in that moment you me at H how can I embarrass my sister during a wedding toast but like respectfully okay here's the [Music] deal yeah [Music] hi everyone we've got some fantastic new devices to show you today in fact it's the biggest update we've ever made to the pixel family pixel is our platform for showcasing the very best of Google AI all the Gemini helpfulness you've seen so far is built right into pixel and we're going even further with pixel 9 the first phone designed for the Gemini era the full stack that Rick walked you through comes to life in pixel in ways that are simple and helpful you've got tensor our Custom Design silicon that's specially tuned for our AI models and you've got our latest on device model Gemini Nano with multimodality thanks to this powerful on device infrastructure nearly every experience across the phone is powered by AI including unique features we've developed just for Pixel today we're going to show you new ways that on device AI is improving your phone calls new Gemini powered features to help you be more organized or be more creative and of course new pixel camera features that help you get the perfect photo or video but let's start with pixel 9's New Look our biggest pixel design progression in years we have four new phones including the gorgeous new pixel 9 and the reimagined pixel 9 Pro fold and we've heard from Pixel users that just just because they want a pro phone doesn't necessarily mean they want a big phone so for the first time you can choose between pixel 9 pro and pixel9 pro XL without [Applause] compromises they have the same incredible display Sleek design premium craftsmanship processing power and the same Pro pixel camera all of our new pixel 9 phones feature a completely re-engineered sculpted design that's not only stun to look at but optimized for feel in hand compactness and durability thanks to the luxurious metal frame with its seamless rounded corners and the scratch resistant flat Gorilla Glass victus 2 the pixel 9 phones are twice as durable as the previous generation to withstand the inevitable accidental drops pixel 9 has an even brighter actual display and the Pro Models use our super actual displays both are the best and brightest displays in their class classes underneath that bright display there's a new ultrasonic sensor for fingerprint unlock that's now 50% faster and as we always do we've developed a diverse collection of striking Colors Let's Take a look at the magic inside of our pixel 9 phones across the full lineup they have some serious horsepower with Hardware that's designed and tuned right here at Google to get the most out of our Gemini models the new Google Google tensor G4 chip our fourth generation processor is our fastest and most efficient yet it's designed to improve Everyday Use cases so web browsing streaming on YouTube taking a photo and shooting a video are smoother with less of a hit to your battery we custom developed tensor G4 working hand inhand with Google Deep Mind so the industry's top AI research team is collaborating directly on the Silicon for Pixel and optimizing it for Google's latest Advanced models including our latest on device model pixel 9 is the first phone to launch with Gemini Nano with multimodality the most capable on device AI model ever shipped on a phone in fact it's three times more capable and sophisticated than the Gemini Nano model we shipped just 9 months ago on Pixel 8 Pro and even with this increase in size and complexity the TPU intenser G4 can generate an industry-leading mobile output rate of up to 45 tokens per second that's more than double pixel8 Peak rate with Gemini Nano we've also upgraded the memory across the entire pixel 9 family with 12 GB of RAM for Pixel 9 and the Pro Models come with 16 GB put simply tensor Gemini Nano and your phone's memory work together so generative AI on Pixel is faster and more intelligent and your phone will be able to keep up with future AI advances too and amazingly we've packed in all this AI goodness while improving thermals and battery performance we're introducing a new Vapor chamber in pixel 9 Pro a more advanced cooling technology to make sure your phone can maintain Peak Performance even when it's working hard for you and thanks to optimizations across tensor Ai and software pixel 99's phone pixel9 phones deliver significantly more battery life than last year's devices the entire line of pixel 99's are ALS the first Android phones to include our new satellite SOS so you can contact emergency responders and share your location even without cellular service it's the kind of feature we hope you never need but it lets you go off the grid with the assurance that the grid is there if you need it satellite SOS will be available first in the US on Pixel 9 devices regardless of your carrier plan now all those pixel enhancements are also coming to our most forward-looking most versatile phone pix 9 profold it's the Pinnacle of mobile Computing so let's check it out it's noticeably thinner and lighter than our first gen foldable when it's folded it has the same size display as pixel9 Pro and comparable thickness too it feels and functions like a phone then you unfold it and pixel9 pro fold becomes something else all together an 8 in tablet with a big and bright super actual Flex display it's the largest display on a phone and it's 80% brighter than the first generation this big screen gives you so much more surface area for entertainment productivity multitasking and content Creation with pixel9 Pro fold you're getting the Best of Both Worlds an 8in tablet for Power users that turns into a phone you can fit in your pocket or purse and you're getting the same tensor G4 and 16 GB of RAM to power great new features that are just for foldables the big beautiful phone screen pairs with NFL Sunday Ticket from YouTube TV check out the cool multiview experience and with split screen you can multitask across different apps at the same time while you're watching the game open up messages to talk some trash in the group chat and wait till you see what the camera can do we'll get there in a few minutes the new pixel 9 phones are the only smartphones in the world built specifically to connect you to Google's AI models both in the data center and directly on your device nearly every experience is enhanced by Gemini Android tensor and the Google services you use every day so let's get to some demos here's Alex to show you what pixel 9 can [Music] [Applause] do good morning pixel has always been about unlocking the full potential of Google AI to help you find what you're looking for to get more done and to be more creative the pixel9 lineup is no different they're shipping with the new Gemini assistant and by combining tensor G4 on your device with tpus in the cloud pixel 9 phones introduce a unique set of helpful AI features that are only available on Pixel I've got a lot to show you today so let's get into it one of the most common things we do on our phone is check the weather for a lot of us it's the first thing we look up in the morning so we're using AI to make that experience much more helpful and delightful with the new pixel weather app let's use it to get a live look at the weather here in Mountain View you can see the app is beautifully designed with super accurate weather forecasts and Gemini Nano generates a custom AI weather report so you don't have to scroll through a bunch of numbers to get a sense of the day's weather and you can even customize the app based on what you want to see maybe you're keeping an eye on the UV index to see if you need to put on sunscreen you can just drag and drop it nice and easy the new pixel weather app is shipping on all of our new pixel 9 phones Google AI on Pixel 9 isn't just helping you get ready for the day it's helping you throughout the day too for years pixel Callis has been blocking spam callers helping you navigate phone trees predicting the whole time for you and a personal favorite even waiting on hold for you no other phone handles all those headaches and now pixel call assis gets even better with call notes which follows up on your phone calls with a completely private summary of the conversation so when you're on a call and you don't have a pen and paper handy you still have easy access to phone numbers times details and any other info you don't want to forget here's an example I'm thinking of switching up my hair and going with a broccoli cut it's trendy I know but I think I could pull it off now my barber can't so he referred me to a new barber shop and the problem is I forgot to jot down the number thankfully I have call notes let me show you how this works I can easily locate the phone number to make an appointment and if I need to I can also review the full transcript of the original call like how much did that cut cost call notes is completely private and it runs entirely on device so your phone calls and summaries are never sent to the cloud it's easy to activate it which notifies everyone on the call and then your pixel will start transcribing and summarizing couldn't be easier and you're in control of how and when you use it now you'd expect your phone to be good at phone calls and telling you the weather we're also using Google AI to deliver some new kinds of help as well here's a scenario we're all familiar with you come across something on your phone you want to remember so maybe you make a mental note or maybe a grab a screenshot but more often than that you forget the thing you wanted remember or you can't quickly find what you need when you need it the new pixel screenshots can help with that it's an app for Pixel 9 that helps you save organize and recall anything you need pixel screenshots is like your own visual library of everything you want to remember items in a recipe Wi-Fi or door codes restaurant recommendations or anything else okay so if you're like me you're always coming across cool stuff online that would make great gifts but then when it comes time to buy the gift I can't remember the ideas or where I saw them like I just got this text from my fiance Christine she's really excited about Kiki Palmer's new book so I'll just click the link and instead of leaving this tab open till the end of time why don't I screenshot it pixel screenshots analyzes the content of the image and makes it searchable and it's all running privately on device thanks to Gemini Nano and tensor G4 let's see I'll quickly add this to my collection of gift ideas and make a note that Christine likes this and if I want to look through all the other gift ideas I've saved I can open up the pixel screenshots app and I'll just navigate to that collection here I can see Kiki's book along with lots of other great gift ideas I've saved now the thing is I don't just screenshot gift ideas for other people I also screenshot things that I want for example I was looking to buy a new bike this summer and I took dozens of screenshots so I could compare them I can just tap the search bar to search my screenshots and why don't I look for bikes in this case do you see how fast that is tensor G4 was designed for Gemini Nano with multimodality so it's fast I was also looking at some shoes why don't I find those and I can find them instantly and because pixel screenshots is designed to extract the information within an image I can also type in more complex queries like t-shirt price and here you can see pixel screenshots didn't just find the original image but it also provided me with an answer in natural language based on the information in the image in pixel screenshots can even remember where I grabbed each screenshot so I could tap to go back to where I found them and buy that shirt the best thing about pixel screenshots is I don't have to do anything differently I just keep screenshotting anything I want to remember pixel screenshots is shipping with all of our new pixel9 devices and we're also working on some new ways to be Al Alex Alex oh wow it's Kiki Palmer I love the demo but let me save you some trouble give your fiance my new book master of me out this November pre-orders available now and whatever you do don't get the broccoli cut now that's two favorite she owes me to all of you at home I hope you'll join me for the first made by Google Afterparty on YouTube no guess list no wristbands it's a VIP after party where everybody's invited it starts right after this I'll see you there oh wow thank you Kiki and Christine if you're watching I think think we just got our first wedding gift okay back to AI on Pixel we've got another first to show you every pixel 9 phone ships with the new pixel Studio a first ofit kind image generator it's powered by an on device diffusion model running on tensor G4 and our imagine 3 text to image model in the cloud so you can just type whatever you want to create perfect example a funky party in invite our coworker Tes he's moving back to San Francisco and finally getting his own place nothing says welcome back to California like a party at the fire pits at Ocean Beach watch how easy it is to whip up an invite I'll make one live right now so I'll just tap create and I'll start with a simple prompt let's go with uh Beach bonfire pit at Sunset and we've made Pixel Studio fast there's not much waiting here as you can see okay now that looks pretty good let's make it quintessential San Francisco why don't we add in the Golden Gate Bridge so let's see what pixel Studio comes up with nice I do want this to feel like a party and pixel Studio lets me get creative so why don't we add some fireworks in the sky see what that looks like really nice I do want this to feel more like an invite though instead of a photo if I tap the style button I can quickly change how the image looks why don't we try a cartoon and it'll take just a moment just like changing your prompt would okay changing your style as you can see it's quick it's easy and honestly it's pretty fun in this case though it's not what I'm going for so why don't we try another style like a retro video game and see what that looks like okay really cool and if I want to change the composition I don't need to change my prompt I can just hit the refresh button to get a new image nice that looks so good okay now in pixel Studio you can also create stickers from your images and I already have a few of tagis so I'll just throw them right in there there we go I think a giant Tes head that looks like a firework kind of hilarious uh I got a few more why don't we throw in a tagis near the bonfire but he looks a little lonely at his own part no worries I have a secondes I can throw in right next to him to keep him company fantastic the only thing missing are the party details so I can quickly add a caption that says Ocean Beach Friday let's go with 7 p.m. that font feels a bit out of place so we can easily change it why don't we go take a look I think this one looks retro and it'll match The Vibes pretty well nice cool now it took me just a moment to create the perfect invite I'll just copy and paste it into that group chat I've got with all of our friends and send it oh and by the way with RCS coming to the iPhone all my friends will get the same highquality image no matter what phone they're [Applause] using okay that's a lot of new AI helpfulness the allnew pixel weather app call notes pixel screenshots and pixel Studio they're all shipping with our new pixel9 phones I'm so excited for you to try them and I'm also excited to hand the stage over to Shaz and Kenny to take you through the magical new camera capabilities in pixel 9 the awardwinning pixel camera is the world's first AI powered camera experience and Google continues to be the only mobile phone maker that builds the entire camera end to end so it can deliver new pixel exclusive features that have never been possible before with pixel 9 upgrades across that entire system come together to make every photo stunning and to solve everyday camera challenges for you so now it's easier than ever to frame up a beautiful scene capture it with Incredible image quality and edit it to look just the way you want let's start with image quality this year we've rebuilt our signature HDR plus pipeline from the ground up taking what we've learned from real tone and over 9 years of building an amazing pixel camera so your photos and videos authentically reflect the world around you the way you see it with your own eyes take this image for example we've made improvements across exposure exposure sharpness detail contrast tone mapping and white balance and the difference is remarkable with more accurate skin tones texture shadows and even better night sight for Exquisite lowlight shots and we're bringing that same HDR plus pipeline to Panorama panoramas are a staple in Mobile photography but they haven't really evolved in years we've rebuilt pixel 99's panorama mode starting with the UI which now intuitively guides your hand once you've captured the full scene pixel runs the photos through the full image processing pipeline for gorgeous incredibly detailed panoramas and by the way the image processing includes nightset pixel was the first phone with nightset for your photos the first to use it for video and now pixel is the first phone to use it for brilliant low light panoramas the the quality is actually pretty wild uh check out this Panorama of the Tetons and now check it out at night and now check it out compared to another smartphone camera look at the detail sharpness and color it's amazing in allinone sick Panorama photo that goes all the way up to 50 megapixels of resolution and you're something we've all struggled with getting that perfect group photo we made group photos a lot better last year with best Ste which makes sure everyone looks their best but one of the biggest problems with group photos is how to include the entire group sometimes you end up taking a photo that you also want to be in the new ad me fixes that so you can be included in your family vacation photo or that once in a lifetime photo with your favorite athlete we'll show you how it works with the pixel 9 Pro and with a pixel user who's a six time NBA Allstar Jimmy Butler [Applause] [Music] oh no thank you for joining us on stage and helping us demo add me uh would you mind if you take a picture with you of course anything for you and and and don't box me out I won't I promise let's step over let's step over here Kenny if you can take a picture please of course can you all see let's see make me look good Kenny yeah all right there we go so I'm gonna pop over to that add me mode I'm going to frame up the shots make sure I include a little room on the right here for myself and boom now Shan this is Jimmy buckets please I need add a little meat in the picture let's get Kenny in the picture let's go as you can see the overlay the augmented reality overlay is guiding me and now I can take a photo and now if you both come over here you will see that it is going to be processed in one single shot all right right you look great by the way oh thank you thanks for that to this Kenny so do of course you do honestly thanks for being such a good sport and we'd love to see more of you here in the Golden State if you know what I mean all right all right think that's my cue yeah you're not going to get me in trouble I see what you're doing okay no thank you one more hook of course of course the boy thank you man seriously thank you thank you Jimmy thank you very much so as you just saw you don't need to hand your phone to a random bystander try to get too close to each other and scrunch your arms or you know just be left out of the photo entirely anymore all thanks to adme adme is available at launch on all of our pixel 9 phones and now let me show you what we are doing with the pixel 99 Pro fold to solve another tricky challenge in photography getting a fussy toddler to look at the camera and smile the new made you look is here to help just turn it on and pick one of the fun colorful visuals at your outer screen each with its own personality and sounds to get your child's attention on the camera made you look gets your baby smiling so you can capture a happy memory and that elusive perfect baby photo and if anyone can make your baby smile is Joy from Disney and Pixar's Inside Out she's coming to made you look in an upcoming pixel feature drop I really wish my parents had this when I was a child I wouldn't be that grumpy honestly me too it's it's pretty good pixel9 Pro fold includes lots of other foldable camera features too you get dual screen preview which lets both you and your subject see how the shots going to turn out and rear camera selfies so every shot you take is taken with the best camera on your phone this year we've also added Pro controls with professional camera features like shutter speed manual focus and more when you match these experiences with the amazing image quality from pixel camera pixel 9 Pro fold is the best camera available in a foldable form factor we're also improving the accessibility of pixel camera across the entire pixel 9 family with guided frame people who have blindness or low vision can take great photos and selfies guided frame now offers even better face angle guidance and lets you know when you might need to improve your lighting and it's now easier to enable right from the camera settings now pixel camera isn't just about taking gorgeous photos and videos it also helps you with everything that happens after you've got the photo helping you perfect your image and make it look just how you want it to look we started this journey three years ago with magic eraser and we're continuing it today with the evolved magic editor experience using generative AI let me open up my pixel9 Pro fold and show you how it works oh thank you shananas let's open up this bad boy all right so this is a good image but it's kind of slanted it could have been so much better if only I had a bit more time to frame my subject this is where autof frame and Magic editor comes in it uses generative AI to recompose my image applying photographic techniques like rule of thirds and golden ratios okay so right now it's filling in the blanks and finding the perfect crop to reframe my subject and wow that is awesome let's go with this one this looks awesome and if you notice it even recovered the piece of his shoe that got left out of the first photo pretty great so I chose this one by clicking that check mark and now just like that I have an amazing stunning landscape shot but we're not done yet let's say we wanted to reimagine this photo entirely I can just tap on the grass here and type what I want to see what do you what do you think she know uh how about wild flowers okay I like where your head is at add some color to this photo so I'll just type in Wildflower and again remember this is a live demo of generative AI we're all going to see these results the same time together they're going to be great I promise oh definitely and is still cooking those well oh yeah I know what you're thinking Chaz these are our colors I know I know yeah let's do it I am a yellow guy you know all right so I'm going to this one's awesome I'm going to hit that check mark again and now we're kind of cooking right the scene's looking great we fixed it earlier but we need something else what do you think Sean something fun yeah hot a balloon what I love that idea let's do it all right so there's a few ways I can select what I want to edit I can tap on an entire area like the sky or I can zoom in for really precise edits awesome and now let's type in hot air balloon and there we go let's see what magic editor comes back with so right now Gemini models are taking the prompt I just typed in and expanding it to include additional details in information based on the scene and wow well that's a little abstract there it is generative AI but I love this one this is my favorite so let's do that and again just to show you the before and after amazing it's never been easier to edit your images just describe what you want and see your ideas come to life the evolved magic editor is available right out of the box on all the new pixel 9 phones all of our pixel 99's also continue to push into new terrain for smartphone video pixels video continues to make big leaps forward thanks to a computational video technology called dual exposure in simple terms it takes two exposures at the same time one optimized for shadows and another optimized for highlights and combines them to use the best of both in real time so you get sharper less grainy videos even in challenging low light scenarios is the kind of computational videography you can get from a pixel that isn't even available on many modern slrs and mirrorless cameras and this year we're continuing to raise the Baseline video quality across the entire pixel9 family at the same time we're adding new capabilities to video boost for our pixel9 Pro phones it sets a new bar for mobile video by combining tensor and the camera Hardware on the device with our full HDR plus pipeline in the cloud we've improved nights side video so your low light videos are even more natural brighter and more detailed and we're moving video boost to tensor processing units in the cloud so when you enable video boost it will now render your videos up to twice as fast when we combine video boost with the brand new 5x telephoto camera in pixel 9 Pro you can now shoot super high resolution Zoom videos up to 20x that can sound a bit abstract so let me put it this way you can crop in 5x 10x all the way up to 20x without sacrificing any quality in fact it has 8 HDR plus across the zoom range and this is on every single video frame It's pretty dope I can't lie it's pretty good you know we were at outside Lance Festival last Friday and we got an amazing performance by Renee rap when we apply video boost look at the detail and the lighting and now we'll just zoom back to where we were actually standing in it's pretty magical and check this out we're also using generative Ai and video boost tpus to upscale your videos to 8K resolution even though you're shooting 4K video the quality and resolution are so high you can even pull high quality 33 megapix steel photos from any frame this is huge for creators and streamers since now you're able get high quality thumbnail stills from any moment in your YouTube videos all [Applause] [Music] that all that to say pixel is once again rated the best smartphone for photography and today we're excited to announce that pixel 9 Pro with video boost has also been rated the smartphone with the highest quality video pixel 9 pixel9 Pro and pixel 9 Pro fold take smartphone photography and video to completely new heights just like every pixel before them now let's welcome Brian back to the [Music] stage with an incredible range of pixel exclusive features and a bold and beautiful new look you're going to love the new lineup of pixel devices we've got pixel 99 the powerfully sophisticated Google phone with an unbelievable upgraded camera supercharge performance and the latest AI features like the new Gemini assistant adme pixel screenshots pixel studio and so much more pixel9 starts at $799 pixel9 Pro adds prole performance and speed with 16 GB of RAM meticulously crafted materials and finishes the brilliant super actual display and the pr grade camera with the best video quality on a smartphone pixel9 Pro comes in two sizes starting at $9.99 and finally the reimagined pixel9 pro fold it's thinner and lighter with the largest display on a phone and Innovative features that you can only get on a foldable phone pixel9 Pro fold starts at $17.99 the entire pixel 9 family is available for pre-order today in the US Japan and Europe pix 9 and pixel 9 Pro XL will begin shipping on August 22nd with the rest of the phones starting to ship in September and we want to make sure our most powerful phones have access to the latest and greatest Gemini models and app features so all three Pro phones come with one year of Gemini Advanced and two terabytes of cloud storage it turns pixel 9 Pro into a true generative AI Powerhouse that's Miles Ahead of any other phone on the market and of course pixel 9 is going to keep getting better over time with a steady stream of new features with pixel drops in seven years of os and security updates it's a different kind of phone that could only be made by Google we hope you love [Music] [Applause] [Music] [Applause] [Music] it pixel watch has come so far in just two generations it's now being worn by millions of people and they tell us they love the special place it plays in improving their lives with pixel watch 3 we are bringing our best lineup yet it delivers our gorgeous iconic design for the first time ever in two sizes we are introducing an all new 45 mm size that's perfect for people who want more from their watch it gives you 40% more display and a 35% bigger battery you also get our custom designed durable 3D coverglass and our brand new actra display it's our most advanced and power efficient display with up to 2,000 knits of brightness it's twice as bright as before and it flexes all the way down to one knit in a dark room the smaller 41 mm uses the same exro technology giving you 10% more display in the same compact size pixel watch 3 is also our deepest integration with Google and pixel yet your watch can now live stream your nest camera and doorbell control your pixel phone's camera and act as your Google TV Remote you can use Google Maps even when offline and take notes with the recorder app and pixel call assist continues to get better with the new hold a minute it answers for you and lets you hold the call while you find a quiet place to talk it's an incredibly helpful Smartwatch but it's so much more than that with fitbit's fitness and health tracking built right in pixel watch 3 is equally an advanced personal health and fitness device this year we are introducing our most comprehensive Fitness experience yet including a whole host of features to help Runners like me a great running companion shouldn't just track my runs it should help me plan my workout guide me through it and help me reflect on my progress the new workout Builder helps me run with the game plan every day I can build custom workouts add intervals set targets to them build Tempo runs and with Fitbit premium Google Air does the leg work for me by automatically building these workouts personalized just for me and during my run I get real time guidance letting me know when my warm-up is over or when it's time for my next interval or when I'm behind Pace I need to pick it up and across everything you do with your pixel watch 3 you're getting highly accurate heart rate tracking with continuous sampling not just during workouts but all day and all night and now we have taken it a notch further by tuning pixel watch 3's heart rate tracking specifically for running it's one of the toughest environments for heart rate sensing your heart rate can change rapidly during the run while your ground contact and arve movement introduces motion and light artifacts pixel watch 3 accounts for exactly these challenges to deliver our most accurate hard track rate tracking for running pixel watchh 3 even helps you improve your running form using Advanced motion to track your run Dynamics like step Cadence or vertical oscillation even stride length for instance last month on my longer distance runs my Cadence dropped and my strides were dragging longer as a lost team Fitbit sensed it and shared that Insight with me and by correcting my form I was able to lower the potential risk of injury and also improve my pace and distance now Fitness isn't just about going all out on workouts it's also about balancing that intensity with my body's need for Recovery to help find that balance we're introducing three new tools first an all new Readiness score it combines sleep heart rate variability resting heart rate to give me a holistic picture of how ready I am to train second a new metric called cardiolo it tracks my heart's exertion during workouts and helps me understand if I'm overtraining or under trining and third a personalized daily target load that combines the Readiness and cardiol load metrics to gu guide me how much intensity to take on each day and all these insights come together in the new Fitbit morning brief along with weather my sleep insights and how I'm tracking against my weekly exercise goals and these are delivered automatically to my pixel watch 3 each morning and it's awesome for someone like me who wakes up 6 morning to go for a run or more like five now that I'm a parent and you know for those mornings when running is not really my jam Fitbit premium provides daily picks from a library of video workouts now with Incredible workout classes from Paton now along with helping with your workouts and with your recovery there's another special role that a watch can play with the power of realtime sensing it can be a powerful health and safety guardian and prompt life-saving action when every second counts like a car crash or a bad fall today I'm excited to share a pioneering Innovation a first ofit kind capability called loss of pulse detection take a look I think the average person does doesn't think about their pulse it's something that we take for granted the phrase loss of pulse is one that many people may not have heard of but a loss of pulse event could really happen to anyone loss of pulse is a health emergency when the heart is not beating in a life- sustaining fashion we have all of this infrastructure in place to get people help as quickly as possible but it's all predicated on theide idea that someone will be there to make a call to Emergency Medical Services on your behalf but we know that more than half the time people experience these events with no one around and they are virtually unsurvivable if you don't have someone to help so we've built a loss of pulse detection feature for the pixel watch that is the first of its kind it can detect if some someone has lost their pulse is nonresponsive and can make a call to Emergency Medical Services where key information is provided like the location of where the user is so they can get help as quickly as possible a loss of pulse event is really a Time critical emergency the feature is specifically looking for a pulse but also looking at physiological and motion data and then tying these together in a really smart algorithm driven by AI that lives completely on the watch when a loss of pulse event occurs every minute that we can save increases the odds of survival we hope this can be an airbag moment or smoke detector moment something that can become standard to help keep us safe when life may bring the [Music] unexpected it is incredibly gratifying to be able to work on something this ambitious that can help people in the most critical moments loss of fulse detection is the kind of innovation that's only possible with continuous highly accurate sensing and we are hopeful that it can have a meaningful impact on people's lives it's available on Pixel watch 3 starting in select EU countries and the UK with more regions to come so we've got a breakthrough new safety feature comprehensive Fitness and Health tracking from Fitbit Google AI the full Vos 5 experience and a whole bunch of helpful Google Integrations it's all coming together on the new pixel watch 3 starting at 349 for the 41 mm and 399 for the all new 45 mm all right I'm equally thrilled to share our final product today the new pixel buds Pro 2 our first generation pixel buds Pro have been widely popular they're still some of the best reviewed premium year buds in the world pixel buds Pro 2 improves on them in every way they're the ultimate Fusion of design performance intelligence created specifically to be the first year buds of the Gemini era of course that starts by delivering what you'd expect from premium earbuds premium sound pixelbuds pro2 accomplished the difficult feed of improving audio processing and improving active noise cancellation and doing it in a power efficient way to get there we have made a multi-year investment and designed our very own chip the new Google tensor A1 tensor A1 brings ultra low latency audio processing adapting to your sound environment up to 3 million times per second and the result is active noise cancellation that is two times as strong as a previous generation earbuds perfect for enjoying some silence in a busy Cafe open plan office noisy airplane and we can think about that Silence has a blank canvas you can fill with accurate highly detailed immersive music and to give you that best quality we have delivered we reengineered the entire audio subsystem and combined it with tensor a1's multipath processing so basically your music now has a dedicated Highway Lane on the processor completely independent of the continuous process needed for thec that's quite rare even in premium earbuds and it means you're getting exceptional music listening experience right out of the box and tensor isn't just improving ANC and giving you great music quality it helps you listen longer pixelbuds pro2 delivers significantly longer battery life even with two times stronger ANC and even though they are smaller than our first generation in fact they're the smallest premium earbuds on the market they're lighter too the lightest noise cancelling earbuds in the category pixelbuds Pro 2 are designed to be the most comfortable and secure fitting earbuds in consumer research twice as many users preferred the comfort of pixel buds Pro 2 over the leading premium year buds but usually there's a compromise to be made between comfort and secure fit to solve this we developed the new twist to adjust stabilizer just twist to make them more secure during a workout or relax with them around the house that same consumer study found pixelbuds Pro 2 to be twice as secure in year so you're getting awesome sound quality powerful noise cancellation long battery life in a super comfortable design on their own pixel buds Pro 2 are the most premium earbuds we have ever made but pixel birds are also the first here birds with Gemini for Something Completely new an eyes free handsfree audio interface to Gemini with the power of Gemini extensions you can access your email ask for walking directions create a YouTube music playlist for your workout and so much more and there are times when I might want to talk things out or have a longer conversation with Gemini live on my pixel Birds Pro 2 I'll now now have a totally new way to interact with an AI assistant let's demo it together so here I have my brand new pixelbuds Pro 2 and normally this experience is private audio in my ear but we are going to let you hear both sides of the conversation and remember this is a live demo so let's see what Gemini says all right here we go I will tap and hold on my pixel buds Pro 2 and say let's talk live hey Gemini I'm I'm on stage right now finishing up a presentation in front of really important audience how can I take in this moment sounds like you're in the zone it sounds like a really big deal maybe try focusing on your breath slow deep breaths in through your nose and out through your mouth notice how it feels to fill your lungs and then let it all go wow that was great uh quite a unique experience and while I was doing that I spotted someone in the audience I really admire how do I break the ice without being awkward that's a natural reaction after a big moment like that since you already know this person a little bit maybe try to focus on something specific you admire about them what is it about them that makes you look up to them I think I know that so I will go ahead and do right that thanks emini hey folks we have Mark Rober Among Us here mark huge fan not just me my kids as well we have watched your Porche pirate video and zipline probably a million times uh so thanks for inspiring us and thanks for being here with us Mark having a real conversation like this with Gemini on my earbuds is a totally different experience I find myself asking different types of questions using it to get ideas and inspiration instead of quick answers and the full transcripts are saved on my phone in case I want to refer back to them later all this even works with phone in your pocket just keep an ear bird in your ear and Gemini will know that it's you pixel Birds Pro two are the perfect companion to your pixel phone with premium sound quality powerful ANC amazing battery life incredible comfort and fit and the helpfulness of gini everywhere you go pixel buds Pro two are 229 and we are so excited excited for you to try them our new Buds and the pixel watch 3 are available for pre-order today and here's Rick again to close us out okay thanks so much for joining us today years of foundational work are coming together right now to drive new innovation new research and new AI experiences AC across Google's full Tex stack we're using Google AI to transform the user experience from the devices to the OS and the apps and services you use every day the Gemini era is real and to prove it everything we've shown you is launching in the next few weeks we have a lot more coming too in the next few months so let me give you a quick look into where our AI research and Innovation is leading us at IO a few months ago we shared an early look at project Astra a Google Deep Mind research prototype that represents our vision of the future of AI assistants it explores just how helpful an assistant can be when it understands the context you're in and responds naturally one of the first Places You'll see project Aster come to life will be right in Gemini live where you'll be able to share your camera during a conversation with Gemini so you can show Gemini exactly where you're stuck in your calculus homework ask for help with the next step of your furniture assembly or brainstorm ideas for getting the neighbors together when inspiration strikes or in this case just drives up and we're bringing your most useful apps into Gemini live too so it can help you take action during your conversations and messages and pull information from apps like Google Calendar so right from Gemini live you can text the details about this business to your neighbor and cross check your calendar all without opening another app now we can't wait to bring these capabilities to live for everyone so stay tuned and our vision for the assistant doesn't stop there we're evolving Gemini to be even more agentive to tackle complex problems with Advanced reasoning planning and memory so you'll be able to think multiple steps ahead and Gemini will get things done on your behalf under your supervision that's the promise of a true AI assistant now we've all been there staring down a daunting research task or faced with an important decision where you just don't know where to start soon Gemini will be able to assist you as your researcher saving you tons of time by using information from across the web to create a research report that's tailored to your exact questions what used to take you hours now takes minutes so you could ask help me research grad school scholarship programs for undergrads interested in public service or here's another example where you might need in-depth information to make a big decision and you don't know where to start I'm thinking of opening a Sidewalk Cafe in Seattle help me resarch what I need to do so Gemini understands you're looking for in-depth research it starts by creating a multi-step research plan for you to approve and then it curates information from across the web using multimodal reasoning and even navigating subpages and drop down menus to gather the most hardto find details as it works Gemini is constantly refining its analysis in a continuous reasoning Loop and identifying which information will be most helpful for you and this is the coolest part it then synthesizes all that information into a well organized research report in a Google doc in this case Gemini looked into permitting for Seattle and King County and regulations for outdoor seating it even includes links to original sources so you can dig in further Gemini's new research capability is a big step forward in our mission to to organize the world's information and make it universally accessible and useful all while connecting you to the creators businesses and organizations that can help you get things done and this isn't a far-off vision at all this feature will launch to Gemini Advanced users in the coming months I'm so excited about the future we're working toward but today has been all about what ready now so those of you here in Mountain View will be able to try these new features today for yourself and for those who aren't here we'd love to see you at one of our Google stores including the new store in Boston and the Chicago and Santa Monica stores that are opening in the next few months and Folks at home you're invited to our first ever made by Google after party hosted by Kiki Palmer and streaming right now on YouTube we've got exclusive inters a few special guests and you can watch me dance with fire on hot ones so we hope to see you there we're so excited for this Gemini era and what it means to our entire mobile ecosystem and to people all around the world so thank you very much for joining us today [Music] do do do do like this [Music] [Applause] [Music] [Music] do do it like [Music] this do do it like this heyy hey hey hey hey hey hey hey hey hey hey hey hey hey heyyy hey hey [Applause] [Music]