Copilot Gaming Experiences is an experimental, AI-powered gaming experience that brings cutting-edge research to life within Copilot Labs. Built on the innovative World and Human Action Model (WHAM) technology from Microsoft Research, it dynamically generates game visuals and responds to player inputs in real time, simulating interactive gameplay without relying on traditional game engines.
Features
AI-Powered Gameplay
Dynamically generates gameplay sequences inspired by classic games like Quake II, using AI to simulate interactive gameplay in real time.
Real-Time Response
Offers real-time interaction where player inputs trigger AI-generated moments, creating an immersive and responsive gaming experience.
WHAM Technology
Leverages the World and Human Action Model (WHAM), a generative AI model from Microsoft Research, to create dynamic game visuals and simulate player behavior.
Copilot Vision
Allows you to see and browse the world with an AI companion, providing advice and insights on what you're viewing.
Copilot Podcasts
Creates personalized podcasts tailored to your curiosity and interests.
Copilot Actions
Uses conversational prompts to perform web tasks such as reservations and travel bookings, available soon.
Screen and Camera Analysis
Copilot Vision can view your screen or mobile camera feed to provide real-time insights and suggestions by analyzing the visual data.
Voice Interaction
Allows users to interact with Copilot Vision by voice, enabling hands-free assistance and insights as you navigate or view content.
Privacy-Centric Design
Ensures that user images, voice audio, and context are not logged or stored, maintaining user privacy while using the feature.
Cross-Platform Accessibility
Available on Edge browser, iOS, Android, and Windows, allowing seamless experience across different devices.
AI-Generated Gameplay
Generates gameplay sequences in real time inspired by classic games like Quake II, creating a unique experience without traditional game engine reliance.
Dynamic Visuals
Creates immersive visuals dynamically, powered by the World and Human Action Model (WHAM), to enhance the gaming experience.
Responsive Player Interaction
Responds to player inputs in real time to simulate interactive gameplay, allowing for a new kind of gaming interaction.
AI-generated podcasts
Request AI-generated podcasts by simply messaging Copilot. It uses curated web content to create podcasts on topics of your choice, offering a personalized learning experience.
Unlimited pre-generated podcasts
Listen to an unlimited number of pre-generated podcasts on various topics available on the platform.
Mobile access
Access Copilot Podcasts via mobile apps or through copilot.microsoft.com, ensuring you can enjoy content on-the-go.
Push notifications for new podcasts
Receive push notifications to alert you when your requested podcast is ready, making it easy to catch up on content.
Comprehensive Answers
Provides detailed and real-time insights by considering all angles of tough questions, ensuring answers are not just useful but thorough.
Conversational Prompts
Allows users to use conversational prompts to complete web tasks like reservations and bookings, enhancing functionality and convenience.
Personalized Podcasts
Delivers personalized podcasts based on the user's curiosity and interests, providing a tailored audio experience.
Vision Browsing
Enables users to see and browse the world with AI assistance, offering advice and insights on what they see.