Envisioning the Apple Car, using the current Apple ecosystem as a guide

My Role

MR Interaction Designer - Feature Scoping,
Research, Interaction Design,
Visual Design, Prototyping.


November - December

(5 weeks).


ArtCenter College
of Design, CA.


How might we solve current pain points in the mobility experience with Apple’s ecosystem?


Think Different

“Live Different”

A new era for Apple

Every Apple product launch has redefined consumer goods.The release of the VisionPro will do the same by going beyond screens to incorporate our physical reality through spatial computing, with this prediction in mind we approached Apple's first vehicle, which is being developed under Project Titan.

For this 5 week project, as part of the Automotive UI course, we envisioned what features this game-changing car could bring in line with Apple's ecosystem. The result is a story-driven interface, highlighting the vehicle's potential for a frictionless, inclusive, and empowering future.

Final designs

Seamless Transition into Car

Feature 1

Once inside a verified car, personal devices will automatically connect to the car and transfer ongoing activities, such as multimedia content, calls, and Facetime.

Frunk Delivery

Feature 2

Users can use the map app to order and receive deliveries directly to their car, even if they are not in the vehicle

Passenger ID

Feature 3

Apple cars will have MagSafe docks available for each seat in the car .Each users' preferred settings, linked to their device, will be saved

MR Collaborative Working

Feature 5

Users can share MR screens by either 1) dragging and throwing a screen with a gesture or 2) using the share button to select the person(s) to share with.

MR content is set to private mode by default, so only the user can see it. When switching to public mode, other MR users in the car can also see the windows.


The goal: explore possible interfaces of a car that could be realized in the near future.

Focus on: EVs as the current forefront of automotive technology, pushing the boundaries of in-car experiences, and supplemented it with deep research into Apple’s ecosystem.

EV User Research

EV users are early adopters, actively exploring the potential of their rides—before, during, and after the vehicle's operation.

I search in the phone maps app at home and then in the car screen again when I get to the car.

I rarely use my car’s mobile app to control my car other than checking battery range. It’s too much trouble.

Even though my Nio has a big center screen, sometimes I still use my phone for navigation and messaging because it’s easier and quicker.

I feel like an EV is indeed the worst investment because I don’t use it for the majority of time in a day and it depreciates quickly in value

I love my car, but I sometimes take the metro or ride-share just so I can read and answer emails while commuting

After interviewing 8 EV drivers their needs were clear:

  • Users expect a smoother experience transitioning in & out of their vehicle.

  • Users want their commute time to be more productive, given that it’s safe.

  • Users expect more out of an EV.

EV Brands Competitor Research

To understand the current paradigm of the EV market, we conducted first-hand research on 13 EV cars.

After experiencing firsthand what is out there in the industry, we concluded:

  • Connecting personal devices to cars is not always seamless

  • Autonomous driving enables a lot of possibilities for the in-car experience.

  • When the car is turned off, there is no use for it.

Brand Research on Apple Ecosystem

Apple’s vision is committed to bringing the best user experience to its customers through innovative design, superior ease-of-use and seamless integration.

Their robust ecosystem acts as a powerful tool to retain users from end to end.

Apple cars will tightly tie together all parts of their ecosystem.

We decided to pursue these focus areas:

Pain PointsOpportunities

Where some see problems, we saw opportunities.

Smart Transition

The smart transition from personal devices into car is ineffective

  • We understand nowadays the experience of a car is not only in the actual vehicle but the first and last mile.

  • Apple will utilize their frictionless ecosystem to improve the experience by understanding that a journey goes beyond the actual vehicle.

Productivity hub

Commute time is unproductive + no privacy in the car

  • Apple users already use their products for work and productivity.

  • Spatial computing plus autonomous driving will enable the car as a new productivity hub.

Power off

Car when turned off is really off

  • Steve Jobs was a huge advocate of eliminating the off button in all of the devices, because their power shouldn't be shut off, unlike when you turn off a car.

  • Using this modus operandi, we see the power the vehicle will have, enabling new features and possibilities when it is not in the streets.


We created some “How Might We” exercises to start looking for the specific functions and scenarios to address.

How might we use the power of Apple’s ecosystem to generate the ultimate journey experience?

Expand the use of CarPlay, given the native hardware

Expand the use of the Frunk and Trunk

Replaceable and upgradable center IVI (maybe it is an iPad)

The same Apple Care experience for the Apple car

Car connects to all other Apple devices (blue bubbles but car is connected also)

Integration with Vision Pro / MR for L3 Autonomous

How might we support drivers who want to feel independent and take maximize their time and journeys?

Allow driver to choose the level of autonomy or assistance they want

Enable “customized mode” setting

In-car 3D avatar with AI assistance, which the driver could interact with both in and out of the car.

CarOS enabled to install more apps, such as productivity software to work in-vehicle ( brainstorming, design, editing...) with audio + gesture + eye input

Handoff of media from device to car.

Learn about driver's behavior to predict and provide assistant

How might we inspire passengers to feel connected even when in someone else's car?

Apple wallet has "Car profile" for each person, tracked when they move between cars, environments, and devices

Enable activities that everyone can participate in together.

Allow passengers to face each other. Turning all the seats toward center (like in a train)

Make the car a family hub

Remember each person's preferences (seat, climate, music)

Mic & speaker for each seat, so everyone can talk & hear without shouting

Functions we decided to pursue:

  • Seamless transition from personal devices to car

  • Apple ID that allows carrying pre-set customizations into every apple car

  • Delivery to frunk

  • Integration with Apple Vision Pro for L3 autonomous driving

  • Privacy mode with directional speakers and microphone

Setting the base

We set these North Star design principles as the guide from which to execute our solution.

Ease of use





Apple connectivity is not only between the users devices, but also between multiple users. With this in mind, we developed a main persona and secondary ones that build a more robust interconnected journey map

Crafting and Prototyping

We did a rapid session of sketching to focus on testing and iterating low-fidelity prototypes with potential users to guide our final designs.

Transition into car

Scenario 1

Allows users to customize the apps and information they want to share with another car.

Manually adding apps each time creates too much friction.

Take over request during self-driving

Scenario 2

Multi-modal feedback could quickly alarm drivers.

AR messages could block the view of the driver.

Think of how the level of feedback can align with the level of emergency of the request.

Environmental Preset

Scenario 3

Allows users to customize environmental presets for different activities on an intuitive interface

Some of the modes should come with a preset to allow a quick kickstart.

Buttons and text are too small for users to interact with in a moving vehicle.

Private & Public Audio

Scenario 4

Protects privacy for in-car calls so nobody else can listen.

The private chat function might turn people away from each other.

Frunk Delivery

Scenario 5

“Deliver to Car” takes advantage of a parked car so people can securely receive delivery when not there.

“Meet Halfway” function could cause more hassles than it solves due to unpredicted real-time traffic condition.

Extra attention needs to be put into safety of personal belongings in frunk.

Mixed Reality Collaborative Working

Scenario 6

“Public/Private” and “Share” features make it easier to both collaborate and work separately.

Intuitive gesture interaction.

Current collaborative working feature is limited.

Typing in Mixed Reality

Scenario 7

Intuitive gesture interaction.

People’s legs offer tactile feedback while typing.

Uneven surface.

MagSafe Connection

Scenario 8

MagSafe provides an easy way for new/existing users to connect personal devices to the car.

Risk of devices falling off if the MagSafe connection is not strong enough.

Design System

Want to know more? Lets chat!



© All Rights Reserved.

Last Updated by Mario on 02/05/2024

Made with love from sunny Los Angeles