Skip to content
ONDI

← All terms

AI terms

On-device AI (AI that runs on your own device)

Japanese オンデバイスAI(端末の中で動くAI)

On-device AI is AI that runs inside your own phone or computer instead of on a faraway server. Your data stays on the device, which protects privacy and lets it work without an internet connection.

On-device AI means the AI does its work inside your own phone or computer instead of handing it to a company server far away (the cloud). It is like cooking in your own kitchen rather than ordering delivery: the ingredients (your data) never leave the house, and you do not have to wait for the courier. Google's Android developer documentation explains that running AI on the device keeps sensitive data on the device to protect privacy, works without an internet connection, and lowers the cost of running the model. Apple likewise keeps a model that runs on the device and a larger model that runs on its servers.

Watch out Models that fit inside a device are small, so they are weaker than cloud AI, and their speed depends on the device. Some features process part of the job on the device and send the rest to a server, so when you handle customer data, check in the settings how much really stays on the device. Some features, such as those on Windows Copilot+ PCs, only turn on when the computer has a dedicated AI chip (NPU).

Source: Gemini Nano | AI | Android Developers · Introducing Apple's On-Device and Server Foundation Models · Apple Intelligence and Siri - Apple · Copilot+ PCs developer guide | Microsoft Learn (checked 2026-10-28)

See also

A typo here, a clumsy button there.

This site is still being polished. Spot something? Tell us — we’ll fix it and send a small thank-you gift.

🎁 Thank-you gift