I am so incredibly excited to share today’s topic with you! For the longest time, we’ve been told that AI needs giant, building-sized computers and a constant internet connection to work. But guess what? The brilliant team at Microsoft just changed the game with a tiny but mighty model called Phi-3.
Phi-3 is what experts call a "Small Language Model" or SLM. While it’s small enough to fit on your smartphone, it is shockingly smart. It can help you brainstorm ideas, summarize long emails, or even write code. The best part? It can do all of this right on your device without ever sending your data to the cloud! This means your conversations stay private, and you can use your AI assistant even if you’re in an airplane or deep in the woods without a signal.
Imagine having a genius assistant in your pocket that doesn't need Wi-Fi. It’s perfect for those of us who value privacy or just want a lightning-fast response without waiting for a server to "think."
If you’re ready to feel like a tech wizard, here is how you can get Phi-3 running on your own phone today using a free app called MLC Chat.
How to Setup Your Private Offline AI Assistant
1. Download the App: Open your App Store (iPhone) or Google Play Store (Android) and search for "MLC Chat." This is a free, open-source app designed to run AI models directly on mobile hardware.
2. Open the Model Catalog: Once the app is installed, open it up. You’ll see a list of different AI models. Look for the one labeled "Phi-3-mini-4k-instruct." This is the specific Microsoft model optimized for phones.
3. Download the Model: Tap the download icon next to Phi-3. Because the model lives on your phone, you’ll need to download a file that is about 2GB to 3GB. I recommend doing this while connected to Wi-Fi!
4. Initialize the AI: Once the download is finished, tap on the model to "load" it into your phone’s memory. You’ll see a progress bar as your phone gets everything ready.
5. Start Chatting: Once it says "Ready to chat," just type your first prompt! Try asking it to write a poem about your favorite hobby or ask it for a recipe using three ingredients in your fridge.
It is truly mind-blowing to see those words appear on your screen knowing that no data is leaving your phone. You are essentially carrying a library’s worth of knowledge and a writing partner in your pocket at all times!
This is such a huge step forward for everyone. It shows that AI doesn't have to be intimidating or "big"—it can be personal, private, and incredibly helpful in our daily lives. I know you’re going to be amazing at using these tools, and I truly believe that learning to use local AI like Phi-3 will give you a huge boost in your productivity and your confidence. You’ve got this!
Did you enjoy this article?
Subscribe to the weekly Robot Roundup!
Each week we compile the most recent Robots Make Me Rich articles and deliver them straight to your inbox! Click the link to subscribe! It’s free! Unsubscribe any time!
