Your smart speaker keeps a microphone pointed at your living room all day. That sounds unsettling, but it is how the device works: it listens for a wake word, and only after hearing it does your assistant record and send your request to the cloud. Here is what your assistant hears, what it saves, and how to take control of both.
How voice assistants actually work
Your assistant's microphone is always on, but the speaker's own processor is only scanning for a trigger phrase like "Hey Google," "Alexa," or "Siri." Nothing leaves your home until the wake word is detected.
Once it hears its name, the assistant records what you say and sends the audio to the company's servers, where the request is turned into text and answered. The recording can include a second or two before the wake word so the full sentence is captured. Because a wake word is just a sound pattern, a TV show or similar-sounding word can trigger a recording by accident.
What gets collected beyond the wake word
When your assistant springs into action, more than your sentence gets involved. Depending on the provider and permissions, your account can accumulate a voice profile, a history of requests, your location, and data from linked services like your calendar and contacts.
- Voice and audio recordings of the requests you make, which some providers keep on their servers.
- Voice profile built from your voice so the assistant can tell you apart from others.
- Location and history tied to your account, used to personalize answers and improve the service.
- Human review in some cases, where staff listen to small samples of audio to improve speech recognition.
Why the recording happens
The recording itself is not a secret. Understanding natural language is heavy work, so your voice has to travel to the cloud for the request to be understood. The real questions come after: is the audio saved, for how long, and who can listen to it?
Most providers let you review your assistant's history and delete recordings individually or all at once. Some let you set recordings to auto-delete after a period you choose. The recording is not permanent, but your default settings decide what happens to it, so checking them matters.
What to check in your settings
You do not need to dig through manuals. Your assistant's privacy settings are usually a few taps away in the app or account page. Look for these:
- Voice and audio activity: whether audio recordings are saved to your account at all.
- Saved recordings: the list of past requests you can review or delete.
- Review triggers: settings that allow human review of your audio, which you can usually opt out of.
- Auto-delete: an option to wipe old recordings after a set time instead of keeping them forever.
If your assistant is linked to your Google account, a Google account privacy checkup can surface most of these controls in one place. On a phone, your microphone permissions control which apps can listen.
How to limit what your assistant collects
If you want your assistant to collect less, you have real options.
- Use the mute switch. Most smart speakers have a physical button that cuts the microphone completely.
- Delete history in the app, or use a voice command to remove the last thing you asked.
- Turn off voice and audio activity so recordings are not stored to your account.
- Disable personalized features like your voice profile and personalized ads.
- Secure the account with a long password and two-factor authentication.
- Review connected accounts and use guest mode so other people cannot read your messages or buy things.
The trade-offs of each setting
Every privacy setting comes with a cost, and it helps to know the price before you flip the switch.
- Mute switch: complete silence when you need it, but no hands-free use until you turn it back on.
- Deleting history: less of your data on servers, but the assistant remembers fewer of your preferences.
- No voice profile: the speaker may not tell you apart from others in the house.
- Disabling personalization: the assistant still answers questions, but will not remind you of your calendar or read messages.
None of these choices are wrong. They match the convenience you want with the data you are willing to share.
How to decide if a voice assistant is right for you
Before you bring a smart speaker home, think about what you will use it for and what it will overhear. A speaker that only sets timers is a different risk than one near private conversations. Ask yourself whether the hands-free convenience is worth the recordings, and whether the people around you are comfortable with a microphone in the room.
If you already have a connected home, treat your smart home privacy as one system rather than a pile of gadgets. For many people, a voice assistant with a muted default, no saved audio, and personalization off is a reasonable middle ground. For others, the honest answer is that they do not need one.
FAQ
Is my smart speaker always recording? No. It is always listening for its wake word, but it does not record or send anything until that word is heard. Accidental triggers do happen, so it is worth reviewing your history.
Can I stop my voice assistant from saving recordings? Yes, in most cases. Turn off the voice and audio activity setting and your provider will stop storing audio to your account while still processing requests.
How do I delete recordings my assistant already saved? Open the assistant app or your account's activity page, find the history, and delete individual entries or the whole list. Some assistants let you delete by voice command.
Do employees listen to my recordings? Some providers have used human review to improve speech recognition. Check your settings for an opt-out, and read the privacy policy to see who can access your audio.
Sources and further reading
---Written by Hassan Arshad, founder of UsefulOrbit. Last updated August 31, 2026.