Our next public workshop, AI Tool Mastery for Work Productivity, starts on Tuesday, 24 November 2026 (Kota Kinabalu, Sabah). Click to view and register.
    Starts In
    Back to blog
    AI News

    A Tiny New AI Voice Model Can Now Run Fully Offline For Free

    By Edison Chua 8 November 2026 5 min read

    A startup squeezed a working speech AI into 32 megabytes that runs offline, no cloud bill required.

    A Tiny New AI Voice Model Can Now Run Fully Offline For Free

    Image: TechCrunch

    Quick Summary

    • Underdog's Woof model is about 32 megabytes with 31 million parameters and runs without an internet connection.
    • Underdog's Bark model is 167 megabytes and turns speech into text for dictation and meeting notes on edge devices.
    • Founder Sigil Wen says fully capable AI models could run on everyday devices within months.
    • On-device models keep audio and text on the user's own machine instead of sending it to a cloud server.

    A startup called Underdog released Woof, a free AI voice model that is only about 32 megabytes and runs entirely on a laptop or phone, no internet connection or monthly subscription needed. It also recently launched Bark, a 167 megabyte model that turns speech into text for dictation and meeting notes.

    What did Underdog release?

    Underdog is a small AI startup building tools that run locally instead of inside a big company's cloud. On 6 November 2026, founder Sigil Wen demoed Woof inside a retro styled browser game: type on an onscreen typewriter and the model reads the text back aloud, or turn a tuner knob and it generates a short piece of music. The game itself was just a showcase. The real point was proving that a usable voice model can now fit in about 32 megabytes, small enough to sit inside a web page instead of a data centre full of servers.

    I think we will be able to run most capable models of today on the devices you already own within months.from Sigil Wen, Founder, Underdog (TechCrunch, 6 November 2026)

    What can these tiny AI models actually do?

    Underdog has released two models so far, each built to do one job well on ordinary hardware rather than one giant model that tries to do everything in the cloud.

    • Woof turns text into natural sounding speech. It has 31 million parameters, weighs about 32 megabytes, and the company says it runs on most devices without needing an internet connection.
    • Bark turns speech into text for transcription and dictation. At 167 megabytes, it is built to run on edge devices rather than a remote server.
    • A separate 27 billion parameter model from Underdog can still run on an ordinary laptop, far below what most cloud based AI tools require.
    • A waitlisted app positions itself as a privately hosted alternative to bigger cloud assistants such as Muse and Instinct.

    How could your business use a model like this?

    Most AI tools your team already uses send every word and every recording to a company's servers, then bill you per minute or per token used. A model that runs on the device itself works differently, and that difference has real uses for a small business. A clinic could dictate patient notes without that audio ever leaving the room. An accounting firm could transcribe a client call on a laptop during a power or internet outage, something that still happens often enough in parts of Sabah. A retailer could keep a running voice log of stock counts with no monthly API bill at all. None of this needs a data centre. It just needs the laptop or phone already on the desk.

    Also today

    • Meta now lets every US user hold a live video call with its Muse AI avatar, nicknamed Jolly, on mobile, web and Mac (TechCrunch)
    • AWS launched agentic Kiro bots that keep their own memory and can stay on a recurring coding job over multiple sessions (VentureBeat)
    • OpenAI reportedly raised another 11 billion dollars at a 1.25 trillion dollar valuation as investor interest in AI keeps climbing (TechCrunch)

    What should you try this week?

    You do not need new hardware to test this idea. Pick one task your business already repeats, such as dictating meeting notes, logging stock counts by voice, or summarising a client call, and try doing it with a tool that keeps the recording on your own device instead of a server you do not control. If your team wants a structured way to work out which AI tools actually fit daily tasks like this, our AI Tool Mastery for Work Productivity workshop in Kota Kinabalu covers practical, safe ways to bring tools like these into HR, finance and admin work without the guesswork.

    Common Questions

    What is Underdog's Woof AI model?
    Woof is a text-to-speech model from the startup Underdog. It has 31 million parameters and is about 32 megabytes, small enough that it can run inside a browser on most laptops or phones without needing an internet connection or a monthly subscription.
    Can a small business actually use an on-device AI model today?
    Yes, for narrow jobs. Woof is open for anyone to download, and Underdog's related Bark model handles speech-to-text transcription on edge devices. Both are early and English-focused, so treat them as a trial for dictation and note-taking, not a full replacement for your main AI tools yet.
    Is on-device AI safer for business data than cloud AI tools?
    It can be. When a model runs on the device itself, the audio or text never has to leave that machine to reach a server. For sensitive material such as client calls or patient notes, that is a real privacy advantage over tools that upload everything to the cloud by default.

    Source: TechCrunch

    Share
    Edison Chua

    Written by

    Edison Chua

    HRD Corp certified AI trainer and founder of NextGen Training Academy, Kota Kinabalu. Trains Malaysian businesses to put AI to work - hands-on, in plain language.

    Want To Put This To Work In Your Business?

    That's exactly what we teach, hands-on and HRDC-claimable.

    View Programs