Multimodal Tool

The Speech to Text Tool

Convert an audio clip of speech into accurate, punctuated text so an agent can read what was said — on a model that can run inside your perimeter for sensitive recordings.

Explore VDF AI Agents
Any modalityText, speech, image, video
GovernedProcessed in your perimeter
AssignableTo any VDF AI agent
100%On-premise capable
The Locked-Media Problem

Most of your content isn’t text

Calls, recordings, scans, images, and foreign-language documents carry critical information that text-only agents simply can’t use. Turning that media into data usually means shipping sensitive content to a hosted API — exactly what regulated teams can’t do.

01

Media is opaque

Audio, video, and images are invisible to search and to agents.

02

Language barriers

Content in other languages stays out of reach.

03

Manual transcription

Transcribing and translating by hand is slow and costly.

04

Sensitive content

Calls and scans can’t be sent to a third-party service.

How the Tool Works

Speech to Text, without the risk

Capability

What it does

Transcribe speech into accurate text.

it transcribes spoken audio into accurate, punctuated text.

Tool
Speech to Text

Assignable to any agent

TranscribePunctuatedMulti-langOn-prem

How it works

Predictable, inspectable behavior

Designed to be reliable.

transcription can run on a local model inside your perimeter with language selection, so confidential audio becomes text without a hosted service.

Governed
Policy + Audit

Every call logged

ScopedLoggedGovernedOn-prem

Governance

Private, governed, on-premise

Runs inside your perimeter.

Transcription, translation, and analysis can run on local models inside your perimeter with audit logging, so sensitive audio, video, and documents become usable data without ever leaving your environment.

100%
On-Prem

Per-tenant, logged

On-premRBACAudit logSovereign
Inputs

Parameters

The speech_to_text tool accepts these inputs when an agent calls it. Required inputs are flagged.

Name Type Required Description
audio_base64 string Optional Base64-encoded audio.
audio_url string Optional URL of the audio (alternative to base64).
language string
default: auto
Optional Spoken language; auto-detected by default.
In depth

How the Speech to Text tool works in practice

Speech to Text is a multimodal tool you assign to a VDF AI agent. It transcribes spoken audio into accurate, punctuated text. Its hallmarks — Transcribe, Punctuated, Multi-lang — let an agent rely on it as a dependable step in a larger task rather than a brittle one-off script.

Under the hood, transcription can run on a local model inside your perimeter with language selection, so confidential audio becomes text without a hosted service. Every call is scoped to the requesting tenant and written to an audit log, so the capability is safe to run inside a regulated, on-premise environment — the same governance model behind every VDF AI tool.

Teams reach for Speech to Text when they need to handle voice notes, support calls, and accessibility. It rarely works alone — pair it with Audio Transcription, Text to Speech, and Translation to build a complete, governed workflow, then compose those steps into an on-premise VDF AI Network.

Where it pays back

Where Speech to Text pays back

Voice notes

Turn a dictated note into text.

Support calls

Transcribe a call for analysis.

Accessibility

Caption audio content.

Search

Make spoken content searchable.

How VDF AI connects it

Assigned to agents, orchestrated as networks

On VDF AI, an industry’s use cases map to agents, and you assign tools like this one to those agents. Compose multiple agents into a governed, on-premise network.

ROI Snapshot

What changes after you assign it

Unlocked
Media becomes searchable data
At-scale
Hours of media processed fast
Private
Sensitive media never leaves
100%
Runs on infrastructure you control
FAQ

Questions about the Speech to Text tool

What is the Speech to Text tool?

It transcribes spoken audio into accurate, punctuated text. Assigned to a VDF AI agent, it runs under role-based policy with full audit logging so the capability is safe to use in production.

Does it run on-premise?

Yes. A local model can transcribe inside your perimeter, so sensitive audio stays private.

How is it different from audio transcribe?

Speech-to-text targets shorter clips; audio transcribe is tuned for long recordings with structure like timestamps.

What inputs does the Speech to Text tool need?

It has no strictly required inputs, and optionally accepts audio_base64, audio_url, and language. Each parameter is validated when an agent calls the tool, and the full call is logged for audit.

Which tools pair well with Speech to Text?

Speech to Text is commonly assigned alongside Audio Transcription, Text to Speech, and Translation. On VDF AI you compose several tools and agents into a single governed, on-premise network.

Does it run on-premise?

Yes. Like every VDF AI tool, it can run on-premise or in your sovereign cloud, scoped per user and audit-logged, so your data never leaves your perimeter.

How do agents use it?

You assign the tool to an agent under a role-based policy; the agent calls it as one step in a task, and several agents and tools can be orchestrated together as a governed VDF AI Network.

Put Speech to Text to work

See the Speech to Text tool assigned to an agent and orchestrated in a governed, on-premise network.