SoniXense — Beyond Vision

02 — The perception gap

Machines can scale perception.Human attention cannot.

Machine capacity expands

SensorsImagingTrackingAISimulationRoboticsData

Perceptual interfaceVisionAttentionWorking memoryCognitionDecision

One human decision-maker

As automation grows, this gap becomes more critical.

Decision is still human.

03 — SoniXense Technology

From complex machine information
to perceptually organized sound.

SoniXense transforms complex, multimodal system data into high-level insights through intuitive auditory cues.

SensorsImagingTrackingAISimulationRoboticsData

01Inputmultimodal data
02Integratealign · synchronize · fuse
03Modelstate · relationships · dynamics
04Sonifyresonate · harmonize · encode
05Renderreal-time · spatial audio

03BExperience

03CDeployment

Built to run inside real systems.

SoniXense is a software intelligence layer for the imaging, sensing, navigation, robotic and XR systems already in use.

ImagingNavigationRoboticsXRIntelligent sensing

Software intelligence layerSoniXense

Speakers · Headphones · XR audio

API · SDKA software layer that plugs into existing pipelines.
Hardware-independentWorks with the imaging, tracking and robotic systems already in place.
Real-time renderingLow-latency output to speakers, headphones and XR audio.

04 — First frontier: Surgery

Making surgical interaction audible.

In surgery, what matters happens where the eyes cannot follow: contact, deformation, force, trajectory and the anatomy just beneath the tool. SoniXense makes that evolving interaction audible in real time.

Instrument trajectoryTool–tissue interactionSubsurface structureAuditory representation

From tool–tissue dynamics to sound.

01

Ophthalmic surgery

Microscale tissue interaction

iOCT · imaging · tool tracking

02

Cardiovascular intervention

Catheter–tissue interaction

Imaging · navigation · procedural state

03

Robotic / minimally invasive surgery

Tool–tissue dynamics

Robotic state · interaction sensing · imaging

04

Spine surgery

Spatial navigation

Trajectory · proximity · critical anatomy

04AFrom science to experience

How a surgical phenomenon becomes something you can hear.

01Surgical phenomenon
Contact, deformation, force and tension, trajectory, proximity to anatomy.
02Measurement / model
Imaging, tracking and sensing feed models of the interaction and of what lies beneath the surface.
03Auditory representation
Model state becomes a continuous auditory scene the surgeon can listen to.
04Interaction
The surgeon acts, tissue and model respond, and the sound changes with them.

04BArtScience

Surgery is the first frontier. The language is older.

SoniXense listens to physical systems the way an ArtScience practice does — through matter, resonance and emergence. That lineage, led by Navid Navab, is where the way we hear complex systems began.

Matter
Sound
Resonance
Physical systems
Interaction
Emergence

Explore SoniXense ArtScience →

05 — Scientific foundation

Funded research,
translated into technology.

SoniXense grows out of a publicly funded academic research ecosystem, not a lab demo.

DFG-funded research

SYNERGIA

Multisensory Integration in High-Intensity Environments — Bridging AI Analysis and Human Perception.

An interdisciplinary project investigating sonification, spatial audio, AI and human perception in demanding surgical environments.

Academic research ecosystem · TUM / CAMP · TU Dresden

Explore Synergia ↗

Synergia visualization of a surgeon, anatomical tissue, and spatial sound waves.

Sonification
Spatial audio
Medical XR
Vibroacoustics
AI / computational modeling
Human perception
Clinical interaction

01Science
The DFG-funded Synergia project, a collaboration of TUM and TU Dresden, anchored at the TUM CAMP chair.
02Translation
Years of work in sonification, medical imaging and computer-assisted procedures, carried from research prototypes toward clinical workflows.
03Company
SoniXense is a spin-off in formation, emerging from Synergia and research at TUM CAMP.

Peer-reviewed research

MICCAI · IPMI · IEEE · Scientific Reports · Medical Image Analysis

CAMP at TUM ↗

ResearchInventionProtected technology

06 — Patents