SoniTranslate: video translation web application
A web interface built with Gradio for translating videos into different languages.
Verified
Core facts
Read by a script from the official API, not rewritten by a model.
- Repository
- https://github.com/R3gm/SoniTranslate
- License
- Apache-2.0
- Languages
- Python
- Maintainer
- R3gm
- Verified
What it is
SoniTranslate is a web application that translates videos into different languages. The SoniTranslate repository hosts the code of the web UI, which is built with the Gradio library. The local installation was tested in Linux. The project can also be run using Colab Runtime.
Main features
The 2024/18/05 update added the Overlap Reduction option.
That update integrates an OpenAI API key for transcription, translation and TTS.
The same update supports ASS subtitles and batch processing with subtitles.
The same update adds vocal enhancement before transcription.
TTS now supports up to 12 speakers.
The same update integrates OpenVoiceV2 for voice imitation.
Getting started
The SoniTranslate README's Before You Start section lists installing the NVIDIA drivers for CUDA 11.8.0 and accepting the license agreement for using Pyannote.
A token must be created to use some of the automatic model download features in SoniTranslate, and in Linux the Hugging Face token can be set as an environment variable.
The installation steps create and activate an anaconda environment for SoniTranslate, clone the github repository and navigate to it, and install the required packages.
Installing ffmpeg with Anaconda is recommended, it is needed to process audio and video files, and optional packages can be installed after installing FFmpeg.
To run locally, make sure the sonitr conda environment is active, and when the local URL is displayed in the terminal, open it in a web browser to access the SoniTranslate interface.
In most environments, pressing Ctrl+C in the terminal where SoniTranslate was launched stops the execution, and a command deactivates the Conda environment.
conda create -n sonitr python=3.10 -y
conda activate sonitr
python -m pip install pip==23.1.2 Setuptools==80.6.0
conda install pytorch==2.5.1 torchvision==0.20.1 torchaudio==2.5.1 pytorch-cuda=11.8 -c pytorch -c nvidiagit clone https://github.com/r3gm/SoniTranslate.git
cd SoniTranslatepip install -r requirements_base.txt -v
pip install -r requirements_extra.txt -v
pip install onnxruntime-gpuconda activate sonitrpython app_rvc.pyconda deactivateWho it is for
To start over from scratch, delete the SoniTranslate folder and remove the sonitr conda environment. To use OpenAI's GPT API for translation, tts or transcription, set the OpenAI API key as an environment variable in quotes. The code is licensed under Apache 2, but the models or weights may have commercial restrictions, as seen with pyannote diarization.
The cpu_mode command-line argument enables CPU mode to run the program without GPU acceleration. The verbosity_level argument sets the logger verbosity level: debug, info, warning, error or critical. The 2024/03/02 update added the output formats MP3, MP4, MKV, WAV and OGG.
The same update added processing of a full YouTube playlist. The 2024/02/22 update added burning subtitles to video. That update also added continuing a process from the last checkpoint.
The queue can accept multiple tasks simultaneously. The 2024/18/05 update added PDF to videobook, which displays images from the PDF.
Sources
This page is written from the official sources below. Open them to check the original text.
- GitHub READMEhttps://github.com/R3gm/SoniTranslateFetched
Verified ·
This page is written by AI from the official sources above and checked automatically. This site has not tested it. Found a mistake? Tell us.