Send YouTube live to OpenAI, get AI summaries & real-time replies for cross-language chat!

Latest Version

Version
0.4.3
Update
May 3, 2024
Size
376KiB
Developer
maki0419.com
Category
Users
313
Rating
2 ★
Manifest Version
3
Web Store Status
Languages Support
English
中文 (繁體)
日本語
See more
Permissions
Storage
See more

AI Chat Assistant (for Youtube Live Stream) Extension

Have you ever been unable to interact with Vtubers on YouTube due to language barriers? Now, we have created a cross-border communication experience for you!

With our new feature, you no longer need to worry about using a translation tool to communicate with Vtubers directly. Real-time translation allows you to easily overcome the challenges of multilingual communication!

Our extension can transmit YouTube live audio to OpenAI for intelligent translation and real-time response. It automatically sends the previous minute of audio to the Whisper API for speech-to-text conversion, sends the results to OpenAI for content analysis, and generates five one-click chat suggestion options to easily overcome communication barriers.

By using our feature, you can easily interact with Vtubers from around the world in the YouTube chat room and enjoy a borderless communication experience!

*This article was generated and translated using artificial intelligence.

## What it does?

- Retrieve the most recent few seconds of audio from a YouTube live stream. 30 seconds by default, but there is a slider available for adjusting it.

- Use the OpenAI Whisper API to convert the audio into text through speech-to-text transcription.

- Forward the transcription to the OpenAI gpt-3.5-turbo Text generation API for content analysis and generate potential chat suggestions.

- Present the chat suggestion options within the YouTube chat room, enabling users to effortlessly send them to the chat room with a single click.

## Disclaimer

Voice-to-text and AI-generated responses are provided by OpenAI. Your audio file will be sent to OpenAI.
You need to fill in the OpenAI API key in the extension settings.

Just a heads up, this is a little project I whipped up for fun. I cannot guarantee its reliability or the quality of the AI responses. So, please approach it with some skepticism and try to find any usable responses. If any one would like to enhance it, feel free to send me a PR!
Read more

Source Manifest.json

{
"update_url": "https://clients2.google.com/service/update2/crx",
"name":"__MSG_extName__",
"description":"__MSG_extDescription__",
"version":"0.4.3",
"manifest_version":3,
"default_locale":"en",
"permissions":["storage"],
"host_permissions":["https://api.openai.com/*",
"https://www.youtube.com/*",
"https://*.googlevideo.com/*"],
"background":{"service_worker":"background.js"},
"action":{"default_icon":{"16":"assets/icon/icon16.png",
"32":"assets/icon/icon32.png",
"48":"assets/icon/icon48.png",
"128":"assets/icon/icon128.png"},
"default_popup":"popup.html"},
"icons":{"16":"assets/icon/icon16.png",
"32":"assets/icon/icon32.png",
"48":"assets/icon/icon48.png",
"128":"assets/icon/icon128.png"},
"content_scripts":[{"matches":["https://www.youtube.com/*"],
"run_at":"document_idle",
"all_frames":true,
"js":["contentScript.js"],
"css":["contentScript.css"]}],
"web_accessible_resources":[{"resources":["contentScript.html",
"contentScript_button.html",
"assets/*"],
"matches":["https://www.youtube.com/*"]}]}
Read more

Similar Extensions

icon

LiveTL - Translation Filter for Streams Extension · Social & Communication 313 715 ★ 2.4MiB

icon

Speech Translator Extension · Productivity 313 183 ★ 48.6MiB

icon

HyperChat [Improved YouTube Chat] Extension · Social & Communication 313 145 ★ 1.19MiB

icon

YouTube Chatbot extension by Audio2Doc Extension · Productivity 313 2 ★ 243KiB

icon

TextGPT - Smarter Text Input by OpenAI Extension · Productivity 313 5 ★ 27.8KiB

icon

AutoReview for Power Automate Extension · Developer Tools 313 2 ★ 4.96MiB

icon

Retaino Extension · Productivity 313 2 ★ 443KiB

icon

Clip Playlist Extension · Fun 313 5 ★ 539KiB

icon

SubTrans - General Subtitle Translator Suite Extension · Productivity 313 91 ★ 714KiB

icon

VideoMind: Quick ChatGPT for Youtube Extension · Productivity 313 0 ★ 429KiB

icon

YouTube TC AutoTrans Corrector Extension · Productivity 313 398 ★ 470KiB

icon

YouTube Translator & YouTube Video Dubbing Extension · Productivity 313 131 ★ 735KiB

icon

Felo Subtitles: ChatGPT Live Translation Extension · Productivity 313 63 ★ 1.29MiB

icon

Coursera Mini Video Player Resizer Extension · Accessibility 313 1 ★ 8.12KiB

icon

TubeX: Your YouTube AI Copilot(Free Tool) Extension · Productivity 313 17 ★ 1.26MiB

icon

Vtuber Live Subtitle Extension · Fun 313 34 ★ 175KiB

icon

Holodex Portal Extension · Fun 313 1 ★ 9.86KiB

icon

Beyond - Gemini™ AI chat for any website Extension · Productivity 313 11 ★ 2.13MiB

icon

Textify Extension · Accessibility 313 5 ★ 48.84KiB

icon

TACQ AI | Linkedin Prospecting Extension · Social & Communication 313 10 ★ 120KiB

icon

Holodex Plus Extension · Fun 313 14 ★ 78.56KiB

icon

ChatGPT Pro Extension · Productivity 313 1 ★ 1.73MiB

icon

Youtube Dubbing Extension · Productivity 313 340 ★ 1.09MiB

icon

NewTranx Subtitler - Real-time voice recognition and AI translation Extension · Productivity 313 102 ★ 11.69MiB