English
中文 (繁體)
日本語
See more
中文 (繁體)
日本語
Send YouTube live to OpenAI, get AI summaries & real-time replies for cross-language chat!
Latest Version
Version
0.4.3
Update
May 3, 2024
Size
376KiB
Developer
maki0419.com
Category
Users
313 
Rating
2 ★
Manifest Version
3
Web Store Status
Extension ID
Languages Support
Permissions
Storage
See more
AI Chat Assistant (for Youtube Live Stream) Extension
Have you ever been unable to interact with Vtubers on YouTube due to language barriers? Now, we have created a cross-border communication experience for you!
With our new feature, you no longer need to worry about using a translation tool to communicate with Vtubers directly. Real-time translation allows you to easily overcome the challenges of multilingual communication!
Our extension can transmit YouTube live audio to OpenAI for intelligent translation and real-time response. It automatically sends the previous minute of audio to the Whisper API for speech-to-text conversion, sends the results to OpenAI for content analysis, and generates five one-click chat suggestion options to easily overcome communication barriers.
By using our feature, you can easily interact with Vtubers from around the world in the YouTube chat room and enjoy a borderless communication experience!
*This article was generated and translated using artificial intelligence.
## What it does?
- Retrieve the most recent few seconds of audio from a YouTube live stream. 30 seconds by default, but there is a slider available for adjusting it.
- Use the OpenAI Whisper API to convert the audio into text through speech-to-text transcription.
- Forward the transcription to the OpenAI gpt-3.5-turbo Text generation API for content analysis and generate potential chat suggestions.
- Present the chat suggestion options within the YouTube chat room, enabling users to effortlessly send them to the chat room with a single click.
## Disclaimer
Voice-to-text and AI-generated responses are provided by OpenAI. Your audio file will be sent to OpenAI.
You need to fill in the OpenAI API key in the extension settings.
Just a heads up, this is a little project I whipped up for fun. I cannot guarantee its reliability or the quality of the AI responses. So, please approach it with some skepticism and try to find any usable responses. If any one would like to enhance it, feel free to send me a PR!
Read more
With our new feature, you no longer need to worry about using a translation tool to communicate with Vtubers directly. Real-time translation allows you to easily overcome the challenges of multilingual communication!
Our extension can transmit YouTube live audio to OpenAI for intelligent translation and real-time response. It automatically sends the previous minute of audio to the Whisper API for speech-to-text conversion, sends the results to OpenAI for content analysis, and generates five one-click chat suggestion options to easily overcome communication barriers.
By using our feature, you can easily interact with Vtubers from around the world in the YouTube chat room and enjoy a borderless communication experience!
*This article was generated and translated using artificial intelligence.
## What it does?
- Retrieve the most recent few seconds of audio from a YouTube live stream. 30 seconds by default, but there is a slider available for adjusting it.
- Use the OpenAI Whisper API to convert the audio into text through speech-to-text transcription.
- Forward the transcription to the OpenAI gpt-3.5-turbo Text generation API for content analysis and generate potential chat suggestions.
- Present the chat suggestion options within the YouTube chat room, enabling users to effortlessly send them to the chat room with a single click.
## Disclaimer
Voice-to-text and AI-generated responses are provided by OpenAI. Your audio file will be sent to OpenAI.
You need to fill in the OpenAI API key in the extension settings.
Just a heads up, this is a little project I whipped up for fun. I cannot guarantee its reliability or the quality of the AI responses. So, please approach it with some skepticism and try to find any usable responses. If any one would like to enhance it, feel free to send me a PR!
Source Manifest.json
{
"update_url": "https://clients2.google.com/service/update2/crx",
"name":"__MSG_extName__",
"description":"__MSG_extDescription__",
"version":"0.4.3",
"manifest_version":3,
"default_locale":"en",
"permissions":["storage"],
"host_permissions":["https://api.openai.com/*",
"https://www.youtube.com/*",
"https://*.googlevideo.com/*"],
"background":{"service_worker":"background.js"},
"action":{"default_icon":{"16":"assets/icon/icon16.png",
"32":"assets/icon/icon32.png",
"48":"assets/icon/icon48.png",
"128":"assets/icon/icon128.png"},
"default_popup":"popup.html"},
"icons":{"16":"assets/icon/icon16.png",
"32":"assets/icon/icon32.png",
"48":"assets/icon/icon48.png",
"128":"assets/icon/icon128.png"},
"content_scripts":[{"matches":["https://www.youtube.com/*"],
"run_at":"document_idle",
"all_frames":true,
"js":["contentScript.js"],
"css":["contentScript.css"]}],
"web_accessible_resources":[{"resources":["contentScript.html",
"contentScript_button.html",
"assets/*"],
"matches":["https://www.youtube.com/*"]}]}
Read more
"update_url": "https://clients2.google.com/service/update2/crx",
"name":"__MSG_extName__",
"description":"__MSG_extDescription__",
"version":"0.4.3",
"manifest_version":3,
"default_locale":"en",
"permissions":["storage"],
"host_permissions":["https://api.openai.com/*",
"https://www.youtube.com/*",
"https://*.googlevideo.com/*"],
"background":{"service_worker":"background.js"},
"action":{"default_icon":{"16":"assets/icon/icon16.png",
"32":"assets/icon/icon32.png",
"48":"assets/icon/icon48.png",
"128":"assets/icon/icon128.png"},
"default_popup":"popup.html"},
"icons":{"16":"assets/icon/icon16.png",
"32":"assets/icon/icon32.png",
"48":"assets/icon/icon48.png",
"128":"assets/icon/icon128.png"},
"content_scripts":[{"matches":["https://www.youtube.com/*"],
"run_at":"document_idle",
"all_frames":true,
"js":["contentScript.js"],
"css":["contentScript.css"]}],
"web_accessible_resources":[{"resources":["contentScript.html",
"contentScript_button.html",
"assets/*"],
"matches":["https://www.youtube.com/*"]}]}
