Screen reader and content analyzer powered by Web AI and Chrome's built-in AI, featuring Moondream2 and Gemini Nano.
A-Eye Web Chat Assistant Extension
A-Eye Web Chat Assistant - Your AI-Powered Web Companion
Transform your browsing experience with Chrome's built-in AI and Web AI technologies. A-Eye delivers intelligent voice control, real-time image descriptions, and smart web content analysis while keeping your data private.
✨ Features You'll Love:
- Talk to Your Browser: Control your browser naturally with voice commands.
- See Through AI: Instant image descriptions and visual content analysis.
- Smart Content Helper: Summaries and explanations for any web content.
- Privacy First: All AI processing happens locally in your browser.
🎯 Powered by Advanced AI:
- Chrome's Gemini Nano: Built-in AI for powerful content understanding.
- Web AI Technology: Smart image recognition and real-time processing.
- No Cloud Required: Everything runs locally on your device.
⚡Visit the following link for more details.
https://github.com/vincentwun/A-Eye-Web-Chat-Assistant/blob/main/README.md
⚠️ Important Steup:
1. To experience the capabilities of the Built-in AI model, you need to install Chrome Dev/Canary (version ≥ 128.0.6545.0).
2. To enable these essential Chrome flags:
- `chrome://flags/enable-webgpu-developer-features` select Enabled
- `chrome://flags/optimization-guide-on-device-model` select Enabled BypassPerfRequirement
- `chrome://flags/prompt-api-for-gemini-nano` select Enabled
- Restart the Chrome Dev/Canary
3. Go to chrome://components and verify that the Optimization Guide On Device Model version is ≥ 2024.5.21.1031.
💡 How to Use
Keyboard Shortcuts
- Alt + Shift + Q: Open A-Eye Web Chat Assistant.
- Alt + Shift + 1: Activate voice control for browser and extension operations.
- Alt + Shift + 2: Interact with the AI for further insights after executing specific commands.
*(e.g., after taking a screenshot or analyzing content, press Alt + Shift + 2 to chat with the AI.)*
- Alt + Shift + 3: Repeat the AI's last response.
Voice Commands
> 💬 Reminder: Grant microphone access to the extension for using voice features.
1. Search
- Command: `\"Search [query]\"`
- Example: `\"Search the weather today\"`
- Action: Opens a Google search for the specified query.
2. Navigate to a Website
- Command: `\"Go to [website]\"`
- Example: `\"Go to google.com\"`
- Action: Opens the specified website. *(The `.com` suffix is optional.)*
3. Take Screenshot
- Commands:
- `\"Take a screenshot\"`
- Action: Captures a screenshot of the current view. The AI can describe the image content.
4. Take Scrolling Screenshot
- Commands:
- `\"Take a scrolling screenshot\"`
- Action: Captures a scrolling screenshot. The AI can provide a description of the image.
5. Analyze Content
- Commands:
- `\"Analyze content\"`
- Action: Performs content analysis on the current page using Gemini Nano.
Read more
Transform your browsing experience with Chrome's built-in AI and Web AI technologies. A-Eye delivers intelligent voice control, real-time image descriptions, and smart web content analysis while keeping your data private.
✨ Features You'll Love:
- Talk to Your Browser: Control your browser naturally with voice commands.
- See Through AI: Instant image descriptions and visual content analysis.
- Smart Content Helper: Summaries and explanations for any web content.
- Privacy First: All AI processing happens locally in your browser.
🎯 Powered by Advanced AI:
- Chrome's Gemini Nano: Built-in AI for powerful content understanding.
- Web AI Technology: Smart image recognition and real-time processing.
- No Cloud Required: Everything runs locally on your device.
⚡Visit the following link for more details.
https://github.com/vincentwun/A-Eye-Web-Chat-Assistant/blob/main/README.md
⚠️ Important Steup:
1. To experience the capabilities of the Built-in AI model, you need to install Chrome Dev/Canary (version ≥ 128.0.6545.0).
2. To enable these essential Chrome flags:
- `chrome://flags/enable-webgpu-developer-features` select Enabled
- `chrome://flags/optimization-guide-on-device-model` select Enabled BypassPerfRequirement
- `chrome://flags/prompt-api-for-gemini-nano` select Enabled
- Restart the Chrome Dev/Canary
3. Go to chrome://components and verify that the Optimization Guide On Device Model version is ≥ 2024.5.21.1031.
💡 How to Use
Keyboard Shortcuts
- Alt + Shift + Q: Open A-Eye Web Chat Assistant.
- Alt + Shift + 1: Activate voice control for browser and extension operations.
- Alt + Shift + 2: Interact with the AI for further insights after executing specific commands.
*(e.g., after taking a screenshot or analyzing content, press Alt + Shift + 2 to chat with the AI.)*
- Alt + Shift + 3: Repeat the AI's last response.
Voice Commands
> 💬 Reminder: Grant microphone access to the extension for using voice features.
1. Search
- Command: `\"Search [query]\"`
- Example: `\"Search the weather today\"`
- Action: Opens a Google search for the specified query.
2. Navigate to a Website
- Command: `\"Go to [website]\"`
- Example: `\"Go to google.com\"`
- Action: Opens the specified website. *(The `.com` suffix is optional.)*
3. Take Screenshot
- Commands:
- `\"Take a screenshot\"`
- Action: Captures a screenshot of the current view. The AI can describe the image content.
4. Take Scrolling Screenshot
- Commands:
- `\"Take a scrolling screenshot\"`
- Action: Captures a scrolling screenshot. The AI can provide a description of the image.
5. Analyze Content
- Commands:
- `\"Analyze content\"`
- Action: Performs content analysis on the current page using Gemini Nano.
Source Manifest.json
{"update_url": "https://clients2.google.com/service/update2/crx", "manifest_version": 3, "name": "A-Eye Web Chat Assistant", "version": "1.1.1", "description": "Screen reader and content analyzer powered by Web AI and Chrome's built-in AI, featuring Moondream2 and Gemini Nano.", "icons": { "16": "icons/icon-16.png", "32": "icons/icon-32.png", "48": "icons/icon-48.png", "128": "icons/icon-128.png" }, "permissions": [ "sidePanel", "activeTab", "scripting", "microphone", "commands" ], "host_permissions": [ "" ], "side_panel": { "default_path": "sidepanel.html" }, "background": { "service_worker": "background.js" }, "action": { "default_title": "Open A-Eye Web Chat Assistant" }, "web_accessible_resources": [ { "resources": [ "./lib/transformers300.js", "./lib/readability.js" ], "matches": [ "" ] } ], "content_security_policy": { "extension_pages": "script-src 'self' 'wasm-unsafe-eval'; object-src 'self'" }, "commands": { "toggle-voice-control": { "suggested_key": { "default": "Alt+Shift+1", "mac": "Alt+Shift+1" }, "description": "Toggle voice browser control" }, "toggle-voice-input": { "suggested_key": { "default": "Alt+Shift+2", "mac": "Alt+Shift+2" }, "description": "Toggle voice input for chat" }, "toggle-repeat": { "suggested_key": { "default": "Alt+Shift+3", "mac": "Alt+Shift+3" }, "description": "Repeat last AI response" }, "_execute_action": { "suggested_key": { "default": "Alt+Shift+Q", "mac": "Alt+Shift+Q" }, "description": "Open Extension" } }}
Read more