Add Voice Support to Plugin Capabilities #487
Conversation
| url: 'https://raw.githubusercontent.com/BasedHardware/Friend/main$pluginMarkdownPath', | ||
| // url: 'https://raw.githubusercontent.com/BasedHardware/Friend/main$pluginMarkdownPath', | ||
| // Paul Graham has speak and listen capabilities on this fork | ||
| url: 'https://raw.githubusercontent.com/DamienDeepgram/Friend/main$pluginMarkdownPath', |
There was a problem hiding this comment.
This is temporary for testing
| @@ -129,7 +129,8 @@ Future<bool> deleteBackupApi() async { | |||
|
|
|||
| Future<List<Plugin>> retrievePlugins() async { | |||
| var response = await makeApiCall( | |||
| url: '${Env.apiBaseUrl}v1/plugins?uid=${SharedPreferencesUtil().uid}', | |||
| // url: '${Env.apiBaseUrl}v1/plugins?uid=${SharedPreferencesUtil().uid}', | |||
| url: 'https://raw.githubusercontent.com/DamienDeepgram/Friend/main/community-plugins.json', | |||
There was a problem hiding this comment.
This is temporary for testing
apps/AppWithWearable/pubspec.yaml
Outdated
| deepgram_speech_to_text: ^2.1.1 | ||
| deepgram_speech_to_text: | ||
| git: | ||
| url: https://github.com/DamienDeepgram/deepgram_speech_to_text.git |
There was a problem hiding this comment.
This is temporary for testing
PR to update the Flutter Deepgram SDK should be merged and this can be reverted
tempo-riz/deepgram_speech_to_text#13
There was a problem hiding this comment.
Waiting for this PR to go through for merging this
There was a problem hiding this comment.
@josancamon19 Flutter SDK PR got merged by the way
There was a problem hiding this comment.
Updated this to the 2.3.1 version of the SDK now that it has been updated
| ], | ||
| "voice": { | ||
| "speak": { | ||
| "model": "aura-helios-en" |
There was a problem hiding this comment.
Available Voice Models
| "model": "aura-helios-en" | ||
| }, | ||
| "listen": { | ||
| "model": "nova-2-general", |
There was a problem hiding this comment.
Available Models
| }, | ||
| "listen": { | ||
| "model": "nova-2-general", | ||
| "endpointing": 300 |
There was a problem hiding this comment.
Controls how long to wait before triggering response
| @@ -39,7 +39,7 @@ class _PluginDetailPageState extends State<PluginDetailPage> { | |||
| getPluginMarkdown(widget.plugin.externalIntegration!.setupInstructionsFilePath).then((value) { | |||
| value = value.replaceAll( | |||
| '](assets/', | |||
| '](https://raw.githubusercontent.com/BasedHardware/Friend/main/plugins/instructions/${widget.plugin.id}/assets/', | |||
| '](https://raw.githubusercontent.com/DamienDeepgram/Friend/main/plugins/instructions/${widget.plugin.id}/assets/', | |||
There was a problem hiding this comment.
This is temporary for testing
Adding Voice Capabilities to a Plugin
https://github.com/DamienDeepgram/Friend/blob/main/community-plugins.json#L49-L59
Leverages
UI Changes
New Fork of the Flutter Deepgram SDK Adding missing features for streaming