AI Voice UI BizBundle

The AI ​​Voice UI BizBundle targets audio products such as ordinary Bluetooth headphones, note, glasses, and professional headphones. After upgrading to AI products, they can utilize AI recording and translation functions. Its professional recording algorithm, combined with an advanced language model, covers real-time accurate transcription and translation of over 100 languages ​​worldwide.

• Before integrating this service package, please complete the preparatory work and framework integration .
• The demo for the AI ​​audio service package can be found at: tuya-aivoice-ios-sdk-sample-objc .

Function Introduction

The AI Voice UI BizBundle provides AI note-taking and AI translation capabilities. You can configure the AI ​​note-taking / AI translation miniapp entry on the page, or access it through the device details page.

The main functions are as follows. Developers can choose to display the functions through the miniapp entry point or the device details page according to product needs:

• AI Notes: Recording, real-time transcription, simultaneous interpretation, AI transcription and summarization, sharing.
• AI translation: simultaneous interpretation, dialogue translation, text translation.

AI Note

• Recording: Professional recording algorithms combined with advanced language models enable real-time accurate transcription and translation of over 100 languages ​​worldwide.
  

• Audio transcription: Automatically identifies the language and accurately transcribes it, supports speaker differentiation, and supports translation.
  

• In summary: Meeting minutes, interview highlights, class notes, and to-do lists can be generated with a single click, transforming chaos into order and supporting various scenarios.
  

• Share and export: Save your content as you like, and share it more easily.
  

AI Translation

• Simultaneous interpretation: Real-time simultaneous interpretation in 100+ languages.
  
• Dialogue translation: Face-to-face communication, barrier-free across languages.
  

How to use?

Integrate UI BizBundle

Add the AI ​​audio service package component to the Podfile of your project and execute the pod install command:

source 'https://github.com/tuya/tuya-pod-specs.git'
source 'https://cdn.cocoapods.org/'
platform :ios, '12.0'

target 'your_target_name' do
  # Secure File
  pod 'ThingSmartCryption', :path => './'
  
  # AI Voice UI BizBundle
  pod 'ThingSmartAIVoiceBizBundle'

  # Device network configuration UI BizBundle
  pod 'ThingSmartActivatorBizBundle'
  # MiniAPP UI BizBundle
  pod "ThingSmartMiniAppBizBundle"
  pod 'ThingSmartBaseKitBizBundle'
  pod 'ThingSmartBizKitBizBundle'
  # Device Detail UI BizBundle
  pod 'ThingSmartDeviceDetailBizBundle'
  # Family UI BizBundle
  pod 'ThingSmartFamilyBizBundle'
   
  # Optional
  # OTA UI BizBundle
  # pod 'ThingSmartOTABizBundle'
    
end

Integrate with MiniAPP

For instructions on integrating the Tuya Mini App SDK (iOS), please refer to: Mini App SDK - iOS .
If you only need to open the miniapp by AppID , you can call it directly:

[[ThingMiniAppClient coreClient] openMiniAppByAppId:@"xxx"];

AI Note（AppID: tyylldwlb8411tg8u2）
AI Translation（AppID: ty0u9m1s5ea1k71m2h）

If you need to navigate to a specific page within the miniapp (custom route), you can use the following route:

AI Note
Home Page：thingSmart://miniApp?url=godzilla%3A%2F%2Ftyylldwlb8411tg8u2%2Fpages%2Fhome%2Findex
Recording：thingSmart://miniApp?url=godzilla%3A%2F%2Ftyylldwlb8411tg8u2%2Fpages%2Fhome%2Findex%3FmodeKey%3DliveRecording
Simultaneous Interpretation：thingSmart://miniApp?url=godzilla%3A%2F%2Ftyylldwlb8411tg8u2%2Fpages%2Fhome%2Findex%3FmodeKey%3DsimultaneousInterpretation
Real-time Transcription：thingSmart://miniApp?url=godzilla%3A%2F%2Ftyylldwlb8411tg8u2%2Fpages%2Fhome%2Findex%3FmodeKey%3DrealTimeRecording

AI Translation
Home Page：thingSmart://miniApp?url=godzilla%3A%2F%2Fty0u9m1s5ea1k71m2h%2Fpages%2Fhome%2Findex
Simultaneous Interpretation：thingSmart://miniApp?url=godzilla%3A%2F%2Fty0u9m1s5ea1k71m2h%2Fpages%2Fsimultaneous%2Findex
FaceToFace Translation：thingSmart://miniApp?url=godzilla%3A%2F%2Fty0u9m1s5ea1k71m2h%2Fpages%2FFaceToFace%2Findex

Precautions

Bluetooth and microphone permissions

To use voice input and Bluetooth functionality, you need to set NSMicrophoneUsageDescription and NSBluetoothAlwaysUsageDescription in info.plist .

<key>NSMicrophoneUsageDescription</key>
<string>Enable Microphone Permissions</string>

<key>NSBluetoothAlwaysUsageDescription</key>
<string>Used to connect Bluetooth devices and facilitate audio/data communication.</string>

Background permissions

To ensure that the background audio input function can be used normally, background audio permissions and background Bluetooth permissions need to be enabled in the development tools.

Check the box under Target > Signing & Capabilities > + Capability > Background Modes.

• Audio, AirPlay, and Picture in Picture
• Uses Bluetooth LE accessories