AI Audio UI BizBundle

The AI Audio UI BizBundle upgrades standard audio devices such as Bluetooth earphones, note cards, glasses, and professional headsets into AI-enabled products. After the upgrade, devices support AI-powered recording and translation. With professional recording algorithms and advanced language models, the bundle supports real-time accurate transcription and translation for more than 100 languages worldwide.

• Before you integrate this BizBundle, complete Preparation and Integrate with Framework.

• Demo address of the AI Audio BizBundle: tuya-aivoice-ios-sdk-sample-objc.

Features

The AI Audio BizBundle provides AI notes and AI translation capabilities. You can configure the entry for the AI Notes or AI Translate miniapps on pages, or access the features from the device details page.

The main features are as follows. You can choose to display these features via miniapp entry or the device details page based on your product requirements:

• AI Notes: Recording, real-time transcription, simultaneous interpretation, AI transcription and summary, and sharing.
• AI Translate: Simultaneous interpretation, face to face translation, and text translation.

AI Notes

• Recording: Professional recording algorithms and advanced language models provide real-time accurate transcription and translation in more than 100 languages.

• Transcription: Automatically identify languages for accurate transcription. Support speaker diarization and translation.

• Summary: Generate structured outputs such as meeting minutes, interview highlights, class notes, and to-do lists with one tap. It organizes cluttered information and supports various scenarios.

• Share and export: Save and share content efficiently.

AI Translate

• Simultaneous interpretation: Real-time simultaneous interpretation for more than 100 languages.

• Face to face translation: Enable face to face multilingual communication.

How to use

Integrate with UI BizBundle

Add the components of the AI Audio UI BizBundle to the Podfile and run the command pod install:

source 'https://github.com/tuya/tuya-pod-specs.git'
source 'https://cdn.cocoapods.org/'
platform: ios, '12.0'

target 'your_target_name' do
  # Secure file
  pod 'ThingSmartCryption', :path => './'

  # AI Audio UI BizBundle
  pod 'ThingSmartAIVoiceBizBundle'

  # Device Pairing UI BizBundle
  pod 'ThingSmartActivatorBizBundle'
  # Miniapp UI BizBundle
  pod "ThingSmartMiniAppBizBundle"
  pod 'ThingSmartBaseKitBizBundle'
  pod 'ThingSmartBizKitBizBundle'
  # Device Details UI BizBundle
  pod 'ThingSmartDeviceDetailBizBundle'
  # Family UI BizBundle
  pod 'ThingSmartFamilyBizBundle'

  # Optional
  # Device OTA Upgrade UI BizBundle
  # pod 'ThingSmartOTABizBundle'

end

Integrate with miniapps

To integrate the Tuya Miniapp SDK (iOS), see: MiniApp SDK.

To open a miniapp by AppID, call:

[[ThingMiniAppClient coreClient] openMiniAppByAppId:@"xxx"];

AI Notes (appID: tyylldwlb8411tg8u2)

AI Translate (appID: ty0u9m1s5ea1k71m2h)

To navigate to a specific page in a miniapp (custom route), use these routes:

AI Notes
Home: thingSmart://miniApp?url=godzilla%3A%2F%2Ftyylldwlb8411tg8u2%2Fpages%2Fhome%2Findex
Recording: thingSmart://miniApp?url=godzilla%3A%2F%2Ftyylldwlb8411tg8u2%2Fpages%2Fhome%2Findex%3FmodeKey%3DliveRecording
Simultaneous interpretation: thingSmart://miniApp?url=godzilla%3A%2F%2Ftyylldwlb8411tg8u2%2Fpages%2Fhome%2Findex%3FmodeKey%3DsimultaneousInterpretation
Real-time transcription: thingSmart://miniApp?url=godzilla%3A%2F%2Ftyylldwlb8411tg8u2%2Fpages%2Fhome%2Findex%3FmodeKey%3DrealTimeRecording

AI Translate
Home: thingSmart://miniApp?url=godzilla%3A%2F%2Fty0u9m1s5ea1k71m2h%2Fpages%2Fhome%2Findex
Simultaneous interpretation: thingSmart://miniApp?url=godzilla%3A%2F%2Fty0u9m1s5ea1k71m2h%2Fpages%2Fsimultaneous%2Findex
Face to face interpretation: thingSmart://miniApp?url=godzilla%3A%2F%2Fty0u9m1s5ea1k71m2h%2Fpages%2FFaceToFace%2Findex

Things to note

Bluetooth and microphone permissions

To use speech input and Bluetooth features, set NSMicrophoneUsageDescription and NSBluetoothAlwaysUsageDescription in info.plist.

<key>NSMicrophoneUsageDescription</key>
<string>Enable microphone permission</string>

<key>NSBluetoothAlwaysUsageDescription</key>
<string>Connect to Bluetooth devices and enable audio and data communication</string>

Background permissions

To ensure audio input works correctly in the background, enable background audio and Bluetooth permissions in your development tool.

Go to Target > Signing & Capabilities > + Capability > Background Modes, then select:

• Audio, AirPlay, and Picture in Picture
• Uses Bluetooth LE accessories