Multi-Lens IPC

The IPC SDK allows for displaying video from multiple cameras on a single screen by using a video splitting protocol for rendering, which relies on device support.

Check video splitting support

API description

Check if the device supports video splitting and return a Boolean value.

@property (nonatomic, assign, readonly) BOOL isSupportedVideoSplitting;

Example

id<ThingSmartCameraType> camera = [ThingSmartCameraFactory cameraWithP2PType:p2pType config:config delegate:self];
if (camera.advancedConfig) {
    return camera.advancedConfig.isSupportedVideoSplitting;
}
return NO;

Get video splitting protocol

API description

Get the video splitting protocol in JSON.

@property (nonatomic, copy, readonly) NSString *cameraSplitVideoInfoJson;

Example

id<ThingSmartCameraType> camera = [ThingSmartCameraFactory cameraWithP2PType:p2pType config:config delegate:self];
if (camera.advancedConfig) {
    return camera.advancedConfig.cameraSplitVideoInfoJson;
}
return nil;

References:

• Description of JSON parameters

• Example protocol

Bind render view with camera ID

API description

Each render view can be bound with one camera ID. This method allows for bulk binding.

You can parse the index from the video splitting protocol and assign it to the videoIndex in ThingSmartVideoViewIndexPair.

- (BOOL)registerVideoViewIndexPairs:(NSArray<id<ThingSmartVideoViewIndexPair>> *)viewIndexPairs;

Request parameters

Unbind render view from camera ID

API description

Unbind the render view from one or more camera IDs.

You can parse the index from the video splitting protocol and assign it to the videoIndex in ThingSmartVideoViewIndexPair.

- (BOOL)uninstallVideoViewIndexPairs:(NSArray<id<ThingSmartVideoViewIndexPair>> *)viewIndexPairs;

Request parameters

Swap camera views

Swap between the video streams rendered by two players.

- (BOOL)swapVideoIndex:(ThingSmartVideoIndex)videoIndex forVideoIndex:(ThingSmartVideoIndex)forVideoIndex;

Request parameters

Example

[camera swapVideoIndex:1 forVideoIndex:2];

Complete example code

/// Binding information class
@interface CameraDivisionRegisterConfig : NSObject<ThingSmartVideoViewIndexPair>

@end

@implementation CameraDivisionRegisterConfig

@synthesize videoIndex;
@synthesize videoView;

@end

// Create camera
- (void)createCamera {
    if (self.camera) {
        return;
    }

   id p2pType = [self.deviceModel.skills objectForKey:@"p2pType"];
   dispatch_async(dispatch_get_global_queue(DISPATCH_QUEUE_PRIORITY_DEFAULT, 0), ^{
    self.camera = [ThingSmartCameraFactory cameraWithP2PType:p2pType deviceId:devId delegate:self];
  //Bind view
    [self bindRenderView];
    [self.camera connect];
});
}

- (void)bindRenderView {
   //one split video player config
    self.oneSplitVideoPlayerConfig = [[CameraDivisionRegisterConfig alloc] init];
    ThingSmartEAGLView *oneSplitVideoPlayer = [[ThingSmartEAGLView alloc] init];
    self.oneSplitVideoPlayerConfig.videoView = oneSplitVideoPlayer;
    self.oneSplitVideoPlayerConfig.videoIndex = 1;
    
    //two split video player config
    self.twoSplitVideoPlayerConfig = [[CameraDivisionRegisterConfig alloc] init];
    ThingSmartEAGLView *twoSplitVideoPlayer = [[ThingSmartEAGLView alloc] init];
    self.twoSplitVideoPlayerConfig.videoView = twoSplitVideoPlayer;
    self.twoSplitVideoPlayerConfig.videoIndex = 2;

  // Get the camera splitting protocol.
  NSString *splitVideoInfoJson = self.camera.advancedConfig.cameraSplitVideoInfoJson;

  // Register the render view.
   [self.camera registerVideoViewIndexPairs:@[self.oneSplitVideoPlayerConfig,self.twoSplitVideoPlayerConfig]];


  // Add view and layout.
    oneSplitVideoPlayer.frame = CGRectMake(0, 90, ScreenWidth(), ScreenWidth()*9/16);
    twoSplitVideoPlayer.frame = CGRectMake(0, CGRectGetMaxY(oneSplitVideoPlayer.frame),  ScreenWidth(), ScreenWidth()*9/16);

  [self.view addSubview:oneSplitVideoPlayer];
  [self.view addSubview:twoSplitVideoPlayer];

}

// Unbind view
- (void)unRegister {
    [self.camera uninstallVideoViewIndexPairs:@[self.boolConfig,self.blotConfig]];
}

#pragma mark - ThingSmartCameraDelegate
- (void)cameraDidConnected:(id<ThingSmartCameraType>)camera {
    self.connected = YES;
    // Preview can only start after a successful P2P connection.
       [camera startPreview];
}

For more information, see Demo.

Description

Video splitting parameters

Example protocol

{
  "total_split_num":3,
  "split_info":[
    {
      "index":1,
      "type":1,
      "res_pos":[[0,0,640,720],[0,0,960,1080]]
    },
    {
      "index":2,
      "type":2,
      "res_pos":[[0,720,640,720],[0,1080,960,1080]]
    },
    {
      "index":3,
      "type":2,
      "res_pos":[[0,720,1280,720],[0,1080,1920,1080]]
    }
  ],
  "align_info":{
    "align_type":32,
    "align_group":[[1, 3],[2]],
    "localizer_group":[1,3]
  }
}