Hand Engine changelog

What's new in Hand Engine

Hand Engine software changelog

 

Moderate update

Hand Engine Update 2.1.0

Previous version

Hand Engine 2.0.0

Deprecated versions

Hand Engine 1.5.2

Release date

16 August 2022

Operating system

Windows 10, 64bit

Meaning of icons

+added, ^changed, !note, #fixed, -removed

Requirement

FIRMWARE UPDATES
Firmware for the MoCap Pro glove – SuperSplay model:

MoCap Pro SuperSplay Glove firmware update 01.01.03 or higher

Bluetooth Dongle firmware update 01.01.04 or higher

Both are included in Launcher firmware bundle version SuperSplay Bundle 1.9 available in your account section of our website

Firmware for the MoCap Pro glove – Fidelity model:

MoCap Pro Fidelity Glove firmware update 01.00.00 or higher

Bluetooth Dongle firmware update 01.01.04 or higher

Both are included in Launcher firmware bundle version Fidelity Bundle 1.0 available in your account section of our website

FIRMWARE UPDATE INSTRUCTIONS
Firmware Update Process via Launcher (Beta)

Legacy Firmware Update Process

OTHER UPDATES
StretchSense WiFi App

If using StretchSense Wi-Fi App then this will also require an update, which you can download from Google Play

Plugins
MotionBuilder Plugin has been updated to 01.00.20. Please download from the account section of our website

 

1. Introduction

This document describes the new features, improvements and bug fixes included in software update 2.1.0 for Hand Engine. For in-depth guides on specific features please visit the StretchSense Knowledge Base https://get.stretchsense.com/knowledge.

2. Major Changes

Express Tuning reintroduced for SuperSplay and added for Fidelity

+ Support for Express Calibration Tuning using Blend Poses for both the MoCap Pro SuperSplay Glove and MoCap Pro Fidelity Glove.

3. Other Changes

^ On the Training tab in the Advanced Calibration view the Training Configuration Detected labels have been updated to match those used during the StretchSense onboarding process and on the StretchSense website:

  • Express  = Express Calibration only
  • Tuned Express = Express plus 1 or more Blend poses
  • Express with Key Pose = Express plus 1 or more Key Pose poses (previously Hybrid Express)
  • Tuned Express with Key Pose = Express plus 1 or more Blend poses and 1 or more Key Pose poses
  • Blend Pose = Only Blend poses (previously called Blend)
  • Blend Pose with Key Pose  = 1 or more Blend poses and 1 or more Key Pose poses (previously called Hybrid)
  • Key Pose = Only Key Pose poses (previously called Pose)

+ You can now use a single Key Pose in combination with Express, Tuned Express or Blend where previously you had to use two or more Key Poses.

+ Hand Engine 2.1.0 prevents users from exiting Hand Engine during recording. Users must stop recording before they exit the application.

4. Bug Fixes

User Interface

  • Fixed an intermittent bug where, having quit the previous Hand Engine session while the gloves were still connected, a blank user interface appeared upon restarting Hand Engine.

Installation

  • Fixed an installation issue faced by users with certain PC permissions by allowing users to install to all user profiles.
  • Fixed an issue where installing to all users can cause a hard crash of Hand Engine when attempting to record data.

SD Card Recording

  • Fixed an issue where SD card recording trigger could become out of sync with start and stop recording when using the Wi-Fi Bridge App as an input source.

Remapping

  • Fixed an issue with remapping onto character rigs with asymmetric left and right joint hierarchy.

Importing Express Calibrations

  • When importing a calibration that only contains Express Calibration (and no captured poses), the user no longer has to capture a single pose (any pose) before clicking the Train button to train the imported Express Calibration.

Pose Editor

  • Fixed formatting issues by adding a scroll bar to the ‘Select Base Pose’ dropdown.

5. Known Issues

User Interface

  • On load, multiple previously connected USB COMPORT devices are restored in the source dropdown even if the USB dongles are not physically connected to the PC. These sources are not available to be connected to. However, if you reconnect these USB dongles to your PC you are able to be connect and calibrate.
  • If your Remap Profile Name is longer than 62 characters it will extend the boundaries of the UI element on the Remapping Target dropdown.

Calibration

  • If using multiple Key Poses for Blend with Key Pose, Express with Key Pose and Tuned Express with Key Pose, we recommend that the poses be dissimilar or at opposite joint angles to each other, i.e. Fist and Paddle L or Thumb Up and Paddle.
  • Performance issue with the MoCap Pro SuperSplay with the index and pinky splay being overly sensitive when using Express Calibration.
  • At the end of an Express Calibration the hand animation may freeze for less than a second as the final model is trained.

Streaming

  • If streaming from Xsens MVN to Unreal Engine 5 via MVN LiveLink, we suggest setting up finger streaming from Hand Engine 2.0.0 into MVN after the MVN LiveLink connection has already been established in UE5. If you attempt to setup streaming from Hand Engine 2.0.0 to MVN before setting up the MVN LiveLink, it is possible to run into an issue where the MVN LiveLink will not connect in UE5.
  • Depending on the memory of your PC, streaming on more than 5 performers (10 pairs of gloves) into Unity, MotionBuilder, or Unreal Engine can lead to drops in performance quality. Please see the bottom of the Hand Engine webpage for minimum PC requirements: https://stretchsense.com/solution/hand-engine/.

Recording

  • When recording via a wireless connection (i.e. Bluetooth dongle or Wi-Fi app) there will be a 1 second keyframe gap in the FCurve within the first 2 seconds of the recorded FBX file.
  • When recording is triggered, if you are also recording to SD card (i.e. SD Card Recording set to “Triggered by Record”) there will be a delay in the hand animation in the viewport of up to 2 seconds. This is due to a delay in the operations associated with the SD card trigger on the Glove circuit. This does not affect the recording itself, only the viewport.

Remapping

  • Sometimes when loading a new FBX file which is similar to an existing FBX file used in remapping, the joint selector dropdowns in the user interface may not appear. The current workaround is to select a new root joint for the hand and set up the remap again from the start.
  • When loading in a new FBX the Remap Profile Name from the most recent remap profile setup will populate the Remap Profile Name text field. We recommend making sure to rename the profile name before updating any joints to avoid overwriting previously created remapping profiles.
  • It is not currently possible to delete Remap Profiles you have previously created yet.

File Playback

  • File Playback with an Express Calibration is only possible when a minimum of 1 pose has been captured i.e. at least one pose must be checked in the Blend column of the Hand Training tab in the Advanced Calibration View.

Wi-Fi App

Wired Connection

  • SD card recording is not possible when using a wired connection for the MoCap Pro SuperSplay and MoCap Pro Fidelity. We recommend setting this to “off” when using the wired connection.
  • When using a wired connection, the MoCap Pro SuperSplay will disconnect when recording is stopped if SD card record is set to “Triggered by Record”. We recommend setting this to “Off” when using a wired connection. This issue will be fixed in a future glove firmware update to the MoCap Pro SuperSplay.
  • When using a wired connection, the Timecode Jam Sync indicator for the MoCap Pro Fidelity is not activating even when within an acceptable range of 2 frames. This will be fixed in a future glove firmware update to the MoCap Pro Fidelity.

Launcher

  • Hand Engine 2.1.0 can not be launched by the StretchSense Launcher Beta 0.7.4. The Launcher can still be used for firmware updates.

Major Update

Hand Engine Update 2.0.0

New versionHand Engine 2.0.0
Previous versionHand Engine 1.5.3
Deprecated versionsHand Engine 1.4.0
Release date14 July 2022
Operating systemWindows 10, 64bit
Meaning of icons+added, ^changed, !note, #fixed, -removed
RequirementFIRMWARE UPDATES
Firmware for the MoCap Pro glove – SuperSplay model
  • MoCap Pro SuperSplay Glove firmware update 01.01.03 or higher
  • Bluetooth Dongle firmware update 01.01.04 or higher

Both are included in Launcher firmware bundle version SuperSplay Bundle 1.9 available in your account section of our website.

Firmware for the MoCap Pro glove – Fidelity model

  • MoCap Pro Fidelity Glove firmware update 01.00.00 or higher
  • Bluetooth Dongle firmware update 01.01.04 or higher

Both are included in Launcher firmware bundle version SuperSplay Bundle 1.9 available in your account section of our website.

FIRMWARE UPDATE INSTRUCTIONS
Firmware Update Process via Launcher (Beta)

Legacy Firmware Update Process

OTHER UPDATES
StretchSense Wi-Fi App

If using StretchSense Wi-Fi App then this will also require an update, which you can download from Google Play.

Plugins

MotionBuilder Plugin has been updated to 01.00.20. Please download from your account section of our website.

 
1. Introduction
This document describes the new features, improvements and bug fixes included in software update 2.0.0 for Hand Engine. For in-depth guides on specific features please visit the StretchSense Knowledge Base.
 
2. Major Changes

New and Previous Generation Glove Support

+ Support for the new generation MoCap Pro Fidelity Glove

+ Backwards compatibility support for MoCap Pro SuperSplay Glove

User Interface Redesign

+ The User Interface has been completely redesigned and now displays up to six performers simultaneously. New workflows allow users to get setup as quickly as possible with an emphasis on the Express Calibration feature.

+The User Interface has been broken out into three distinct views: Stage View, Focused Performer View and Advanced Calibration View

  1. Stage View: View all staged performers at once (up to six) and view simple diagnostic information for each performer such as the Data Sample Rate, Sensor Activity Indicator, Battery Life, SD Card Presence, Timecode Jam Sync status, Streaming status, and glove and dongle Firmware Information.
  2. Focused Performer View: Focus in on a specific performer. This is where you go to connect gloves, run an express calibration, access advanced calibration options, setup streaming and view glove timecode. Can be accessed by clicking the Focus Performer button when multiple performers are ‘staged’ (added).
  3. Advanced Calibration View: This view is made up two tabs; Capture and Hand Training. Capture is where you can capture poses to add to or tune your calibration. Hand Training is where you can configure your calibration, choosing whether to include your Express Calibration as a base and which, if any, pose based calibration options to include.

Stage Controls

+ Stage Controls, which can be found at the bottom of the screen in the Stage View and Focused Performer View, allow you to manage performers, start, stop and browse recordings and manage your timecode source.

+ Performers can be staged to the Stage View and unstaged (removed) from the Stage View by ticking or unticking the checkbox associated with each performer in the Staged column of the Performers section on the left of the Stage Controls.

+ Staged performers are active performers and therefore, recordings will be made for each glove on each active performer when recording.

! A maximum of 6 performers can be staged simultaneously (depending on the number of performers permitted in your license).

! The stage view will modify the interface layout based on how many performers are staged.

+ Users can now edit take names, browse recordings, set recording location and set SD card options from the Recording section in the middle of the Stage Controls.

+ Users can access Timecode source settings directly from the Timecode section on the right of the Stage Controls and the Master Timecode is displayed in the center in the Recording section for easy viewing.

Performer Management

+ Performer management has been simplified and now has its own section under the Stage Controls labelled Performers. The user can create and store calibrations for multiple performers. Before connecting gloves, you will need to create and stage a new performer under the Stage Controls

+ Next to performer names on the viewport, users can associate a color (using a color picker) with each performer for easier identification in Stage View

Connecting gloves

+ Connecting gloves has been simplified to a dropdown menu where you can select from all available StretchSense input sources (Bluetooth wireless connection or wired USB connection)

+ You can also select the network port (for connecting to the StretchSense Wi-Fi Bridge App) or file source (for playing back a raw file)

! To play back a raw file you need to have an active calibration. You can import the calibration in the Hand Training tab of the Advanced Calibration window. For the recording to playback correctly it will require the original calibration that was used to record the file

Advanced Calibration Window

+ All pose-based calibration has been moved to the Advanced Calibration window

+ The Capture tab is where you can manually capture poses from pose libraries, which you can access from the Select Pose Library dropdown menu

+ From the Capture tab you can import and export Pose Libraries you have created in Hand Engine and access the pose editor to make new poses to add to new or existing pose libraries

+ The Hand Training tab is where you can view, edit and delete your Captured Poses

^ Output Mode has been replaced by a single Train button. Now you configure your calibration using the Include Express Mode toggle, and by choosing which poses you want to include using the Blend or Key Pose checkboxes. Once you have selected the desired parameters click the Train button to apply those changes. To make any changes to your calibration re-click the Train button to apply the new parameters.

! Hand Engine will train the model based on your calibration configuration choices and will determine which Output Mode is detected. For example, if only the Express toggle is checked, Express Mode will be detected. Or if Express is unchecked and poses are checked in the blend column, Blend Mode will be detected. And so on.

! You can set global Key Pose Settings such as Transition Animation and Duration after the glove has been trained.

3. MoCap Pro Fidelity Glove Specific Changes

+ The MoCap Pro Fidelity gloves use a unique Express Calibration model that takes advantage of the ten additional sensors it has compared to the MoCap Pro SuperSplay. This Fidelity-specific Express Calibration model has improved distal joint performance and finger touch performance compared to the SuperSplay model.

+ New poses included in the Expert and Finger Touch (Fidelity) pose libraries take full advantage of the MoCap Pro Fidelity glove’s extra sensors, providing superior fidelity of movement in finger distal joint animation.

+ The MoCap Pro Fidelity also has extra wrist sensors that can be used to reduce ‘noise’ (unwanted finger movement) when there is a significant amount of wrist movement introduced during a performance, as you may encounter with scenes with props such as swords or axes. When a MoCap Pro Fidelity glove is detected by Hand Engine extra Wrist Settings appear in the Hand Training tab which can be used to dampen the impact of wrist movement

+ The higher the Wrist Dampening factor the slower the user’s wrist movement or rotation needs to be to activate finger movement reduction

+ MoCap Pro Fidelity gloves come with onboard SD card storage of 64GB. You can access stored files on the SD card by plugging the MoCap Fidelity glove into a Windows PC and putting the glove in Storage Mode by holding the power button for 3+ seconds until the light changes from blinking blue to solid green. The glove will now be accessible as a USB Drive in File Explorer. To go back to normal operation of the glove press the power button once and LED will return to blinking blue.

4. Other Changes

Express Calibration

– Express Calibration tutorial has been removed.

^ Default Express Calibration Duration has been extended from 15 seconds to 20 seconds to improve usability for first time users.

– Express Calibration Tuning using Blend Poses has been removed. This will be reintroduced in next Hand Engine update.

! Express Calibration with Key Poses (Hybrid express) is still available.

Manual Calibration

– Group Calibration has been removed.

– Pose Calibration Timer has been removed.

FBX Recording

+ Users no longer need to select whether they want to record to Hands Only FBX or Full Body Skeleton in Settings. By default recording in Hand Engine now creates FBX files for separate left and right hands and Full Body Skeleton for each active performer, stored in a single take folder.

^ Setting the recording location is now more accessible. Recording location is now set from the Stage Controls rather than the Settings menu.

+ In Settings menu users can now choose to record to FBX starting at key frame 0 or to start at the current timecode value (the default option in previous versions of Hand Engine).

Remote Triggering

+ In Settings when a user defines a remote trigger source (Vicon, OptiTrack, Xsens, or Qualisys) the default port for those systems is chosen as the triggering port. The user can change this to a custom port if needed.

– Use remote trigger system take location when remote trigger recording has been deprecated.

SD Card Recording

+ Triggering SD Card recording is now a global setting in the Recording tab of the Stage Controls rather than set per device. You can set Hand Engine to record to SD card by setting the dropdown under SD Card to ‘Triggered by Record’.

! ‘Triggered by Record’ is the default option

Batch Processing of SD Card Files

^ Batch Processing functionality has been rebuilt.

– Batch processing “Raw files recorded via SD card” toggle has been removed.

^ Batch processing of SD card files in Hand Engine now requires you to bulk copy the SD CSV files from the microSD storage on your glove to the corresponding local capture folder that will serve as the Input Folder for the Batch Process function. By default this is C:\Users\Public\Documents\StretchSense\Hand Engine\Captures

! When a local capture folder contains both the locally recorded CSV raw files and the CSV raw files from the SD card, the Hand Engine Batch Process function has a preference for SD recorded CSV raw files and will ignore the locally recorded CSV raw files

! Please refer to the Knowledge Base for more detailed information on the process

Remapping

^ Remapping Setup window has been reworked and improved so that the user can setup both the left and right hand remap of a target character in a single Remapping Target Profile.

+ The saved Remapping Target Profile can be applied in the Advanced Calibration window of each glove for a single performer.

! A device has to be connected for a Remapping Target Profile to be able to be applied in the Advanced Calibration window.

Pose Editing

+ Pose editing has been reworked into its own workflow in the newly created Pose Editor window.

Session State

^ Save, Load and Restore sessions have been removed and now the previous state of Hand Engine is saved automatically so you can pick up where you left off.

Notifications

+ Notification and error messaging system has been revamped to be more visible and accessible to users when completing actions in the Hand Engine user interface.

Diagnostics

+ You have the ability to follow the console logs in real time. See Help>Follow Logs.

– Sensor bar graphs for each individual sensor have been removed.

Viewport

– Toggle Viewport Hands functionality has been removed.

Plugins

^ MotionBuilder plugin has been updated to 01.00.20 to reflect changes in Hand Engine. All other plugins for Unreal Engine, Maya and Unity remain unchanged and will operate as with previous versions of Hand Engine.

5. Known Issues

Calibration

For Hybrid Mode to work a minimum of two poses need to have key selected. For best results, we recommend having at least three poses with key selected and that these three poses be dissimilar or at opposite joint angles to each other, i.e. Fist and Paddle L or Thumb Up and Paddle. In situations where the desired result only requires one or two poses, you can effectively mute the extra poses you add by setting the confidence levels for those poses to zero.

Performance issue with the MoCap Pro SuperSplay with the pinky splay being overly sensitive when using Express Calibration.

At the end of an Express Calibration the hand animation may freeze for less than a second as the final model is trained.

Streaming

If streaming from Xsens MVN to Unreal Engine 5 via MVN LiveLink, we suggest setting up finger streaming from Hand Engine 2.0.0 into MVN after the MVN LiveLink connection has already been established in UE5. If you attempt to setup streaming from Hand Engine 2.0.0 to MVN before setting up the MVN LiveLink, it is possible to run into an issue where the MVN LiveLink will not connect in UE5.

Depending on the memory of your PC, streaming on more than 5 performers (10 pairs of gloves) into Unity, MotionBuilder, or Unreal Engine can lead to drops in performance quality. Please see the bottom of the Hand Engine webpage for minimum PC requirements.

Recording

When recording via a wireless connection (i.e. Bluetooth dongle or Wi-Fi app) there will be a 1 second keyframe gap in the FCurve within the first 2 seconds of the recorded FBX file.

When recording is triggered, if you are also recording to SD card (i.e. SD Card Recording set to “Triggered by Record”) there will be a delay in the hand animation in the viewport of up to 2 seconds. This is due to a delay in the operations associated with the SD card trigger on the Glove circuit. This does not affect the recording itself, only the viewport.

File Playback

File Playback with an Express Calibration is only possible when a minimum of 1 pose has been captured i.e. at least one pose must be checked in the Blend column of the Hand Training tab in the Advanced Calibration View.

Importing Express Calibrations

When importing a calibration that only contains Express Calibration (and no captured poses), you will need to capture a single pose (any pose) before you can click the Train button. You can then deselect this pose from the Blend column and click Train a second time to return to your imported Express Calibration.

Wi-Fi App

Depending on your PC specifications, phone specifications and Wi-Fi network latency, it is possible to run into performance issues when using the Wi-Fi app for 4 or more performers. The Wi-Fi app continues to receive regular updates so please keep up to date with the latest available version on Google Play and keep up to date with the Knowledge Base for recommendations on setup when using the Wi-Fi app.

Wired Connection

SD card recording is not possible when using a wired connection for the MoCap Pro SuperSplay and MoCap Pro Fidelity. We recommend setting this to “off” when using the wired connection.

When using a wired connection, the MoCap Pro SuperSplay will disconnect when recording is stopped if SD card record is set to “Triggered by Record”. We recommend setting this to “Off” when using a wired connection. This issue will be fixed in a future glove firmware update to the MoCap Pro SuperSplay.

The Timecode Jam Sync indicator for the MoCap Pro Fidelity is not activating in wired connection even when within an acceptable range of 2 frames. This will be fixed in a future glove firmware update to the MoCap Pro Fidelity.

Launcher

Hand Engine 2.0.0 can not be launched by the StretchSense Launcher Beta 0.7.4. The Launcher can still be used for firmware updates.

Hotfix

Hand Engine Update 1.5.3

New versionHand Engine 1.5.3
Previous versionHand Engine 1.5.2
Deprecated versionsHand Engine 1.5.1
Release dateMay 4, 2022
Operating systemWindows 10, 64bit
Meaning of icons+added, ^changed, !note, #fixed, -removed
Requirement**This functionality requires a glove firmware update v01.01.00 or higher and dongle firmware update 01.01.02 or higher. This update is included in Launcher firmware bundle version 1.5 or higher.New Firmware Update Process via Launcher (Beta)How to Update Your Mocap Pro Glove and USB Dongle Firmware via the StretchSense LauncherLegacy Firmware Update ProcessGlove Firmware Update ProcessDongle Firmware Update Process
 
1. Introduction
This document describes the new features, improvements and bug fixes included in software update 1.5.3 for Hand Engine
 
2. Minor Changes
+ Allow user to define trigger source (Vicon, OptiTrack, Xsens, or Qualisys) and therefore packet structure on incoming XML trigger message depending on which trigger source the user is triggering Hand Engine from
+ Added tooltips for interactive elements in “User Preferences” window
+ Notification message appears when Take Name is above 110 characters to warn users that recording will leads to a truncated Take Name folder for the local recording and on the SD card. Meta files for local recording will still contain the entire Take Name but MetaSD files on the SD card will truncate the Take Name to 110 characters
^ Changed title of preferences window from “Application Settings” to “User Preferences”
^ Removed Take Name string from Global Meta File. Global Meta File now named GlobalMeta.json
 
3. Bug Fixes
# Fix for OptiTrack Motive and Xsens MVN triggering issue where remote trigger was not working for, UDP listener has been updated to differentiate Motive, Vicon, Qualisys and Xsens trigger events by getting user to define incoming source
# Allow updating of trigger port without having to restart Hand Engine. User can now test that port has been updated by turning on and off remote trigger toggle
# Fix for SD Card recording when Take Names are greater than 32 characters. For successful recording to the SD card the maximum limit for Take Names has been increased from 32 to 110 characters
# Added a flag to batch processing functionality to fix a previous known issue where batch processing to a Full Body FBX can lead to data being written for only one hand
! If using the StretchSense WiFi Bridge app to connect to Hand Engine, users will need to update the application to version 1.16 for SD card recording to work with the increased Take Name character limitStretchSense WiFi Bridge – Apps no Google Play
 
4. Known Issues
For Hybrid Mode to work a minimum of two poses need to have key selected. For best results, we recommend having at least three poses with key selected and that these three poses must be dissimilar or at opposite joint angles to each other, i.e. Fist and Paddle L or Thumb Up and Paddle. In situations where the desired result only requires one or two poses, you can effectively mute the extra poses you add by setting the confidence levels for those poses to zero.
 
On rare occasions the MetaSD file recorded for a take may have an empty MetaSD file (size of the file will be 0kb). This take will not be able to be batch processed and will provide the user with an error message during the batch process directing you to the problem file. If you wish to batch process the remaining files it is recommended to remove the take folder with a 0kb MetaSD file from the list of takes being batch processed then restart the batch process. The problem take will still be able to be played in Hand Engine using the raw CSV file and File Playback functionality and then exported as an FBX manually by the user.
 
Performance issue with the pinky splay being overly sensitive when using Express Calibration.
 
Switching between Express and Hybrid Mode with only an Express pose trained in your profile may lead to thumb performance issues. We recommend capturing at least 3 extra poses if intending to use Hybrid with Express Calibration tuning.
 
Clicking the Scan button does not auto-assign a COMPORT. After clicking Scan the user must first select the COMPORT they would like to use from the dropdown list then click the ‘on’ switch.
 
When manually exporting, recorded CSV files will use the Take Name set in Hand Engine rather than the Take Name used in the CSV file name. 

Hotfix

Hand Engine Update 1.5.2

New version

Hand Engine 1.5.2

Previous version

Hand Engine 1.5.1

Deprecated versions

Hand Engine 1.5.1

Release date

March 15th, 2022

Operating system

Windows 10, 64bit

Meaning of icons

+added, ^changed, !note, #fixed, -removed

Requirement

**This functionality requires a glove firmware update v01.01.00 and dongle firmware update 01.01.02. This update is included in Launcher firmware bundle version 1.5.

New Firmware Update Process via Launcher (Beta)

How to Update Your Mocap Pro Glove and USB Dongle Firmware via the StretchSense Launcher

Legacy Firmware Update Process

Glove Firmware Update Process

Dongle Firmware Update Process

1. Introduction

This document describes the new features, improvements and bug fixes included in software update 1.5.2 for Hand Engine

 

2. Main Features and Improvements

File Name Change to Recorded Files**

^ For both the files recorded to the PC and the SD card, when a recording is created, a date folder is created in the Captures folder. Every recording on that date produces a Take folder. The Take folder includes all files recorded for that take including FBX files, raw CSV files, calibration files and meta files for each performer for each active glove.

+ All files will have the Performer name appended to the file. For example, if there is a recording for a performer named John the files will be saved as P1L_John.FBX or P1R_John.FBX.

+ FBX file name is now referenced in Meta.json files. This can be used for automation purposes when reading Meta.json file.

+ Global Meta.json file added that provides information on all performers. This can be used for automation purposes when reading GlobalMeta.json file.

! File name changes in detail (PC):

  • P1: files prefixed with P1 relate to Performer 1. If you recorded with more than one performer during a take, the files will have the prefix P2, P3, etc.

  • P1L_Performer.FBX and P1R_Performer.FBX: left hand only FBX and right hand only FBX respectively, as recorded in Hand Engine.

  • P1FullBody_Performer.FBX: left and right hand data recorded onto a single full-body skeleton, as recorded in Hand Engine.

  • P1L_Performer.CAL and P1R_Performer.CAL: left hand calibration data and right hand calibration data respectively.

  • P1L_Performer.CSV and P1R_Performer.CSV: left hand raw data and right hand raw data respectively.

  • P1LMeta_Performer.JSON and P1RMeta_Performer.JSON: left hand metadata and right hand Metadata data respectively, includes information about time and date of take, take name, file references and all settings used.

  • TakeNameGlobalMeta.JSON: contains metadata for all performers and profiles in a take, includes information about time and date of take, take name, file references, and all settings used for all performers.

! File name changes in detail (SD Card):

  • P1LSD_Performer.CSV/P1RSD_Performer.CSV: Left hand raw data and right hand raw data respectively, recorded on the SD card onboard the glove (only data for that glove is recorded).

  • P1LMetaSD_Performer.JSON/P1RMetaSD_Performer.JSON: Left hand metadata and right hand metadata respectively, recorded on the SD card onboard the glove (only data for that glove is recorded).

 

3. Minor Changes

^ Updated Knowledge Base and Support links under Help menu.

^ Updated firmware check.

^ Updated recording triggers for WiFi Bridge Application to match new firmware requirements.

^ Updated file trigger to only create one file instance when repeated start capture and stop capture signals are sent to Hand Engine.

+ Batch processing has been updated to account for the updates to file name.

^ Performer name is appended to files created from batch processing.

+ Re-enabled ability to record raw sensor capacitance data to a raw data file (raw data .csv file only) even without a glove calibration.

+ Frame rate is now streamed when remapping is enabled to fix issues when recording simultaneously in platforms like Motion Builder.

+ Force update of jam sync when connecting to source.

^ Jam synced glove timecode is now streamed via TCP instead of the Hand Engine master timecode. This reduces timing variations that might occur over the wireless transmission of data to Hand Engine.

+ Pass performer name to SD card in TAG to append performer name to files saved to SD card.

+ Added SD card status response to Logger file that prints to the console.log success or failure of recording.

+ Added SD card retry of 500ms. After 3 attempts recording will be triggered.

+ Enabled SD card recording if no calibration is present.

 

4. Bug Fixes

# Fixed an issue when using WiFi app simultaneously with SD card recording triggering that would lead to no files being recorded onto the SD card. Requires latest WiFi app available on Google Play Store.

# Fixed an issue where Hand Engine would persist upon exit and require ending processes in Task Manager.

# Fixed OptiTrack Motive timecode listener to fix buffering of timecode data.

# Ignore Vicon trigger at time events to fix an issue where if a remote system sends duplicate start record trigger commands, the system will create multiple folders with same take name and will write files to split between each folder.

# Update FPS rate to match setting in Hand Engine which fixed an issue where recorded FPS metadata was not imported when loading a FBX file into third party software.

# Fixed an issue with the character definition of the full body FBX as the character was missing 2 spine joints, left and right shoulders, neck and left and right toes.

# Fixed an issue where SD card recording did not work when the connection input was switched between the USB input and the WiFi App input without power cycling the glove.

# Fixed an issue that prevented PXFullbody.fbx from being generated if only a right glove was connected.

# Fixed an error when dealing with recording of Fullbody.fbx sometimes not working depending on whether both hands had been trained.

# Fix to add .json file extension to meta file.

 

5. Known Issues

Performance issue with the pinky splay being overly sensitive when using Express Calibration.

Switching between Express and Hybrid Mode with only an Express pose trained in your profile may lead to thumb performance issues. We recommend capturing at least 3 extra poses if intending to use Hybrid with Express Calibration tuning.

Batch exporting left and right raw files to full body FBX can on rare occasions lead to data being written on only one hand.

Clicking the Scan button does not auto-assign a COMPORT. After clicking scan the user must first select the COMPORT they would like to use from the dropdown list then click the ‘on’ switch.

When manually exporting, recorded CSV files will use the Take Name set in Hand Engine rather than the Take Name used in the CSV file name.

 

Hotfix

Hand Engine Update 1.5.1

New version

Hand Engine 1.5.1

Previous version

Hand Engine 1.5.0

Deprecated versions

Hand Engine 1.5.0

Operating system

Windows 10, 64bit

Meaning of icons

+added, ^changed, !note, #fixed, -removed

Requirement

**Batch Processing functionality requires a glove and dongle firmware update (glove firmware v01.00.19 and dongle firmware version v01.01.00). Both versions are included in Launcher firmware bundle version 1.3.

New Firmware Update Process via Launcher (Open Beta)

How to Update Your Mocap Pro Glove and USB Dongle Firmware via the StretchSense Launcher

Legacy Firmware Update Process

Glove Firmware Update Process

Dongle Firmware Update Process

 

1. Introduction

This document describes the minor changes and bug fixes included in software update 1.5.1 for Hand Engine

 

2. Minor Changes

+ Directly after completing a batch process, the Hand Engine UI is Reset.

 

3. Bug Fixes

# Fixed an issue when trying to batch export files locally recorded on the PC resulting in an error message “Cannot read property ‘calibration’ of undefined” error. Files previously recorded in 1.5.0 will be able to be batch exported in 1.5.1.

 

5. Known Issues

Attempting to Restore Session after Batch processing can lead to an infinite loading screen requiring a restart of Hand Engine (Ctrl + R)

Moderate update

 

Hand Engine Update 1.5.0

Previous version

Hand Engine Animator 1.4.0, Hand Engine Studio 1.4.0

Deprecated versions

Hand Engine Animator 1.2.1, Hand Engine Studio 1.2.1

Operating system

Windows 10, 64bit

Meaning of icons

+added, ^changed, !note, #fixed, -removed

Requirement

**Batch Processing functionality requires a glove and dongle firmware update (glove firmware v01.00.19 and dongle firmware version v01.01.00). Both versions are included in Launcher firmware bundle version 1.3.

New Firmware Update Process via Launcher (Open Beta)

How to Update Your Mocap Pro Glove and USB Dongle Firmware via the StretchSense Launcher

Legacy Firmware Update Process

Glove Firmware Update Process

Dongle Firmware Update Process

 

1. Introduction

This document describes the new features, improvements and bug fixes included in software update 1.5.0 for Hand Engine

 

2. Main Features and Improvements

Batch Processing: Automation of raw CSV files export to FBX**

+ Raw files recorded locally on your PC or recorded directly onto your gloves via SD card can be batch processed by Hand Engine into FBX files. Navigate to File>Batch Processing to access the Batch Processing tool in Hand Engine

! Only files recorded using 1.5.0 with the latest firmware can be batch processed (glove firmware v01.00.19 and dongle firmware version v01.01.00)

^ In a file structure change for files recorded locally on your PC, the default recording directory is changed to C:\Users\Public\Documents\StretchSense\Hand Engine\Captures

^ In a file structure change for files recorded on an SD Card the default recording directory is changed to D:\StretchSense\Hand Engine\Captures

^ For both the files recorded to the PC and the SD card, when a recording is created, a date folder is created in The Captures folder. Every recording on that date produces a Take folder. The Take folder includes all files recorded for that take including FBX files, raw CSV files, calibration files and meta files for each performer for each active glove during that take (see below for details)

! File name changes in detail (PC):

  • P1: Files prefixed with P1 relate to Performer 1. If you recorded with more than one performer during a take, the files will have the prefix P2, P3, etc.

  • P1L.FBX and P1R.FBX: left hand only FBX and right hand only FBX respectively, as recorded in Hand Engine.

  • P1FullBody.FBX: left and right hand data recorded onto a single full-body skeleton, as recorded in Hand Engine.

  • P1L.CAL and P1R.CAL: left hand calibration data and right hand calibration data respectively.

  • P1L.CSV and P1R.CSV: left hand raw data and right hand raw data respectively.

  • P1LMeta.JSON and P1RMeta.JSON: left hand metadata and right hand Metadata data respectively, includes information about time and date of take and all settings used.

! File name changes in detail (SD Card):

  • P1LSD.CSV/P1RSD.CSV: Left hand raw data and right hand raw data respectively, recorded on the SD card onboard the glove (only data for that glove is recorded)

  • P1LMetaSD.JSON/P1RMetaSD.JSON: Left hand metadata and right hand metadata respectively, recorded on the SD card onboard the glove (only data for that glove is recorded)

! For detailed information on Batch Processing please refer to the KnowledgeBase how-to-guide on Batch Processing

Express Model Performance Upgrade

+ 25% performance gain in the number of poses that can be reliably recreated with an Express calibration

+ Thumb performance improvement with reduced clipping

Preview Feature: Calibration Tuning with Additive Poses in Hybrid Mode

+ In Hybrid Mode, captured pose calibrations can now be added to Express calibrations. Using this method, Hybrid Mode can be used to fine tune Express calibrations

+ By first creating an Express calibration as a base for your continuous movement, the user can then add individual poses by ticking the Blend checkbox for each pose they wish to add. Users can check, uncheck or delete poses as they wish. To apply the changes, users must then click the Hybrid button in the Output section. Without this step, the changes will not be applied

Hand Engine Animator and Studio consolidated into a single Hand Engine license type from 1.5.0 onwards

+ From 1.5 onwards our two license types, Hand Engine Animator and Studio, are consolidated into one, simplifying our licensing model for customers. Previously, Hand Engine Animator license allowed for two pairs of gloves and Hand Engine Studio allowed six pairs of gloves

+ With the new license, you will be able to pick how many pairs of gloves you would like, between two and six pairs. This change provides you with more flexibility

+ For Hand Engine Animator users, the change will be applied in the background and it will not have any impact on their Hand Engine experience

+ For Hand Engine Studio users, you will have already been provided with an updated Hand Engine license on your StretchSense account for use with Hand Engine 1.5 or later. Your existing Hand Engine Studio license can still be used to access older versions of Hand Engine Studio

 

3. Other Minor Changes

+ A confirmation prompt has been added for when users choose to delete a performer or profile, providing the option to confirm or cancel the decision to permanently delete a profile or performer

^ File, Settings and Help menu UI text contrast has been improved

^ Remapping wizard text instructions have been updated

^ License activation page now directs users to support@stretchsense.com rather than sales@stretchsense.com

Due to file structure changes, the ability to customize the Take Name Format in Settings>Preferences for the files being saved has been removed

 

4. Bug Fixes

# Fixed an issue when importing a performer from a JSON file and the right hand calibration would not work, giving an error message saying: “Please create an Performer, profile and connect your gloves before Calibrating”

# When loading the .csv file to export to FBX without adding the Performer and Profile, the error message “Device not trained yet” has changed to “Please make sure the Performer, Profile, and Output mode are selected before exporting to FBX”

# During playback from .csv file without the Performer and Profile, the error message “{“status”:”Device source not currently set to file mode”}” has changed to “Please select the Performer and Profile before playback is triggered”

 

5. Known Issues

Batch Exporting left and right raw files to Full Body FBX can on rare occasions lead to data being written on only one hand

If any remote system sends duplicate start trigger commands the system will create multiple folders with same take name but will write to only one folder

Clicking the scan button does not auto-assign a COMPORT. After clicking scan the user must first select the COMPORT they would like to use from the dropdown list then click the ‘on’ switch

When manually exporting, recorded CSV files will use the Take Name set in Hand Engine rather than the Take Name used in the CSV file name

Moderate update

 

Hand Engine Update 1.4.0

Previous version

Hand Engine Animator 1.3.0, Hand Engine Studio 1.3.0

Deprecated versions

Hand Engine Animator 1.2.0, Hand Engine Studio 1.2.0

Operating system

Windows 10, 64bit

Meaning of icons

+added, ^changed, !note, #fixed, -removed

Requirement

FBX functionality requires latest firmware version for glove (v1.0.17) and dongle (v1.0.12)

New Firmware Update Process via Launcher (Open Beta)

How to Update Your Mocap Pro Glove and USB Dongle Firmware via the StretchSense Launcher

Legacy Firmware Update Process

Glove Firmware Update Process

Dongle Firmware Update Process

 

 

1. Introduction

This section describes the new features, improvements and bug fixes included in software update 1.4.0 for Hand Engine. Update Hand Engine by logging in and downloading the installer files from your account.

 

2. Major Enhancements and Features

+Hand Engine User Interface now arranged by performer, not by glove
  • Hand Engine Interface improved to simplify performer setup
  • Pairs of gloves now appear under a single performer panel to simplify workflow

  • Users are presented with a more focused setup view. This includes performer setup, left and right glove connection, express calibration and streaming options

  • Additional controls are accessible via the expandable “Advanced Calibration Options” button. Additional options include Captured Poses, Blend, Pose and Hybrid Mode Settings, Glove Timecode and SD Card Options

  • Profiles for left and right hands are auto-populated upon creating a Performer

  • A sensor indicator was added per device. This allows users to monitor multiple active performers simultaneously (provides summed sensor output from all sensors in active glove)

  • <p”>Scene and Object Tab hidden from default view. “Edit Pose” button available to access bone hierarchy and local rotations</p”>
+ Express Calibration tutorial video has been included in-software to guide users through the Express Calibration process

 

3. Other Features

+Connection type selectors for USB, File and Network have been replaced with SVG Icons

+Actor replaced by Performer in all instances

+Character section replaced with Left and Right groups

+Remap feature moved into Streaming section

+Preview button replaced with Live/Pose toggle in Hand Engine Viewport

+Serial and firmware info can be found by hovering over the “Information/i” icon on each device panel

+Ability to choose to export Left Device Calibration Profile or Right Device Calibration Profile. Located under File>Export Calibration Left and File>Export Calibration Right

+Message displayed when user clicks Add Pose. Identifies to user which hand model was used as the pose template

+FBX Recording toggle updated from Hands Only/Full Body to Hands/Body

+If “use remote trigger system take location” is set to on in Settings>Preferences, a backup of recorded files will still be saved in the default recording location save directory set by the user

– Removed left and right hand selector from individual devices

– TCP connection removed from Network Input (only UDP connection is used for beta Wi-Fi bridge Android App)

-Snap proximity UI element removed

 

4. Bug Fixes

# Error message displayed when you choose a recording location save directory that does not exist

# Error message displayed when SD card not found

# Fixed white screen error in Hand Engine 1.3.0 when setting IP binding

# If “use remote trigger system take location” is set to on in Settings>Preferences and the directory doesn’t exist an error message is displayed to inform the user the save directory does not exist

 

5. Known Issues

Clicking the scan button does not auto-assign a COMPORT. After clicking scan the user must first select the COMPORT they would like to use from the dropdown list then click the on switch

Master timecode stream only updates when at least one glove is connected. Timecode will update as soon as a connection with the glove is re-established

Manual export of recorded CSV file will use Take Name set in Hand Engine rather than the Take Name used in the CSV file name.52

Moderate update

Hand Engine Update 1.3.0

1. Major Enhancements and Features

  • Option to export recording to full body FBX or two individual hand FBX
    Allows flexibility in regard to how the FBX data can be integrated into different offline workflows for merging hand and body data in third party software.
  • Migration of Hand Engine to Standalone Application
    Run Hand Engine without the need for a Chromium-based browser e.g. Chrome or Edge.
  • New Express calibration model
    New model with improved performance. Improved splay behavior during finger bend.

! This feature will require the same update to glove and dongle firmware as in Hand Engine 1.2.0.

Learn how to update your firmware:

 

2. Other Features

  • Preview Feature: Hand Engine streams out Pose information
    Pose ID, Pose Name, Pose Confidence and Active State for key Poses in Pose Detection and Hybrid Mode via TCP Stream. Updated Unreal Engine, Unity3D, MotionBuilder and Maya Plugins can receive this information:
    • Unreal Plugin 01.00.05 (please note this plugin has also been updated for UE 4.27)
    • MotionBuilder Plugin 01.00.17
    • Unity Plugin 01.00.03
    • Maya Plugin 01.00.02
      Login to your account for the latest plugins.
  • Raw data files (CSV files) include column headers for joint angle information.
  • Set default Express Calibration time to 15s (for existing users this will not change the timer settings they have already set).
  • Warning pop-up when glove and dongle firmware is out of date. Warns user that recording of data may be corrupted if firmware is out of date

 

3. Bug Fixes

  • OptiTrack Timecode fixed when Motive and Hand Engine running on same PC.
  • UI added to set OptiTrack Local IP Address for listening to Timecode from Motive.
  • SD Card Recorded CSV Files can now be exported into an FBX via File Playback.

 

4. Known Issues

Manual export of recorded CSV file will use Take Name set in Hand Engine rather than the Take Name used in the CSV file name.

Minor update 

Version 1.2.1 (Hotfix)

Improvements

Bug fixes

  • FBX now Exports encoded with the TakeName set in Hand Engine instead of exporting with Take001 every time
  • Captured poses are now visible not blank upon loading a session

Requirements

Requires latest firmware version for Glove (v1.0.17) and Dongle (v1.0.12)

Learn how to update your firmware:

Moderate update

Version 1.2: Improved support for optical systems, auto jam sync, Express Calibration improvements

Major improvements and features

  • Streaming Hand Engine data over the network to a computer running MVN Animate Pro or Plus (via UDP). User can set the IP address of the computer running MVN in Hand Engine.
  • New Express calibration – new model with improved performance, especially in regard to thumb and splay movement.
  • Simplified and expanded timecode synchronization for optical systems (Vicon Shogun and OptiTrack Motive).
  • Improved timecode synchronization via wireless jam sync. Gloves can be synced from within Hand Engine. Reduces drift and the need for mechanical devices like UltraSync One to be plugged into the glove.
  • FBX recording changes: adjustable frame rates that conform with industry standards.

Minor changes

  • Remapping: ability to set binding pose of target asset to L-Pose or Paddle Pose. Previously target asset had to be in L-Pose.
  • How to Guides link in Hand Engine updated to new Knowledge Base.

Bug fixes

  • Crash during trigger of multiple devices resolved (bug fix)
  • Fix to align keys with frames (bug fix).

Known issues

  • Loading a session doesn’t load user changes to Xsens Streaming IP Address, Remapping settings.
  • UI: Multicast/Unicast dropdown menu is misaligned on different sized monitors.
  • When loading a Saved Session the captured poses for the profile loaded is missing. They reappear if you change between profiles.

Requirements

Requires latest firmware version for Glove (v1.0.17) and Dongle (v1.0.12)

Learn how to update your firmware:

Previous Hand Engine release notes

Versions: