PoseLandmarkBarracuda

PoseLandmarkBarracuda is a human pose landmark detecter that runs the Mediapipe Pose Landmark neural network model on the Unity Barracuda.

PoseLandmarkBarracuda implementation is inspired by HandLandmarkBarracuda and I referenced his source code.(Thanks, keijiro!).

Install

PoseLandmarkBarracuda can be installed with npm or GitHub URL.

Install from npm (Recommend)

PoseLandmarkBarracuda can be installed by adding following sections to the manifest file (Packages/manifest.json).

To the scopedRegistries section:

{
  "name": "creativeikep",
  "url": "https://registry.npmjs.com",
  "scopes": [ "jp.ikep" ]
}

To the dependencies section:

"jp.ikep.mediapipe.poselandmark": "1.1.1"

Finally, the manifest file looks like below:

{
    "scopedRegistries": [
        {
            "name": "creativeikep",
            "url": "https://registry.npmjs.com",
            "scopes": [ "jp.ikep" ]
        }
    ],
    "dependencies": {
        "jp.ikep.mediapipe.poselandmark": "1.1.1",
        ...
    }
}

Install from GitHub URL

PoseLandmarkBarracuda can be installed by adding below URL on the Unity Package Manager's window

https://github.com/creativeIKEP/PoseLandmarkBarracuda.git?path=Packages/PoseLandmarkBarracuda#v1.1.1

or, adding below sentence to your manifest file(Packages/manifest.json) dependencies block.

"jp.ikep.mediapipe.poselandmark": "https://github.com/creativeIKEP/PoseLandmarkBarracuda.git?path=Packages/PoseLandmarkBarracuda#v1.1.1"

Demo Image

Demo image was downloaded from here.

ONNX Model

The ONNX model files have been converted for Unity Barracuda from Mediapipe's "pose_landmark_full.tflite" and "pose_landmark_lite.tflite" file. The ONNX model files were converted with tflite2tensorflow and tf2onnx.

Author

IKEP

LICENSE

Copyright (c) 2021 IKEP

Apache-2.0

[1.1.1] - 2022-01-09

• Supported ComputeBuffer input.
• Set the default value of the PoseLandmarkModel type argument to PoseLandmarkModel.full.

[1.1.0] - 2021-07-21

• Support 3D world landmarks of MediaPipe Pose v0.8.6

[1.0.1] - 2021-05-30

• Fixed a bug where human's visibility score could not be obtained correctly.
• Fixed the output segmentation's RenderTexture format from RenderTextureFormat.RFloat to RenderTextureFormat.ARGB32.

[1.0.0] - 2021-05-17

This is the first release of creativeIKEP/PoseLandmarkBarracuda(jp.ikep.mediapipe.poselandmark).