Package detail

jp.ikep.mediapipe.holistic

creativeIKEP86Apache-2.01.1.0

Mediapipe Holistic for Unity Barracuda.

unity, Barracuda, Mediapipe, Holistic

readme

HolisticBarracuda

full

full

pose_and_face

pose_and_face

pose_and_hand

pose_and_hand

pose_only

pose_only

face_only

face_only

HolisticBarracuda is the Unity Package that simultaneously estimates 33 pose, 21 per-hand, and 468 facial landmarks with a monocular color camera only.

HolisticBarracuda runs the pipeline simular to Mediapipe Holistic on the Unity.

Dependencies

HolisticBarracuda uses the following packages:

Used source codes

Parts of face and hands implementations used many keijiro's below source codes. Thanks!

Install

HolisticBarracuda can be installed by adding following sections to your manifest file (Packages/manifest.json).

To the scopedRegistries section:

{
    "name": "Keijiro",
    "url": "https://registry.npmjs.com",
    "scopes": [ "jp.keijiro" ]
},
{
  "name": "creativeikep",
  "url": "https://registry.npmjs.com",
  "scopes": [ "jp.ikep" ]
}

To the dependencies section:

"jp.ikep.mediapipe.holistic": "1.1.0"

Finally, the manifest file looks like below:

{
    "scopedRegistries": [
        {
            "name": "Keijiro",
            "url": "https://registry.npmjs.com",
            "scopes": [ "jp.keijiro" ]
        },
        {
            "name": "creativeikep",
            "url": "https://registry.npmjs.com",
            "scopes": [ "jp.ikep" ]
        }
    ],
    "dependencies": {
        "jp.ikep.mediapipe.holistic": "1.1.0",
        ...
    }
}

Usage Demo

This repository has the demo that inference pose, face and hands landmarks, and visualize landmarks.

Check a Unity scene, scripts and shaders in the "/Assets" directory.

Demo image

Videos for demo was downloaded from pexels.

Author

IKEP

LICENSE

Copyright (c) 2021 IKEP

Apache-2.0

changelog

[1.1.0] - 2022-09-25

  • Update BlazePose version
  • Fixed an issue that estimation was not performed correctly when the color space was Liner.
  • Automatically load HolisticResource asset data. The constructor arguments are not required.
  • Add new methods (GetPoseLandmark, GetPoseWorldLandmark, GetFaceLandmark, GetLeftEyeLandmark, GetRightEyeLandmark, GetLeftHandLandmark and GetRightHandLandmark) for accessing data with CPU (C#).
  • Add detection score variables (faceDetectionScore, leftHandDetectionScore and rightHandDetectionScore)
  • Improve the stability of hand estimation.

[1.0.1] - 2021-10-06

This is the first release of creativeIKEP/HolisticBarracuda(jp.ikep.mediapipe.holistic).