Skip to content

Human pose estimation using hour-glass architecture and Tensorflow 2.0

Notifications You must be signed in to change notification settings

borarak/human-pose-estimation

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

11 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Human-pose-estimation

This repository contains my own experiments, research, reproductions of state-of-the-art human pose estimation.

TODO list

  • Vanilla hour-glass networks with stacking, trained from scratch (no transfer learning)
  • Step/cyclic learning rates (experimental)
  • Gaussian smoothed labels
  • More data augumentation
  • Gated skip connections
  • Add data preparation steps
  • Optimise for real-time inference speeds

Dataset

Currently, i have used the COCO person keypoints dataset to train. Since this is a multi-person dataset, there is a preparation step to extract single persons.

To prepare the data, follow the prepare_verify_dataset.ipynb notebook. This notebook crops out every person instance from the COCO dataset using the person bounding boxes and creates new annotations from them. Since our goal is to do single person pose estimation, it's important that each trainng image has one centered person. In some cases, it's not possible to have only person, in that case the algorithm is nudged to concentrate on the centered and focussed person. During inference times, a person object detector can be used first detect each person instance in the image and subsequently feed that detection to the pose model. There are ways to do dense human pose estimation ofcourse but that's not the focus of this repository.

Train

An example experiment exists in experiments/hourglass_stack1.sh

  1. Replace the directory configurations inside the script.

  2. To train call one of the experiments as follows or create your own

    ./experiments/hourglass_stack1.sh

Results

sample1.png

sample2.png

sample3.png

Support

In case you are interested in support or collaboration, send me a message on LinkedIn