Skip to content

Visual Domain Knowledge-based Multimodal Zoning Textual Region Localization in Noisy Historical Document Images

Notifications You must be signed in to change notification settings

chulwoopack/gravity-map

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

28 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Visual Domain Knowledge-based Multimodal Zoning for Textual Region Localization in Noisy Historical Document Images

This repository contains the implementation of zoning solution based on multimodal approach using our novel visual representation, Gravity-map. The model predicts textual regions in a set of closed polygons on a document image. The underlying CNN models used in our solution is dhSegment and FPN.

The detail of this work can be found in the corresponding paper.

Overview of Our Approach

fusion_approach

Step-by-Step Process to Build Our Gravity-map

Step 1: Oversegment image using Voronoi-tesselation Step 2: Compute geometric feature, gravity Step 3: Construct Gravity-map

Resultant Samples of Zoning

resultant_sample

About

Visual Domain Knowledge-based Multimodal Zoning Textual Region Localization in Noisy Historical Document Images

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published