Village data collection #28

dhruv-1001 · 2024-01-27T07:39:49Z

Visit onlinemaps.surveyofindia.gov.in

Update your profile.

Select Click to buy

Select State & Dist you want to download data for. Keep adding till you have added all the districts for a state.

Place order on next screen. Download data one-by-one.

Data downloaded will be in .zip format, with file names as such

Village Boundary Database.zip
Village Boundary Database (1).zip
Village Boundary Database (2).zip
... and so on

Extract these files
You will have .gdb folders for districts you have downloaded as such

AGRA.gdb
ALIGARH.gdb
PRAYAGRAJ.gdb
... and so on

Now convert these files to .zip, to have files like this

AGRA.zip
ALIGARH.zip
PRAYAGRAJ.zip
... and so on
.zip to be created using this tool.

Now that you have .zip files for all districts of a state. You now need to upload these files to this repository using git lfs.

How to upload `.zip` files using `git lfs`

Make sure you have git lfs installed. Follow instructions provided here.

Once you have installed git lfs. Add everything you have downloaded, inside server/geojson-data/indian_village_boundaries.zip/ folder inside of a folder named after the state you have downloaded village data for.
Following the example above, it would look like such.

indian_village_boundaries.zip
- uttar_pradesh
  - AGRA.zip
  - ALIGARH.zip
  - PRAYAGRAJ.zip

Once you have files in this file structure, follows this documentation to add downloaded files using git lfs.

Once you are done, open up a PR to this repository

List to track data collection progress

Note: Comment on this issue if you are interested. And i'll create and assign the state ticket for you.

The text was updated successfully, but these errors were encountered:

sagarkori143 · 2024-01-31T07:07:27Z

Hi @dhruv-1001 👋 I want to work on this. Please assign this to me. Thanks!

jainvedant392 · 2024-01-31T07:09:10Z

Hey @dhruv-1001 , I would like to contribute to this issue. Could I start working on it?

younome71 · 2024-01-31T07:13:13Z

Hey @dhruv-1001, I would like to contribute to this issue

the-dg04 · 2024-01-31T07:13:44Z

Hey @dhruv-1001 , I would like to contribute to this issue. Can you please assign it to me?

ChakshuGautam · 2024-01-31T07:34:15Z

Hey please raise PRs state-wise we will merge them as they are ready. Thanks.

Please don't wait for it to be assigned.

dhruv-1001 · 2024-01-31T08:21:38Z

Hey all, just mention for what states you will be uploading the data for. So that everyone have a different state.

kumarguddu609 · 2024-01-31T08:23:10Z

Hey @dhruv-1001 I am doing BIHAR

dhruv-1001 · 2024-01-31T08:24:13Z

Please select the one that we don't already have data for. Do refer the checklist.

kumarguddu609 · 2024-01-31T08:25:27Z

okay

Biswapremsahu77 · 2024-01-31T08:39:55Z

Hey @dhruv-1001 i want to work on this, and i can take tamil nadu.

the-dg04 · 2024-01-31T08:45:00Z

Hey @dhruv-1001 i would like to do Andaman and Nicobar

sagarkori143 · 2024-01-31T08:47:00Z

Ok @dhruv-1001 . I am taking the UP 🤩

masterismail · 2024-01-31T10:08:39Z

will do it for Telangana !

edit : data isn't available for any district of Telangana

rd-sharma7 · 2024-01-31T11:51:59Z

@dhruv-1001 I checked a checklist & Will upload data for Madhya Pradesh.
inlast can I mention you ,if a doubt pop up there on comment or discord??

sagarkori143 · 2024-01-31T12:38:24Z

Hey @dhruv-1001 . I am not able to locate this folder

Can you please help me in uploading the data

dhruv-1001 · 2024-01-31T12:42:22Z

@sagarkori143, it doesn't exists. Just create dir along this path ./server/geojson-data/indiain_village_boundaries.zip/

sagarkori143 · 2024-01-31T12:43:52Z

Okay Dhruv! Thanks!

vilol-04 · 2024-01-31T13:49:15Z

hey @dhruv-1001 . I am interested to work on this issue. I'll be working for Chandigarh.

kumarguddu609 · 2024-01-31T14:20:19Z

Hey @dhruv-1001
It gets error: can not upload new objects to public fork, when try to push git LFS objects to forked repository as github says

You can push Git LFS objects to public forks if the repository network already has Git LFS objects or you have write access to the root of the repository network.
git-lfs/git-lfs#1906

younome71 · 2024-01-31T18:58:07Z

Hey @dhruv-1001, I will do for Punjab

dhruv-1001 · 2024-02-01T04:34:29Z

will do it for Telangana !

edit : data isn't available for any district of Telangana

You can go ahead with some other state!

dhruv-1001 · 2024-02-01T04:36:00Z

Hey @dhruv-1001 It gets error: can not upload new objects to public fork, when try to push git LFS objects to forked repository as github says

You can push Git LFS objects to public forks if the repository network already has Git LFS objects or you have write access to the root of the repository network.
git-lfs/git-lfs#1906

It seems to work for me. Here is an example PR. Can you list out what all steps are you following?

rd-sharma7 · 2024-02-04T12:31:12Z

Hey @dhruv-1001 , I just stuck while pushing a geojson-data folder inro server , I already added this folder haiving all district data on my laptop folder you can see a tree of it there:

I don't know why in tree ,files of Madhya_Pradesh folder not present I added.

sagarkori143 · 2024-02-04T16:14:44Z

Hey @dhruv-1001 , I just stuck while pushing a geojson-data folder inro server , I already added this folder haiving all district data on my laptop folder you can see a tree of it there:

I don't know why in tree ,files of Madhya_Pradesh folder not present I added.

Check out the git ignore file if you are ignoring these files while pushing.

rd-sharma7 · 2024-02-05T12:37:18Z

Thanks @sagarkori143 . your hint worked.

jainvedant392 · 2024-02-05T16:06:21Z

Hey @dhruv-1001, currently the data for meghalaya and arunchal pradesh is unavailable. So I'll make the pull request as soon as they are available. Thanks.

Hey @dhruv-1001, for the time being, I am doing haryana. Regards, Vedant.

jainvedant392 · 2024-02-05T19:58:22Z

Hey @dhruv-1001 , I have created the PR for Haryana state. It would be delightful if you could make an issue for it and also attach the C4GT community label to it. Thank you.

dhruv-1001 · 2024-02-13T11:46:12Z

Hey @dhruv-1001, currently the data for meghalaya and arunchal pradesh is unavailable. So I'll make the pull request as soon as they are available. Thanks.

Hey @dhruv-1001, for the time being, I am doing haryana. Regards, Vedant.

Data for meghalaya & arunanchal pradesh is now available. Comment on tickets, and i'll assign those issues to you.
Edit: just checked, it says product is not available. Will have to wait until it's available.

Biswapremsahu77 · 2024-02-13T11:52:29Z

Hey @dhruv-1001 i can do meghalaya and arunachal pradesh. You can assign it to me

Ashurajput02 · 2024-02-13T11:55:45Z

Hey @dhruv-1001, currently the data for meghalaya and arunchal pradesh is unavailable. So I'll make the pull request as soon as they are available. Thanks.

Hey @dhruv-1001, for the time being, I am doing haryana. Regards, Vedant.

Data for meghalaya & arunanchal pradesh is now available. Comment on tickets, and i'll assign those issues to you. Edit: just checked, it says product is not available. Will have to wait until it's available.

I can do for arunachal pradesh

Biswapremsahu77 · 2024-02-14T08:29:52Z

Hey @dhruv-1001 , Can you please open an issue for Odisha as well? You can assign it to me.

zeel991 · 2024-02-14T10:17:13Z

Hey @dhruv-1001 , Can you please open an issue for Odisha as well? You can assign it to me.

Odisha is already ticked in the Description if scenario was not so , I have prepared all the states data without an issue raised , except of those whose data isnt available

Biswapremsahu77 · 2024-02-14T10:31:42Z

Ohh sorry , i didn't see that...😅😅😅, But why isn't its shown in the indian_village _boundaries folder?? @zeel991

zeel991 · 2024-02-14T10:43:34Z

Ohh sorry , i didn't see that...😅😅😅, But why isn't its shown in the indian_village _boundaries folder?? @zeel991

No clue about that , but if the files are required , I am just a push command away to resolve the issue

Biswapremsahu77 · 2024-02-14T10:45:46Z

Okkk..Great👍👍👍 @zeel991

irfan-iiitr · 2024-03-16T08:19:10Z

@zeel991 can i work on J&K.

sagarkori143 · 2024-03-16T08:26:21Z

@zeel991 can i work on J&K.

Did you check whether data is available for J&K or not?

irfan-iiitr · 2024-03-16T08:28:38Z

@zeel991 yess some of the data of districts are available

zeel991 · 2024-03-16T08:32:32Z

@zeel991 can i work on J&K.

Did you check whether data is available for J&K or not?

Data of some of the districts is available , data of other districts isn't there yet

zeel991 · 2024-03-16T08:34:55Z

@zeel991 can i work on J&K.

You can go ahead , but i would say to wait until data of all the districts is available , as currently it would solve the issue partially

irfan-iiitr · 2024-03-16T08:37:39Z

@zeel991 would like to go ahead , when the rest of the data will be available pushing it will be just a click away

zeel991 · 2024-03-16T08:39:33Z

@zeel991 would like to go ahead , when the rest of the data will be available pushing it will be just a click away

Sure! , I would go for Arunachal Pradesh and Meghalaya whenever data is available

sagarkori143 · 2024-03-16T09:14:12Z

@zeel991 would like to go ahead , when the rest of the data will be available pushing it will be just a click away

Hey @irfan-iiitr Before going ahead with this let me know how many of the total are available there.

irfan-iiitr · 2024-03-16T09:16:09Z

@sagarkori143 6 out of 14 are available

Harish-2003 · 2024-03-20T02:54:17Z

Hey @dhruv-1001 can i work on goa? and also i created an issue and pull request at #141 #142

dhruv-1001 added the draft-issue label Jan 27, 2024

dhruv-1001 mentioned this issue Jan 27, 2024

Add Script to convert .gdb to geoJSON #30

Closed

dhruv-1001 closed this as completed Jan 30, 2024

dhruv-1001 reopened this Jan 31, 2024

dhruv-1001 added C4GT Community and removed draft-issue labels Jan 31, 2024

kumarguddu609 mentioned this issue Jan 31, 2024

fix: add puducherry to village_database #33

Closed

dhruv-1001 mentioned this issue Feb 1, 2024

chore: added uttar_pradesh/AGRA.zip #35

Closed

rd-sharma7 mentioned this issue Feb 5, 2024

Village Data Collection - Madhya_Pradesh #82

Closed

zeel991 mentioned this issue Feb 5, 2024

Added all Files of Uttarakhand #84

Closed

rd-sharma7 mentioned this issue Feb 5, 2024

Added all files of MadhyaPradesh #85

Closed

jainvedant392 mentioned this issue Feb 5, 2024

Add all files for Haryana. #87

Merged

vilol-04 mentioned this issue Feb 9, 2024

Village Data Collection - CHANDIGARH #100

Closed

Gauravdcap mentioned this issue Feb 11, 2024

added punjab_geodata #102

Merged

Biswapremsahu77 mentioned this issue Feb 12, 2024

Added files for Tamil Nadu State #106

Merged

Village data collection #28

Village data collection #28

Comments

dhruv-1001 commented Jan 27, 2024 • edited

How to upload .zip files using git lfs

sagarkori143 commented Jan 31, 2024 • edited

jainvedant392 commented Jan 31, 2024

younome71 commented Jan 31, 2024

the-dg04 commented Jan 31, 2024

ChakshuGautam commented Jan 31, 2024 • edited

dhruv-1001 commented Jan 31, 2024

kumarguddu609 commented Jan 31, 2024

dhruv-1001 commented Jan 31, 2024

kumarguddu609 commented Jan 31, 2024

Biswapremsahu77 commented Jan 31, 2024

the-dg04 commented Jan 31, 2024

sagarkori143 commented Jan 31, 2024 • edited

masterismail commented Jan 31, 2024 • edited

rd-sharma7 commented Jan 31, 2024 • edited

sagarkori143 commented Jan 31, 2024

dhruv-1001 commented Jan 31, 2024 • edited

sagarkori143 commented Jan 31, 2024

vilol-04 commented Jan 31, 2024 • edited

kumarguddu609 commented Jan 31, 2024

younome71 commented Jan 31, 2024

dhruv-1001 commented Feb 1, 2024

dhruv-1001 commented Feb 1, 2024

rd-sharma7 commented Feb 4, 2024 • edited

sagarkori143 commented Feb 4, 2024

rd-sharma7 commented Feb 5, 2024

jainvedant392 commented Feb 5, 2024

jainvedant392 commented Feb 5, 2024

dhruv-1001 commented Feb 13, 2024 • edited

Biswapremsahu77 commented Feb 13, 2024

Ashurajput02 commented Feb 13, 2024

Biswapremsahu77 commented Feb 14, 2024

zeel991 commented Feb 14, 2024 • edited

Biswapremsahu77 commented Feb 14, 2024 • edited

zeel991 commented Feb 14, 2024 • edited

Biswapremsahu77 commented Feb 14, 2024 • edited

irfan-iiitr commented Mar 16, 2024

sagarkori143 commented Mar 16, 2024

irfan-iiitr commented Mar 16, 2024

zeel991 commented Mar 16, 2024

zeel991 commented Mar 16, 2024 • edited

irfan-iiitr commented Mar 16, 2024

zeel991 commented Mar 16, 2024

sagarkori143 commented Mar 16, 2024

irfan-iiitr commented Mar 16, 2024

Harish-2003 commented Mar 20, 2024

dhruv-1001 commented Jan 27, 2024 •

edited

How to upload `.zip` files using `git lfs`

sagarkori143 commented Jan 31, 2024 •

edited

ChakshuGautam commented Jan 31, 2024 •

edited

sagarkori143 commented Jan 31, 2024 •

edited

masterismail commented Jan 31, 2024 •

edited

rd-sharma7 commented Jan 31, 2024 •

edited

dhruv-1001 commented Jan 31, 2024 •

edited

vilol-04 commented Jan 31, 2024 •

edited

rd-sharma7 commented Feb 4, 2024 •

edited

dhruv-1001 commented Feb 13, 2024 •

edited

zeel991 commented Feb 14, 2024 •

edited

Biswapremsahu77 commented Feb 14, 2024 •

edited

zeel991 commented Feb 14, 2024 •

edited

Biswapremsahu77 commented Feb 14, 2024 •

edited

zeel991 commented Mar 16, 2024 •

edited