Automatically load "datapackage.json" when supplied a path to a folder

[khusmann]

A lot of frictionless implementations automatically load datapackage.json when reading a directory. It'd be nice to go

read_package("/path/to/packagedir")

instead of always

read_package("/path/to/packagedir/datapackage.json")

[peterdesmet]

Would be useful, but it is a bit more complex than:

• Check if the provided path (or URL) ends with datapackage.json
• If not, append datapackage.json with file.path()
• Return error if that file could not be found

datapackage.yml and datapackage.yaml files are also valid, so we need to check if the provided file path has this. If not, we'll have to assume a datapackage.json file, potentially missing a datapackage.yml file. Maybe we could check for those files as well before reporting an error.

I think that is why I initially chose the verbose approach, especially since tab completion when writing the path immediately provides feedback on whether a file is present.

[peterdesmet]

I'm curious to see how other frictionless software tackles this.

[khusmann]

Ah, makes sense! I was wondering about that yaml stuff -- I saw yaml export functions in frictionless-py but so far have not seen a datapackage.yaml in the wild, so I was running with the assumption that the datapackage.json was the defacto standard.

The collections in the datahub were initially confusing to me to get working with frictionless-r because there was no direct link to the datapackage.json in their file listing (here, for example). The default behavior of their data-cli tool points to the root URL of the package though, and I found adding /datapackage.json did the trick.

I think it's nice (for new users especially) to be able to treat the datapackage as a sort of opaque blob they can load resources from (like tabs in an excel file), without needing to think about the internal structure -- it also facilitates distributing packages as self-contained zip files.

[peterdesmet]

@khusmann Thanks for investigating. datapackage.json is the only valid format according to the specs, but yml/yaml is supported by frictionless-py and it was requested and implemented as a feature for frictionless-r. I think for guessing a file, it's fine to follow frictionless-py (and the specs) and only look for a datapackage.json. I'll try to get your PR included in the next version.