Feature request: For automation, add more defaults (and ideally, an all option for some) for generate sources

[jaredx435k2d0]

Is your feature request related to a problem? Please describe.
I'm trying to run generate sources automatically via cron on a virtual machine. But, from what I can tell, there isn't a way to suppress some of the prompts (choose relations, flatten JSON, etc.).
It also seems that I have to hardcode the schemas I'd like, using config.yml.

Describe the solution you'd like
I'd like a simple way to be able to generate sources for all relations in a schema, and for all schemas in a database.
I'd like to be able to have the following in my config

• "all" for schemas
• "all" for relations"
• a default for flattening JSON
• an default update strategy for existing staging models

Describe alternatives you've considered
Not being able to automate it. Closest I've come is by hard coding my schemas in config.yml and then still needing to execute manually so I can interact with the prompts.

[BAntonellini]

@jaredx435k2d0 we've just added a new --no-prompt flag to dbt-coves generate commands (sources, properties and metadata). Check it out in our newest a28 version

This allows you to automate the creation of resources, alongside the usage of already existent flags/args.

For example, the following would generate all sources in all schemas on your DB:

dbt-coves generate sources --schemas "*" --no-prompt

It will auto-flatten and generate all the resulting resources with the filter(s) you use.

A more complex filtering:

dbt-coves generate sources --schemas "my_schema" --select-relations "prefix_*" --update-strategy recreate --no-prompt

[jaredx435k2d0]

This is awesome! I'm planning to use some dbt-coves commands in a regular automation, so this will be perfect.

Just to be clear, there is currently no way to choose to have it NOT flatten JSON, is that correct?

[jaredx435k2d0]

Can you please explain the new recreate option? Does that delete and recreate, as in I'd lose any existing documentation? Or would it retain that, but just "recreate" in the sense that it refreshes / would now not include any items deleted since the last execution?