Support json logging in Lambda

[mbertrand-kintsugi]

Is there an existing issue for this?

• I have searched existing issues, it hasn't been reported yet

Use case description

JSON logging is widely considered the standard way to emit log information. Especially to logging search and aggregation systems based on the ELK stack. We rely heavily on detailed logging information in order to understand and troubleshoot errors that happen during our rather large/intricate batch process. Having the ability to include "more than a string" of data is crucial for us. We emit our Python logs in json format using the AWS Powertools log formatter. We have configured our Cloud Watch Subscription Filters to read and pipe json formatted data to AWS Open Search. But we discovered that there was another setting for the Lambda itself that is set to Plain Text by default. We would like it if we could emit all our logs in JSON format.

Proposed solution (optional)

Support LoggingConfiguration options for Lambdas. Enable json by default since it is the (other) commonly accepted format by most logging systems. It is also going to be the default in aws as of Jan 1.

[fnunezkanut]

+1
Was about to open an issue for this new feature that i think was added last few weeks :)

[mbertrand-kintsugi]

Probably could be folded into #12264