LocalStack version 0.14.0

LocalStack release 0.14.0

Announcements

• Breaking changes:
  • This version introduces the external service port range in LocalStack. This port range has been used in LocalStack Pro before, but has now been moved to the community edition. While doing so, the port range has been broadened (it now ranges from 4510 to 4559). Please make sure to adjust your Docker configurations to expose this port range (such that external services started within the container can be reached) or use the latest version of the LocalStack CLI to manage your LocalStack container.
  • When using ElasticSearch with the ES_ENDPOINT_STRATEGY=port (formerly off) and ES_MULTI_CLUSTER=0, a port from the external service port range is used (instead of PORT_ELASTICSEARCH or 4571 by default).
• Upcoming breaking change: This version deprecates the ES_ENDPOINT_STRATEGY, ES_MULTI_CLUSTER, and ES_CUSTOM_BACKEND. Instead, the OPENSEARCH_* variables should be used. The ES_ENDPOINT_STRATEGY=off is being renamed to port (i.e. please use OPENSEARCH_ENDPOINT_STRATEGY=port from now on).

Change log

1. New Features

• add initial support for SNS PublishBatch API
• add support for email-json protocol in SNS subscriptions
• add support for AWS OpenSearch
• support multi arch for local-kms provider
• support invocation of local API URLs via stepfunctions

2. Enhancements

• bump moto-ext to latest version
• minor refactoring in SNS get_message_attributes() method
• add utilities for migrating services to ASF
• minor refactoring in selecting handler in edge.py for better extensibility
• add check for supported protocols on SNS subscription
• adjust routing to enable using anonymous boto3 client to fetch S3 object
• refactor Lambda executors to allow modification of container settings using hooks
• minor adjustments in patch decorator for bound methods of class instances
• hardcode default tmp and data paths
• Add handling for DynamoDB stream iterator expiration, bump kinesis-mock to 0.2.2
• remove obsolete moto imports in CloudFormation resource classes
• remove obsolete patch for CloudWatch metrics filtering
• cleanup CloudFormation logic and remove old/obsolete code
• add utility to manage / reserve ports for external services
• invalidate builder stage in dockerfile on package version changes
• use base_url instead of url for determining SQS queue URL
• add cachetools to CLI dependencies
• set MessageGroupId and MessageDeduplicationId on SQS message from SNS subscription
• Introduce lazily-created localstack-internal-awssdk utility lambda function
• capture X-AMAZON-APIGATEWAY-ANY-METHOD for cases where route key is for integrations
• provide better log info when CloudFormation resources cannot be found
• clean up old/unused CloudFormation logic
• refactor SQS queue-url generation
• extend SNS publish batch support for FIFO topics
• remove monkey patching and circular dependency
• refactor sqs queue resolving and url rendering
• minor refactoring of CFN logging code to dump resources as JSON string
• clean up aws_stack utils, remove obsolete global cached boto3 resources
• add missing CloudFormation parameters for Firehose delivery streams
• migrate firehose to ASF
• stop setting environment variable if cognito_identity if empty
• Kinesis refactor server abstraction
• Allow container client to connect/disconnect containers to/from a network
• handle SSE for sqs
• refactor config and rip out global port/url variables
• add connection parameters and credentials to EventBridge API destinations
• replace function calls with literal syntax and remove unnecessary comprehensions
• broaden the external service port range, adjust docker-compose
• update Docker base image (python:3.8.12-slim-buster) digest to 3544d06
• add util function for deletion of None-values from dicts
• combine OpenSearch and Elasticsearch backends
• update exposed ports and docker-compose

3. Bug Fixes

• fix CloudFormation deployment of SNS::TopicPolicy
• fix handling of empty prefix for Firehose S3 uploads to properly trigger event notification
• fix external host setting for sqs
• fix acronym handling in camel_to_snake_case
• fix API Gateway to match the most specific path in the presence of "{proxy+}" placeholders
• fix asf scaffold to generate TypedDict declarations correctly
• fix sqs port extraction from headers and other related issues
• fix ASF SQS provider to allow direct calls to queue URLs
• fix DynamoDB local/localhost region for NoSQL Workbench
• fix ASF SQS xml response encoding
• fix request parser to enable X-Amz-Target strings with multiple dots
• fix expectations around Kinesis record encoding, always re-encode records for shard subscribers
• fix CloudFormation deployer to recursively resolve string placeholders
• fix ASF REST operation lookup with conflicting path params
• fix DomainValidationOptions property in ACM Certificate CFN deployment
• fix access to listener in logic for restarting Kinesis
• fix issue rendering VTL templates for API Gateway by flattening the input
• fix accessing external SQS port for intra-service communication
• fix positional args in CloudFormation find_change_set(..) method
• fix SNS PublishBatch logic for optional Subject atttribute
• fix Kinesis installation via LPM, add Docker check for StepFunctions installation
• fix docker client ctx manager and json decode issues on windows
• fix passing Conditions on stack updates, refactor/simplify CFN function arguments
• fix EC2 route tables and service backend initializations for recent upstream moto changes
• add config for host path to fix mounting of libs_dir
• minor fix in SNS tests to resolve stale PR merge
• minor fix in printing result for local node.js Lambda executor
• ASF rest-json parser fixes
• minor fix in request parsing to match path parameters with slashes
• replace get_data() with response.content to fix logic in SNS HTTP subscriptions
• fix gzip handling in SSL proxy

LocalStack release 0.13.3

LocalStack release 0.13.3

Change Log

1. New Features

• add initial ASF (AWS Service Framework) SQS provider implementation
• add automatic Docker network detection for Lambda containers
• add support for dynamic SSM/SecretsManager references in CloudFormation templates
• add version info to internal health HTTP endpoint

2. Enhancements

• add support for gzipped responses in SSL proxy via Accept-Encoding headers
• lowercase 'accept' headers in API Gateway for parity with AWS
• add negative test for SNS FIFO topic validation, migrate SNS tests from unittest to pytest
• add ability to customize default IAM/STS user via TEST_IAM_USER_ID/TEST_IAM_USER_NAME
• add integration test that passes binary data via APIGateway to Lambda
• refactor StepFunctions multi-region support to use upstream changes
• add proper validations for SNS/SQS integration with fifo queues
• allow provider overrides to be passed to the started LocalStack container
• ensure SequenceNumber is present in Lambda events from DynamoDB Streams
• support updating of API Gateway resources via PATCH operations
• refactor logging code to replace string interpolation with passing arguments to log methods
• refactor code to remove unnecessary list comprehensions
• refactor code to remove mutable default arguments
• pull out subtypes instance manager into separate util class for reusability
• update and clean up outdated documentation
• replace dict and list function calls to literal syntax
• remove uname command in system check for windows compatibility

3. Bug Fixes

• fix API gateway proxy resources
• fix passing of request parameters to API Gateway HTTP integrations
• fix Firehose-ElasticSearch integration, allow S3Backup AllDocuments with ElasticSearchDestination
• fix multiple service container creation
• fix extraction of filter values for describing EC2 prefix lists
• fix single-space env default in docker-compose
• fix RenovateBot config to only enable patch updates

LocalStack release 0.13.2

LocalStack release 0.13.2

Announcements

• Security fixes: This release upgrades log4j dependencies to version 2.17.0 to fix the critical security vulnerabilities CVE-2021-44228, CVE-2021-45046

Change Log

1. New Features

• add initial support for region-based in-place partition rewriting
• add "--offline" pytest flag, skip "online-only" tests, fix some tests
• add SKIP_SSL_CERT_DOWNLOAD option to allow skipping download of SSL cert

2. Enhancements

• bump version of Java utils to 0.2.18 to fix log4j vulnerability CVE-2021-44228, CVE-2021-45046
• refactor README.md to make it crisp and readable
• refactor Lambda logic to remove local executor Callable from model entities
• automatically pull non-cached Docker images on image inspection
• replace dict calls with comprehensions
• small fixes to allow running LocalStack with podman
• reduce log level of edge port configuration hook
• correctly wait for stay-open port to be available, fix fallback to exec mode
• add compatibility checks for S3 copy object with metadata
• add proper error response message to reject empty SNS messages
• minor refactoring to use negative index -1 to get the last element of sequence
• minor refactoring of Lambda API for better extensibility

3. Bug Fixes

• fix updating of HTTP method in message handler chain to avoid None methods
• fix misc. tests failing for non-default region
• fix Terraform test issue related to SQS changes in the AWS provider
• fix association of VPCs in Route53 HostedZone responses
• fix CloudFormation updates for EC2::Instance with empty SecurityGroups property
• fix listing of KMS signing keys for asymmetric key pairs

LocalStack version 0.13.1

LocalStack release 0.13.1

Announcements

• Upcoming breaking change: This version introduces the LEGACY_PERSISTENCE config, which determines whether the legacy persistence mechanism (based on API calls record&replay) should be used. Currently still defaults to LEGACY_PERSISTENCE=1, but the logic will be disabled by default and may get removed entirely in a future release. (Please note: this is only affecting the legacy persistence in Community - if you're using the Pro version, you can ignore this message.)

Change Log

1. New Features

• add LocalStack Package Manager (lpm) CLI
• add plugin-based hooks for bootstrapping and infra startup
• add functionality for custom Elasticsearch backends
• add support for stay-open mode for docker-reuse Lambda executor
• add cli command to show current config
• add initial integration of Route53Resolver API
• add multi-region support for StepFunctions state machines

2. Enhancements

• refactor handler chain and add MessageModifyingProxyListener to enable modification of requests/responses
• add Directories config object and introduce directory structure
• use unittest.mock.patch.object for overriding config params
• publish logs per metric and remove faulty metric filter behavior in CloudWatch API
• add Docker tags for minor and patch versions
• exclude Elasticsearch >=7.14.0 client versions for OpenSearch compatibility
• add SIGINT signal handler for CLI to enable clean shutdown across different operating systems
• clean up obsolete patches for event_rules in EventBridge API
• slightly refactor StepFunctions install logic for better extensibility
• add flag to check port availability in start_proxy_server(..) to fix test flakes
• increase timeout when waiting for edge port to become available
• allow redirection of var libs to static libs inside the container / move dependencies to correct folders
• update startup hook that initializes and restores persistence
• download test-jar for Lambda integration tests with make init-testlibs
• filter warnings about "tail unrecognized file system" from Lambda logs
• add basic Architectures support to Lambda API
• get hostname by using gethostname() instead of reading /etc/hostname
• add patch utility
• add .localstack config directory and config profiles
• add initial support for KMS Sign API
• skip time expiration validation for presigned S3 URL when S3_SKIP_SIGNATURE_VALIDATION=True
• remove dead event logging code
• move machine id cache to new cache directory
• add missing attributes for Lambda::Function CloudFormation resources
• add "is running" check before restarting Kinesis and StepFunctions services
• add module init file for localstack.runtime
• add support for SNS delivery logs stored to CloudWatch Logs
• explicitly handle S3 OPTIONS request with "Access-Control-Request-Method" header
• add psutil as CLI requirement
• strip extra xmlns attributes in PutBucketNotification responses for AWS Rust SDK compatibility
• update Makefile to use new cli detach flag for smoke test
• patch CFN stack outputs for API Gateway
• make can_use_sudo use non-interactive mode
• migrate several tests from unittest -> pytest
• re-arrange Dockerfile commands to decrease image size and increase number of cache hits
• pin Docker base images, enable DependaBot/RenovateBot to update once a week
• apply boolean lowercase conversion in IAM responses for all clients (not only Node.js SDK)
• enable Docker buildkit cache inlining, use remote Docker layer cache
• patch LogStream.filter_log_events to use get_pattern_matcher
• minor refactoring of EventBridge utils, fix location of EVENTS_TMP_DIR
• minor: improve parameter checks and error responses for SES SendEmail

3. Bug Fixes

• fix returning formatted date string for requestTime in Lambda API GW events
• fix edge routing for API Gateway invocation URLs when Signature= query param is passed
• fix SNS pagination to support large CloudFormation stacks with very large number of topics
• fix lpm to return non-zero exit code if package installation fails
• fix using custom Docker images for nodejs14.x/python3.9 only if no custom registry is provided
• fix MD5 check on S3 requests with "chunk-signature="
• fix "localhost" region in requests headers for compatibility with NoSQL Workbench
• fix Docker flags parsing in configure_container
• fix tests and remove obsolete patch for CloudWatch metrics filtering
• fix setting HMAC/non-HMAC credentials when injecting internal Authorization headers in requests
• fix OldImage/NewImage in DynamoDB->Kinesis event payloads on updating/deletion of items
• fix creation of multi route table associations in CFN EC2::SubnetRouteTableAssociation resources
• fix deleting objects from non-existing S3 buckets
• fix text/xml content-type header in STS responses
• fix install_go_lambda_runtime for multi-arch build
• fix forwarding of unprintable chars to SQS DLQ
• upgrade pyopenssl version to fix OpenSSL issue, refactor SSL cert generation
• minor fix checking for dict/CaseInsensitiveDict in merge_recursive(..) util function

LocalStack version 0.13.0

LocalStack release 0.13.0

Major Changes

This release introduces three major changes

• A Debian-based multi-platform Docker image of LocalStack, with full support for amd64 and experimental support for aarch64 (see #4921 for known limitations and progress)
• Upgrade to Python 3.8
• Lazy-loading of services as the default behavior

Debian-based multi-platform (amd64, arm64) docker image

#4754 introduced a multi-platform docker build to support both amd64 and arm64. Alpine and musl made things unnecessarily difficult, so we switched to a Debian buster base image. Post-init (e.g., in /docker-entrypoint-initaws.d) scripts that expect an Alpine environment (e.g., use apk commands to install things into the LocalStack container) will stop working.

Lazy-loading of services

As part of an ongoing effort to improve startup performance, we have introduced a new code loading and service startup mechanism to allow lazy-loading of services. After LocalStack starts, services used to be in the state running, indicating that they are loaded and ready to serve requests. To allow more fine-grained state handling for services with lazy loading, we have introduced a new type of state called available.
When starting LocalStack, services are by default in the state available, which means that clients can start making requests to the services, and at the first time the service is hit, all the necessary code is loaded and the backend service is started, at which point the service after which the service will be in the running state. The environment variable EAGER_SERVICE_LOADING controls this behavior.

Scripts that depend on the output of /health being running will require setting setting EAGER_SERVICE_LOADING=1, which will start all services eagerly. This works together with the SERVICES variable to create the behavior from localstack <= 0.13.0.

(An alternative solution is to update your startup logic to accept either running or available as the healthy service state - e.g., see details in this issue).

Change log

1. New Features

• make lazy service loading the default behavior
• debian-based multi-platform support
  • multi-platform support in localstack codebase
  • finalize multi-platform build
  • initial version of multi-platform-build
• support multiple concurrent elasticsearch clusters:
  • implement one cluster per domain-support for elasticsearch
  • implement custom endpoint routing for elasticsearch clusters
• add simple UI for deploying CloudFormation stacks from public template URLs
• add delete support for AWS::SSM::Parameter CloudFormation resources
• add initial support for Firehose processors to transform records written to targets
• add ability to short circuit wait/retries

2. Enhancements

• use serving.Server abstraction for ElasticMQ server to resolve startup issues
• add Werkzeug>=2.0 as requirement
• use werkzeug Request object in asf
• use werkzeug Response object in asf
• invalidate pro test cache for changes in both
• bump moto version to 2.2.5
• minor: correct typos in README
• add support for {"exists": false} in SNS message filtering
• add support for CFN resource AWS::Logs::LogStream
• minor: adjust API GW logic and tests for latest upstream moto changes
• convert boolean strings to lowercase in IAM responses for JS SDK compatibility
• add LEGACY_DOCKER_CLIENT and EAGER_SERVICE_LOADING to CONFIG_ENV_VARS
• minor: add property to API GW resource context class to extract identity information
• refactor logic for pulling specific Docker image tags, add more tests
• implement generic approach for routing internal REST resources
• extend logic and add more tests for escapeJavaScript(..) velocity template function
• remove custom parameter by label filtering, leverag logic from upstream
• upgrade moto-ext dependency to latest version
• Format JSON stack template for better readability in UI
• minor: remove print(..) statement
• support ranges of host ports to be mapped to a container port
• add missing attributes in Firehose records sent to destinations

3. Bug Fixes

• minor fix to deal with missing Tags attribute in EC2::RouteTable
• fix filtering by tags when fetching state of EC2::RouteTable CloudFormation resources
• fix URL encoding to properly handle '(none)' base paths in API Gateway
• fix arn parsing in aws_stack
• minor: fix API GW test assertion after recent moto upstream changes (part 2)
• minor: fix API GW test assertion after recent moto upstream changes
• minor fixes in Lambda and API Gateway logging / error handling
• fix extracting attributes from Firehose records
• revert moto to version 2.2.4 to fix builds temporarily

LocalStack release 0.12.20

Change Log:

LocalStack release 0.12.20

1. New Features

• major: implement lazy-loading of services
• introduce ApiInvocationContext class to encapsulate API Gateway request context information
• add AWS Service Framework parsers, serializers, and tests
• add AWS Service Framework API and scaffolding CLI
• add initial lifecycle hook abstraction for services
• add OUTBOUND_HTTP_PROXY option for proxies when downloading external resources
• add temporary support for python3.9 runtimes via mlupin/docker-lambda images
• add support for more Elasticsearch versions

2. Enhancements

• add object-oriented moto server abstraction
• update moto patch to fix CDATA wrapper for SQS message attribute values
• add option to set permissions for save_file(..), save local config file with 0o600 permissions
• upgrade Terraform version to fix CI builds
• refactor API GW logic for easier extraction of resource/method details from invocation context
• add test-invoke-method to test API Gateway endpoints
• add requestId attribute to Lambda event from API Gateway integration
• add more SQS tests to prepare for new SQS implementation
• refactor DynamoDB to use serving.Server
• update Elasticsearch default version in es_api.py
• support version qualifiers for managing Lambda policy statements
• correctly format Lambda function inline code on CloudFormation update
• refactor serving.Server to fix ElasticsearchCluster
• add headers from S3 object and correct codes to S3 website responses
• add defaults for SSM parameter name in CloudFormation model
• extend create_zip_file(..) to support 'append' mode and specifying root directory
• update default/cached Elasticsearch version to 7.10
• extract correct region from target ARN for S3 notifications
• add ability to skip content gzipping for individual services responses
• make boto client creation in aws_stack.connect_to_service thread safe
• add SSM->EventBridge integration to send notifications about parameter changes
• add concurrency control for multiserver startup
• add multi-region support for EventSourceListenerSQS
• add setup.cfg and update build configuration
• pin version of "pip" to fix setup step in CI
• add support for "::" to specify a custom Java Lambda handler method in local executor mode
• fix health endpoint to support feature states
• refactor extract_region_from_headers to make it more reusable
• add generic fallback health check for local APIs
• adjust exposed ports in docker-compose.yml
• add logic and tests to gracefully handle zipping of empty directories
• use Python time for do_run cache time comparison
• add support for routing events to log groups, fix event pattern matching/mapping for prefix filter
• prefix Lambda container names with MAIN_CONTAINER_NAME to support multiple instances in parallel
• allow partial SSE specification and auto-create managed KMS keys for DynamoDB tables
• update troubleshooting guide to not set DOCKER_HOST when using Lambda remote mode in CI
• minor: use existing util function to extract region from ARN
• minor: add generate_default_name_without_stack utility method

3. Bug Fixes

• fix docker_utils import in localstack status cli command
• fix AWS::SecretsManager::Secret CloudFormation ARN handling and tests
• fix restarting of DynamoDB process
• fix local execution of Java Lambdas if handler method is implementing RequestHandler interface
• fix issues in AWS service framework dispatching
• fix error response when attempting to delete non-existing Lambda
• fix scaffolding for remaining AWS services
• fix Elasticsearch plugin download when building docker base image
• fix check for None values in response multi_value_headers
• fix overwrite behavior for PUT requests to the health endpoint
• fix updates for AWS::IAM::Role in CloudFormation
• fix state checking for active service provider
• fix statement/policy handling for Events::EventBusPolicy CFN resource
• upgrade version of Terraform in base image to fix recent CI build issues

LocalStack release 0.12.19

Change Log:

LocalStack release 0.12.19

1. New Features

• add initial support for KMS asymmetric keys
• add initial support for KMS grant operations
• add support for and/or/condition CFN intrinsic functions
• add support for states:::events:putEvents to publish events from StepFunction
• add wildcard support for EXTRA_CORS_ALLOWED_ORIGINS configuration

2. Enhancements

• move attribute defaults from template_deployer to service models
• cache single instance of request context to enable mutability
• refactor Lambda API delete_function logic for better extensibility
• pass ENABLE_CONFIG_UPDATES environment variable to Docker container from CLI
• support case-sensitive response headers, add ETag to CORS exposed headers for S3 JS SDK compatibility
• add pagination to get_lambda_log_events(..) util function to fix Lambda tests
• log emails sent via SES send_raw_email into local log file
• add ability to pass invocation handler to test HTTP server for API GW integration tests
• add missing event attributes and increase timeout in Java Lambda tests
• rename docker->docker_utils to avoid import/aliasing issues
• minor refactoring of inter-service message forwarding for better extensibility
• add simple util classes ObjectIdHashComparator and ArbitraryAccessObj
• add helper function to mock a request context with a particular region
• refactor and remove fix_resource_props_for_sdk_deployment(..) in CFN deployer
• move delete patches in template deployer to CFN service models
• refactor error handling and add MOCK_UNIMPLEMENTED config to gracefully handle unimplemented APIs
• add ability to pass --workdir to launched containers in Docker client
• allow Lambda plugins to return invocation results directly, create plugin to handle LAMBDA_FORWARD_URL
• increase ElasticSearch cluster startup timeout
• skip forwarding Lambda invocation result if on_successful_invocation is None
• add missing edge routing logic for AWS SDK v2
• add support for s3:ObjectCreated:Copy event in the presence of X-Amz-Copy-Source headers
• add Docker client methods to inspect networks
• wait until port is closed on DynamoDB shutdown/restart
• pass CORS configuration options and Thundra Node.js/Python agent config from CLI to the container
• add util function to restart StepFunctions service process
• minor: check for empty files in download_and_extract(..) util function
• implement PluginDisabled exception to handle disabled plugins
• refactor DDBStreams/ES/Firehose APIs to use RegionBackend classes

3. Bug Fixes

• fix potential race condition in Docker container start/wait logic
• fix CFN SecretsManager::Secret to properly return secret ARN as Ref
• fix CFN resource type lookup
• fix deploying Lambdas with colliding names due to common prefixes
• fix issue with single quotes in payload for Node.js Lambda in local execution mode
• fix deployment of DynamoDB table with SSE disabled in Terraform definition
• fix selection of sub-elements in SQS listener XML responses
• fix Lambda SNS event source attribute as aws:sns instead of localstack:sns
• minor fix to avoid running multiple edge proxies on the same port

LocalStack release 0.12.18

Change Log:

LocalStack release 0.12.18

1. New Features

• add generic LocalStack plugin framework
• implement CLI using click, rich, and stevedore
• add Node.js/Python/java8.al2 runtime support for Thundra plugin
• add extensible class abstraction for Lambda event source listeners
• introduce Lambda executor plugin mechanism to hook in custom extensions at runtime
• add support for local execution of Go Lambda functions
• add support for generated secrets in CFN SecretsManager::Secret
• add initial version of Config Service API

2. Enhancements

• make some integration tests more lenient to environment changes
• add attributes to SQS messages from Lambda event source mapping
• add support for LS_LOG=trace-internal log level
• add check if DNS_ADDRESS is zero before starting the DNS server
• consider function alias when resolving Lambda function or layer ARN
• refactor Lambda executor methods to use InvocationContext as input param
• move pre- and post-create CFN actions from template_deployer to resource models
• extend util function for creating simple SSL proxy servers
• add plugin_spec to signatures of PluginLifecycleListener
• move API imports in infra.py to respective start methods
• add missing SSEDescription and TableId entries in DynamoDB DescribeTable calls
• add ability to specify --network via DOCKER_FLAGS config
• add util function to manually configure region for current request context
• enable sync/async SFN invocations in API Gateway integration
• remove obsolete patches for Logs metric_filters
• add test for deletion of SQS messages with changed visibility
• parse volume mount flag with regex to allow windows paths and additional arguments
• support <apiId>.execute-api.* hostnames for API Gateway invocation URLs
• distinguish polling and reactive mode in EventSourceListener
• add CloudFormation support for AWS::Events::EventBusPolicy
• create SQS queue policy for AWS::SQS::QueuePolicy CFN resource
• add support for DefinitionSubstitutions in CFN StateMachine resources
• add support for ApiGateway::DomainName and ::BasePathMapping CFN resources
• add get_physical_resource_id() for ApiGateway::Deployment
• add ability to specify SelfManagedEventSource for CFN Lambda::EventSourceMapping
• update kinesis-mock to 0.2.0, adding built-in multi-region support
• add startup logic to install prebuilt SSL cert if available
• update setup.py with additional information
• run Golang local test only if executed in Alpine
• run LocalStack tests against LocalStack Pro in Github Action
• rework some integration tests to make them more robust
• restructure Python requirements, Dockerfile and Makefile
• add LAMBDA_CODE_EXTRACT_TIME to configure max Lambda code extract wait time
• add default name for IAM::ManagedPolicy CFN resource
• aggregate valid regions accross all available partitions, to support regions like us-gov-*
• disable cli banner when running infra in docker
• move code in RESOURCE_TO_FUNCTION into service models, split into separate files
• add exception handling to EventBridge notifications if targets are unaccessible
• inject AWS_ENDPOINT_URL into Lambda container environment
• add plug points for code/config initializations in LambdaExecutorPlugin
• refactor testutil.py to deploy large Lambda zip files via S3
• add separate section with service provider configurations to README
• disable shell mode in run(..) util if cmd is passed as a list
• pass Cognito Identity info through HTTP headers, return InvocationResult with content instead of wrapping as Flask response for LAMBDA_FORWARD_URL
• add util functions get_edge_port_http() and is_provided_runtime(..)
• add localstack infra cli command for backwards compatibility
• add test assertion to verify value of maxReceiveCount in SQS RedrivePolicy
• extend logic to apply request/response templates in API GW messages
• add support for synchronous invocations of StepFunctions via API GW
• support --add-host argument in LAMBDA_DOCKER_FLAGS
• add simple integration tests for Support API
• add utility function to parse properties/INI config files
• add restart method for Kinesis and DynamoDB processes
• add util function to inject specific region into AWS Authorization header
• inject missing Lambda environment variables in local Lambda executor
• add resource id to auto-generated Lambda name in CFN stacks
• add warning message for LAMBDA_EXECUTOR=docker* if Docker is not accessible
• consolidate .coveragerc and .flake8 config int pyproject.toml
• minor: remove references to PORT_WEB_UI in docs
• minor: add util function to extract access_key_id from auth header, add type hints to utils
• minor: expose private Docker client methods as static methods in Docker Util class

3. Bug Fixes

• fix logic and add test for edge invocations from AWS Go SDK v2
• fix CFN list_stack_resources() for stacks with deleted resources
• fix ApiKeyRequired in API Gateway CloudFormation resources
• fix code updates of Lambda functions for Docker executor
• fix EC2/Logs tests after upstream changes
• fix raw message delivery attribute for SNS/SQS subscriptions
• fix documenting TMPDIR and HOST_TMP_FOLDER in docker-compose
• fix getting IP addresses of Docker containers with non-default networks
• fix template deployer and tests to retrieve updated PhysicalResourceId for EC2::Instance
• fix spaces in JSON events passed to custom runtime
• fix AWS::ApiGateway::Account regression
• fix argument error in exception handling in lambda_api.py
• fix adding tags to SQS queues when value is an empty string
• fix missing request parameters in CFN ApiGateway integration
• fix responding to S3 website requests with proper object content-type
• minor fix in regex to parse Docker volume flags
• restructure and clean up README.md

LocalStack release 0.12.17

Change Log:

LocalStack release 0.12.17

1. New Features

• security fixes: replace Docker CLI commands with Docker Python SDK client
• add support for multi-region request handling
• add ability to specify custom IDs for API GW REST APIs via tags
• add CloudFormation support for Events::Connection
• add EDGE_FORWARD_URL option to forward all edge requests

2. Enhancements

• update README and coverage docs with latest available services
• canonicalize boolean strings in SNS FIFO topic creation via CloudFormation
• canonicalize HTTP header names in API GW Lambda events to lower-case
• add basic interface for StateSerializer to be used in persistence mechanism
• add support for Route53 GetHealthCheck
• minor refactoring of imports to fix CLI dependency issues
• deploy extended attributes for IAM::User CloudFormation resources
• add ability to run privileged ports 53/443 in local dev mode
• return S3 bucket hostname for "DomainName" CF attribute
• restructure Thundra plugin code and fetch latest Java agent version from metatata xml in repository
• add support for IAM::User CloudFormation resources
• add missing CloudFormation properties for SNS::Topic
• update download URL for patched DynamoDB in base Docker image
• add fallback for boolean type conversion in CloudFormation deployments
• update analytics event logging system
• add Thundra config variables to config.CONFIG_ENV_VARS to pass them to Docker instance
• refactor logic across the codebase to make use of the Docker client utils
• extend merge_recursive(..) util function
• introduce KMS_PROVIDER env variable and switch to moto as default KMS provider
• add cleanup of docker-reuse Lambda containers if code/configuration is updated

3. Bug Fixes

• fix logic and tests for decimals formatting
• fix removing X-amz-content-sha256 header after stripping off chunk signatures
• fix/revert lookup of OS user inside Docker container
• fix patches in Logs API to accommodate recent upstream changes
• fix KMS listener initialization
• fix extracting event bus name as Ref attribute from CF Events::EventBus resources
• fix Kinesis CBOR response encoding for Java SDK compatibility, extend tests
• minor fix for handling symlink targets in cp_r(..)
• minor fixes to enable deployment of arc.codes sample app
• minor fix: consider Flask&Requests responses in aws_responses utils

LocalStack release 0.12.16

Change Log:

LocalStack release 0.12.16

1. New Features

• add integration for Thundra tracing via THUNDRA_APIKEY
• add support for local execution of Node.js lambdas
• add support for DeleteAlias and TracingConfig in Lambda API
• support sequential Lambda execution for Kinesis streams, using ParallelizationFactor
• support resolving SSM parameter values in CloudFormation templates
• add possibility for services to subscribe to runtime config changes
• add TEST_TARGET=AWS_CLOUD option to run tests against real AWS

2. Enhancements

• update README with instructions to build the Docker image
• add integration test for EC2 route table association
• adjust updated download URL for patched DynamoDBLocal.zip
• update kinesis-mock version to fix missing Logger classes
• store SES templated email messages to DATA_DIR or tmp folder for easier debugging
• refactor and extend AWS response parsing utils
• remove Web dashboard process from supervisord.conf
• extend test utils to pass in an auth_creator_func(..) for creating API GW authorizers
• minor: remove deprecated web UI documentation
• add option to disable boto3 retries/timeouts
• remove EventBus proxy listener patches for Tags operations handled upstream
• integrate and use the util function to remove Docker env files
• print version string if Terraform version check fails in integration tests
• replace unparse with custom XML serializer for AWS responses
• support CloudFormation string placeholders with triples like "${resource.attr.subattr}"
• improve kinesis startup routine and add KINESIS_MOCK_FORCE_JAVA config option
• replace botostubs with boto3-stubs in test fixtures
• add retry logic for downloading Elasticsearch plugins to fix temporary network issues
• extend ACM ARN integration test when importing certificates
• improve infra graph code, extend tests, add new fixtures
• add tests for Lambda invocation destinations
• add unit tests for common and config
• add JSON safe parsing when processing API GW event in local Javascript Lambda
• patch moto to include region header for GET and HEAD requests
• update CI workflow to aggregate coverage report
• use JAVA_TOOL_OPTIONS to apply LAMBDA_JAVA_OPTS in Java Lambdas
• cleanup and refactor CI configurations
• add default account_id for API GW Lambda invocation events
• add ability to define UDP Docker ports in PortMappings class
• strip off warning messages when extracting Docker container ID from stdout
• add exception response when calling DeletePolicy on non-existent IAM policy
• refactor Lambda executor to use unified container API and break apart container/Lambda logic
• pin version of "requests" library to fix import errors in Lambda tests
• add feature that saves LocalStack version info into data dir
• add pre-commit hook that runs linting and formatting
• add support for CloudFormation Fn::GetAtt WebsiteURL for S3 buckets
• refactor JSONPatch implementation for API GW to handle edge cases more reliably
• add make targets for linting and formatting only modified files
• add proper headers when triggering API destination target
• add CORS headers required for AWS SDK v3
• refactor Firehose and properly return "ExtendedS3DestinationDescription" with extended attributes
• add support for API Gateway documentation parts (tf-compat)

3. Bug Fixes

• fix regex to extract API ID in hostname from API GW endpoint URL
• fix logic in inject_test_credentials_into_env(..) to set custom env parameters for Lambda functions
• fix DynamoDB to Kinesis stream event format - add "tableName", remove "StreamViewType"
• fix Docker detection on hosts with cgroup v2 (unified hierachy)
• fix running multiple API Gateway JSON Patch operations in sequence (tf-compat)
• fix timestamp format of Lambda event source mappings for TF compatibility
• fix returning error response when requesting ACL for non-existing S3 bucket
• fix edge routing to match rules if request host contains a dot "."
• fix EXTRA_CORS_ALLOWED_ORIGINS environment variable to match docs
• fix ARN structure for EventBridge resources
• fix extraction of EventBridge API destination name using new ARN format
• fix S3 host-based routing detection
• fix accessing missing "body" from Lambda response in API GW
• fix JSON Patch for API GW method settings
• fix some data types for API GW patch operations
• fix "application/xml" content-type header for S3 responses
• minor: fix file path in "config validate" CLI command