Infrastructure code for "Streaming Data Architecture"

This repository contains infrastructure as Terraform configurations which were automatically generated from blueprint created using cloudcraft.co.

Terragrunt is used to work with Terraform configurations which allows to orchestrate dependent layers, update arguments dynamically and keep configurations DRY.

Table of Contents

1. Quick start
2. Configure access to AWS account
3. Create and manage your infrastructure
4. References
5. About modules.tf

Quick start

1. Install Terraform 0.12 or newer
2. Install Terragrunt 0.22 or newer
3. Optionally, install pre-commit hooks to keep Terraform formatting and documentation up-to-date.

If you are using macOS you can install all dependencies using Homebrew:

$ brew install terraform terragrunt pre-commit

Configure access to AWS account

The recommended way to configure access credentials to AWS account is using environment variables:

$ export AWS_DEFAULT_REGION=eu-west-1
$ export AWS_ACCESS_KEY_ID=...
$ export AWS_SECRET_ACCESS_KEY=...

Alternatively, you can edit terragrunt.hcl and use another authentication mechanism as described in AWS provider documentation.

Create and manage your infrastructure

Infrastructure consists of multiple layers (dynamodb-table, s3-bucket, ec2-instance_3, ...) where each layer is described using one Terraform module with inputs arguments specified in terragrunt.hcl in respective layer's directory.

Navigate through layers to review and customize values inside inputs block.

There are two ways to manage infrastructure (slower&complete, or faster&granular):

• Region as a whole (slower&complete). Run this command to create infrastructure in all layers in a single region:

$ cd eu-west-1
$ terragrunt apply-all

• As a single layer (faster&granular). Run this command to create infrastructure in a single layer (eg, dynamodb-table):

$ cd eu-west-1/dynamodb-table
$ terragrunt apply

After the confirmation your infrastructure should be created.

References

• Terraform documentation and Terragrunt documentation for all available commands and features.
• Terraform AWS modules.
• Terraform modules registry.

About modules.tf

modules.tf is an open-source project by Anton Babenko, and, yes, you can contribute, too:

1. Questions, bugs and feature-requests - open an issue.
2. Become a sponsor to @antonbabenko.
3. You are always welcome to share, star, like, tweet, follow!

All content, including Terraform AWS modules used in these configurations, is released under the MIT License.