Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Azure Steam Analytics Jobs SU #25945

Closed
1 task done
aevlogiev opened this issue May 13, 2024 · 2 comments
Closed
1 task done

Azure Steam Analytics Jobs SU #25945

aevlogiev opened this issue May 13, 2024 · 2 comments

Comments

@aevlogiev
Copy link

aevlogiev commented May 13, 2024

Is there an existing issue for this?

  • I have searched the existing issues

Community Note

  • Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request
  • Please do not leave "+1" or "me too" comments, they generate extra noise for issue followers and do not help prioritize the request
  • If you are interested in working on this issue or have submitted a pull request, please leave a comment and review the contribution guide to help.

Azure streaming job SU's value are not fully supported unable to anything below 3 SU's including partial SU's which are supported in the cloud with V2 pricing like 2/3 of SU and etc
error

Terraform Version

1.8.3

AzureRM Provider Version

3.103.1

Affected Resource(s)/Data Source(s)

azurerm_stream_analytics_job

Terraform Configuration Files

# resource "azurerm_stream_analytics_job" "test" {
#   name                = "${local.env_short}test"
#   resource_group_name = azurerm_resource_group.this.name
#   location            = azurerm_resource_group.this.location
#   compatibility_level = "1.2"
#   data_locale                              = "en-US"
#   events_late_arrival_max_delay_in_seconds = 120
#   events_out_of_order_max_delay_in_seconds = 0
#   events_out_of_order_policy               = "Adjust"
#   output_error_policy                      = "Stop"
#   sku_name                                 = "StandardV2"
#   streaming_units                          = 2/3
#   transformation_query                     = file("./code/StreamingJobs/Query-test.sql")

# }

Debug Output/Panic Output

Error: Attribute must be a whole number, got 0.6666666666666666
│ 
│   with azurerm_stream_analytics_job.Mqtt,
│   on streamingJobs.tf line 175, in resource "azurerm_stream_analytics_job" "test":
│  175:   streaming_units                          = 2/3

Expected Behaviour

It should be able to create it since its a valid value for sku_name StandardV2

Actual Behaviour

Throws an error

Steps to Reproduce

terraform apply

Important Factoids

No response

References

No response

@aevlogiev
Copy link
Author

In addition even if value is set within the range lets say 3 in cloud it creates it as 1/3 so in anyway the field streaming_units = xx is not working as expected in anyway

@aevlogiev
Copy link
Author

FYI: After some playing around and look at Azure responses it turns out that Streaming Units on API level is instance count, therefore streaming_units filed works as follows:
3 Instance count is = to 1/3 of V2 Pricing SU
7 Instance count is = to 2/3 of V2 Pricing SU
10 Instance count is = to 1 of V2 Pricing SU and so on. Using Instance count numbers on streaming_untis field result in proper sizing in the cloud. Closing maybe will be ideal for some description and update on the TF documentation for first time users.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant