[COST-4962] Populate OCP Network UI Summary Tables

[cgoodfred]

Jira Ticket

COST-4962

Description

This change will populate the network summary tables for the UI to consume.

Testing

1. There are two ways to test this as the summary SQL has not been merged in yet.

• Option 1: merge in the changes from this PR ([COST-4744] Azure network data processing SQL #5056) and run summary so the daily summary table is filled first
• Option 2: insert a few records for different days with expected criteria filled in. Here is an example of a record for an inbound network insertion.

INSERT INTO reporting_ocpusagelineitem_daily_summary (uuid, cluster_id, cluster_alias, data_source, namespace, node, resource_id, usage_start, usage_end, infrastructure_raw_cost, infrastructure_markup_cost, infrastructure_data_in_gigabytes, infrastructure_data_out_gigabytes, raw_currency, source_uuid, report_period_id, cost_category_id) VALUES('1c88cd37-9d56-407e-9262-ec1dea8dea06', 'my-ocp-cluster-1', 'TestCluster', 'Pod', 'Network unattributed', 'azure_compute1', 'azure_compute1', '2024-05-21', '2024-05-21', 10, 0, 100, NULL, 'USD', '2483a9ea-6cad-40ff-adc1-4f0acf819bc1', '1', NULL);

2. After getting records in, run summary and check the newly filled tables.
3. Some verification SQL for inbound records:

--baseline
postgres=# SELECT sum(infrastructure_data_in_gigabytes) as in, sum(infrastructure_raw_cost) as cost FROM reporting_ocpusagelineitem_daily_summary WHERE infrastructure_data_in_gigabytes > 0;
-[ RECORD 1 ]-------------
in   | 110.000000000000000
cost | 1.100000000000000

--network table
postgres=# SELECT sum(infrastructure_data_in_gigabytes) as in, sum(infrastructure_raw_cost) as cost FROM reporting_ocp_network_summary_p WHERE infrastructure_data_in_gigabytes > 0;
-[ RECORD 1 ]-------------
in   | 110.000000000000000
cost | 1.100000000000000

--network by node
postgres=# SELECT sum(infrastructure_data_in_gigabytes) as in, sum(infrastructure_raw_cost) as cost, node FROM repor
ting_ocp_network_summary_by_node_p WHERE infrastructure_data_in_gigabytes > 0 GROUP BY node;
-[ RECORD 1 ]-------------
in   | 110.000000000000000
cost | 1.100000000000000
node | azure_compute1

--network by project, for now will only have Network unattributed project
postgres=# SELECT sum(infrastructure_data_in_gigabytes) as in, sum(infrastructure_raw_cost) as cost, namespace FROM 
reporting_ocp_network_summary_by_project_p WHERE infrastructure_data_in_gigabytes > 0 GROUP BY namespace;
-[ RECORD 1 ]-------------------
in        | 110.000000000000000
cost      | 1.100000000000000
namespace | Network unattributed

4. Some verification SQL for outbound records:

--baseline
postgres=# SELECT sum(infrastructure_data_out_gigabytes) as out, sum(infrastructure_raw_cost) as cost FROM reporting_ocpusagelineitem_daily_summary WHERE infrastructure_data_out_gigabytes > 0;
-[ RECORD 1 ]-------------
out   | 165.000000000000000
cost | 1.650000000000000

--network table
postgres=# SELECT sum(infrastructure_data_out_gigabytes) as out, sum(infrastructure_raw_cost) as cost FROM reporting_ocp_network_summary_p WHERE infrastructure_data_out_gigabytes > 0;
-[ RECORD 1 ]-------------
out  | 165.000000000000000
cost | 1.650000000000000

--network by node
postgres=# SELECT sum(infrastructure_data_out_gigabytes) as out, sum(infrastructure_raw_cost) as cost, node FROM reporting_ocp_network_summary_by_node_p WHERE infrastructure_data_out_gigabytes > 0 GROUP BY node;
-[ RECORD 1 ]-------------
out  | 165.000000000000000
cost | 1.650000000000000
node | azure_compute1

--network by project, for now will only have Network unattributed project
postgres=# SELECT sum(infrastructure_data_out_gigabytes) as out, sum(infrastructure_raw_cost) as cost, namespace FROM reporting_ocp_network_summary_by_project_p WHERE infrastructure_data_out_gigabytes > 0 GROUP BY namespace;
-[ RECORD 1 ]-------------------
out       | 165.000000000000000
cost      | 1.650000000000000
namespace | Network unattributed

Release Notes

• proposed release note

* [COST-4962](https://issues.redhat.com/browse/COST-4962) Populate OCP Network UI Summary Tables during summary flow.

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 94.2%. Comparing base (ff7e502) to head (ac90435).

Additional details and impacted files

@@          Coverage Diff          @@
##            main   #5057   +/-   ##
=====================================
  Coverage   94.2%   94.2%           
=====================================
  Files        378     378           
  Lines      31622   31622           
  Branches    3756    3756           
=====================================
+ Hits       29777   29780    +3     
+ Misses      1177    1174    -3     
  Partials     668     668