1.5.0

Tools & UDMIS

• Bug fixes
• Stability improvement
• Enhanced support for Clearblade

Schema Changes

• (metadata) new optional property metadata.device_version
• (metadata) new optional property metadata.resource_type
• (metadata) metadata.system.location, and metadata.system.physical_tag` now optional (were required)
• (metadata) removed is_gateawy property. Use "resource_type": "GATEWAY" instead.
• (state) added additional enumeration entry initializing,for pointset.point.value_state`
• (all) clarified timestamps must be RFC3339 in the UTC timezone

Validator

• Added device clock accuracy check producing validation error if timestamps in payloads deviate from the time the message was received by more than 60s.

Sequencer

• New documentation for running sequencer tests

Tests promoted to BETA

• gateway_proxy_events
• broken_config
• valid_serial_no
• pointset_remove_point
• pointset_request_extraneous

Tests promoted to PREVIEW

• family_ipv4_addr
• family_ipv6_addr
• family_ether_addr
• endpoint_connection_error
• endpoint_connection_retry
• endpoint_connection_success_alternate
• endpoint_connection_success_reconnect
• endpoint_failure_and_restart
• endpoint_redirect_and_restart

Tests promoted to ALPHA

• too_much_state

Complete Changelog

• Gracefully handle udmis pod shutdown by @grafnu in #723
• Bump apollo-server-core from 3.10.1 to 3.12.1 in /udmif/api by @dependabot in #724
• Updating all tools to use configuration files by @grafnu in #725
• Handle legacy state messages by @grafnu in #710
• Propagate deviceNumId through to ClearBlade by @grafnu in #726
• Fix up testing for missing metadata files by @grafnu in #727
• Bump graphql from 16.6.0 to 16.8.1 in /udmif/api by @dependabot in #729
• Bump graphql from 16.5.0 to 16.8.1 in /udmif/web by @dependabot in #728
• Hack around problems with PubSub emulator install by @grafnu in #730
• Cleanup project/broker handling for Clearblade by @grafnu in #735
• Allow NaN in JSON by @grafnu in #737
• Implement no-state sequence testing mode by @grafnu in #738
• Bump urllib3 from 1.26.8 to 1.26.17 in /etc by @dependabot in #733
• Bump avro from 1.11.1 to 1.11.3 in /etc by @dependabot in #734
• Bump @babel/traverse from 7.19.1 to 7.23.2 in /udmif/web by @dependabot in #739
• Bump @babel/traverse from 7.18.13 to 7.23.2 in /udmif/api by @dependabot in #740
• Bump @babel/traverse from 7.18.13 to 7.23.2 in /udmif/event-handler by @dependabot in #741
• Update blobset_final.json by @tomhum3365 in #732
• Update endpoint_reconfiguration.json by @tomhum3365 in #731
• Fix anchor links in generated.md by @grafnu in #744
• Add ability for semantic key sequence.md generation by @grafnu in #742
• Check pubtime and validate for clock skew and timezone offset by @grafnu in #746
• Bump urllib3 from 1.26.17 to 1.26.18 in /etc by @dependabot in #745
• Add namespaces for registries, topics, and k8s installs by @grafnu in #747
• Fixing flaky file pipe test by @grafnu in #749
• Refactoring of container creation mechanism by @grafnu in #750
• Tools automation through git repo actions by @grafnu in #751
• Add sequences into report by @noursaidi in #736
• Restore functioning device_config_acked test by @grafnu in #748
• Update testing workflow to use parallel sharded structure by @grafnu in #754
• Minor cleanup of redirect tests by @grafnu in #755
• Fix for calls with no namespace by @grafnu in #756
• Filter out error messages for invalid sub-schemas by @grafnu in #757
• Promote Pointset Tests and bug fixes by @noursaidi in #753
• Include complete state update in udmi_target by @grafnu in #758
• Fix namespace-less cloud registrar by @noursaidi in #759
• Add base gateway sequence test by @grafnu in #763
• Fix error reporting and some outputs by @grafnu in #764
• Refactoring of Pubber pointset manager (functionality neutral) by @grafnu in #765
• introduce SystemManager class by @grafnu in #766
• Implement Device Manager by @grafnu in #767
• Add failure mode to Pubber for not-gateway-proxy by @grafnu in #768
• Incorporate LocalnetManager and fix ip route parsing by @grafnu in #769
• Bumped spellcheck action to latest version, since 0.23.0 is EOL by @jonasbn in #770
• Fixes for Pubber startup errors by @grafnu in #772
• Fix testing pipeline for cases with bad device state by @grafnu in #773
• Add too_much_state test for devices that send state too often by @grafnu in #774
• Bump @adobe/css-tools from 4.0.1 to 4.3.1 in /udmif/web by @dependabot in #771
• Basic implementation of capabilities for testing granular behavior by @grafnu in #775
• Fix pipeline state update handling by @grafnu in #777
• Allow +0000 timestamps by @grafnu in #778
• registrar command line fixes for working with single devices by @grafnu in #780
• Add initial writeback easing specification by @grafnu in #781
• Add multi-subscription message shunt capability by @grafnu in #783
• Refactoring DiscoveryManager by @grafnu in #782
• Bump @adobe/css-tools from 4.3.1 to 4.3.2 in /udmif/web by @dependabot in #776
• Adding device state change monitoring by @grafnu in #779
• Add extra checks to make state last_update checks more stable by @grafnu in #784
• Update versions in files to 1.5.0 by @noursaidi in #785
• Promote up sequencer tests by @noursaidi in #786
• clarify timestamps in utc and hide properties from schema by @noursaidi in #788
• Sequence report bug fixes and improvements by @noursaidi in #789
• reduce test duration by @noursaidi in #790
• Documentation for running sequencer by @noursaidi in #791
• fix schema validation entry on legacy site by @noursaidi in #792

New Contributors

• @tomhum3365 made their first contribution in #732
• @jonasbn made their first contribution in #770

Full Changelog: 1.4.2...1.5.0

1.4.2

Bug Fixes

• Validator - fixed not validating pointset in state messages
• Validator - fixed instance when validation would not happen correctly
• Registrar - fixed ordinary device becoming a gateway

Tool Updates

• New UDMIS (UDMI Services) replacement for Cloud Functions, based on Kubernetes (deploy scripts provided for GKE)
• UDMIS support for Clearblade
• All tools updated to support usage with Clearblade IoT Core Product
• Updated registrar to use Reflector (UDMIS)
• Support for CI execution of tools through GitHub Actions

Schema Updates

• Features property added to metadata
• Discovery families property - accepted values expanded from enumeration to allow alphanumeric string

Sequencer Updates

Fixes

• Broken_config test stability improvements

Tests promoted to BETA:

• state_make_model
• state_software
• feautre_enumeration
• pointset_publish_interval
• pointset_sample_rate
• device_config_acked

Tests promoted to PREVIEW

• empty_enumeration

Tests promoted to ALPHA

• endpoint_failure_and_restart
• pointset_remove_point
• pointset_request_extraneous
• pointset_publish
• config_logging

Full Changelog: 1.4.1...1.4.2

1.4.1

What's Changed

• Sequence doc generator by @grafnu in #428
• Fix pubber shutdown logic by @grafnu in #432
• Separate validation report from result -- state vs. event by @grafnu in #433
• Refactoring of validator++ codebase, just moving things around. by @grafnu in #434
• Onboarding discovery mapping flow by @grafnu in #365
• Mapping Engine and Agent by @grafnu in #435
• Adding script to work with git remote branches by @grafnu in #426
• Add links to learning material by @noursaidi in #438
• New gencode schema index page with categorisation by @noursaidi in #436
• Updating gencode.md docs by @grafnu in #440
• UDMIF updates for SQL/DAO and validation event handling by @slevertbiot in #444
• Validator message window and report contents by @grafnu in #439
• update external_refs with learning material links by @noursaidi in #445
• Update list in compliance.md and fix generator by @noursaidi in #446
• Add tool to view device GCP cloud logging entries by @noursaidi in #448
• Fix all existing validator/ lint warnings by @grafnu in #452
• Don't block registar devices, and refactor a bit to enable Registrar unit testing by @grafnu in #451
• Add endpoint_config_connection_error test by @johnrandolph in #455
• Fix for disabled CI integration testing and endpoint sequence test by @grafnu in #459
• Add web-server invoker and test refactoring by @grafnu in #456
• Correct writeback_state sequence test by @noursaidi in #450
• Endpoint redirection documentation by @noursaidi in #447
• Add software and hardware fields to metadata schema by @noursaidi in #462
• gittools update and venv version check by @grafnu in #471
• Add persistent store, restart cound, and utility refactoring by @grafnu in #467
• Add nonce to blob schema, and add success test by @johnrandolph in #466
• add "commit" to endpoint reconfiguration by @noursaidi in #463
• Fix semantic string generated output for endpoint connection sequence by @grafnu in #474
• Fix for broken pubber proxy device and corresponding integration test by @grafnu in #475
• Debugging and logging improvements by @grafnu in #476
• Increase test stability and cleanup some logging/debug by @grafnu in #478
• Merge buildings-iot fork to faucetsdn by @mspratt-biot in #473
• Merge different configuration objects, and create the basic foundation for profiles-in-validator by @grafnu in #480
• update comment for documentation check in CI by @noursaidi in #479
• Add missing validation pubber logs to CI output by @grafnu in #482
• Udmi web app updates by @mspratt-biot in #484
• Fixes for continuous validation by @grafnu in #486
• remove unused declare -A options in bin/pubber by @noursaidi in #490
• Add scripts to deploy blank GCP project and reflect credentials by @noursaidi in #481
• Create upversioning utility to upgrade schema and test messages version by @noursaidi in #477
• deprecate legacy dashboard and rename "dashboard" to "udmis" by @noursaidi in #488
• Update shadowjar to 7.1.2 by @grafnu in #495
• add CoV increment to schema by @noursaidi in #493
• Improve clarity in config message documentation page by @noursaidi in #492
• Add additional gcloud miscellaneous tooling by @noursaidi in #491
• Pubber endpoint configuration working with mosquitto broker by @grafnu in #497
• Split writeback tests by @noursaidi in #498
• Fix validation error for gateway state messages by @grafnu in #501
• Utility to stream messages from a given device from Pub/Sub by @noursaidi in #505
• Update stream_device_messages to add multiple devices by @noursaidi in #506
• Add misc utility to replay validated messages from validator out directory by @noursaidi in #510
• fix events prefixed as null when writing traces with validator by @noursaidi in #509
• Add shell exit traps for EXIT cleanup by @grafnu in #503
• Endpoint topic prefix configuration by @grafnu in #502
• Enable metadata schema validation by @grafnu in #504
• Fix validation report errors by @grafnu in #507
• fix udmis deploy by @noursaidi in #515
• Explicit deviceId check by @grafnu in #520
• Fix last_start sequence test inconsistencies by @grafnu in #521
• Fix for flaky mosquitto tests by @grafnu in #522
• Add units into generated config by @grafnu in #523
• Fix timeout error message by @grafnu in #525
• Validate partial pointset messages and properly cull error history by @grafnu in #527
• Various fixes to pubber and sequencer by @johnrandolph in #519
• Last seen timestamp validator fix by @grafnu in #524
• system_mode_restart by @johnrandolph in #531
• Update mapper output schema to allow multiple devices per message by @gnmerritt in #496
• generateEndpointConfigBase64Payload needs to use generateEndpointConfigClientId by @johnrandolph in #532
• Feature-neutral refactoring of testing framework by @grafnu in #528
• Add blocking/interrupt mechanism for sequence tests that timeout. by @grafnu in #526
• Generate code coverage reports locally by @johnrandolph in #537
• Cleanup of writeback tests in prep for underlying refactoring by @grafnu in #538
• Fixes #4, #6 and #19 from Google doc by @mspratt-biot in #513
• Updating min_loglevel sequence test by @grafnu in #536
• Presubmit script by @johnrandolph in #539
• Add concurrency group by @grafnu in #540
• various fixes to scripts in misc folder by @noursaidi in #541
• Adding alternate registry endpoint redirection test by @grafnu in #542
• Updates to schema components and some test improvements by @grafnu in #543
• Adding basic pylint by @grafnu in #546
• Add -e to detect missing pylint by @johnrandolph in #549
• Move testing script run sequences to a script by @johnrandolph in #548
• FeatureStage annotation for tests by @grafnu in #547
• Refactor system operations config/state bucket by @grafnu in #545
• Initial version of udmi tool wrapper by @grafnu in #552
• Endpoint tweaks to support alternate mqtt brokers/servers by @grafnu in #551
• Switch to Postgres DB for UDMIF and other various fixes by @mspratt-biot in #553
• Fix timestamp generation for pointset messages by @grafnu in #559
• sequencer tests for sample rate by @noursaidi in #518
• Minor cleanup to some generated sequences by @grafnu in #567
• Add @feature annotation with categories by @grafnu in #566
• adding "udmi validate" tool by @grafnu in #561
• Fix output stage golden file error by @grafnu in #573
• Augment scripts to allow for local file capture and playback by @grafnu in ht...

1.4.0

What's Changed

• Discovery scan_id by @grafnu in #389
• Convert validator to use cmdline args by @grafnu in #391
• Add message trace/playback capability (for testing) by @grafnu in #392
• Bump terser from 4.8.0 to 4.8.1 in /udms by @dependabot in #393
• Swarm by @grafnu in #394
• Add Validation Message out by @grafnu in #396
• Strengthen the schema w/r/t format, required fields by @johnrandolph in #397
• Fix output generation for device validation reports by @grafnu in #400
• Validation message documentation by @grafnu in #401
• Unique discovery keys by @grafnu in #402
• Merge biot udmi to faucetsdn by @slevertbiot in #388
• Add reflector utility by @grafnu in #408
• Merge biot udmi to faucetsdn by @slevertbiot in #410
• Redirect by @grafnu in #409
• Restart schema and capability by @grafnu in #411
• Refactor common SiteModel class out of Pubber by @grafnu in #413
• Creating formal schema definitions for misc config files by @grafnu in #414
• reauthTime check by @pisuke in #415
• Automatically generate category constants for Java and schema validation by @grafnu in #416
• Rename _iot_config to _iot_endpoint_config by @johnrandolph in #418
• Adding branch-status script by @grafnu in #419
• Add pubber by @johnrandolph in #417
• Endpoint Configuration Schema Update by @grafnu in #423
• git branch -update and -status tools by @grafnu in #425
• Restart testing and general pubber stability by @grafnu in #427

Full Changelog: 1.3.14...1.4.0

1.3.14

What's Changed

• Functionality-neutral refactor (mostly lint fixes) by @grafnu in #271
• Fix subType streaming validator errors by @grafnu in #272
• Deploy UDMI cloud functions with gcloud by @grafnu in #275
• Adding discovery schema only (not sequencer) by @grafnu in #268
• Update cloud functions to be region- and firebase- agnostic by @grafnu in #276
• Bump node-forge from 1.0.0 to 1.3.0 in /dashboard/functions by @dependabot in #280
• Updates to hardware/firmware version reporting by @grafnu in #254
• Check local UDMI version against upstream by @grafnu in #274
• Bump minimist from 1.2.5 to 1.2.6 in /udms by @dependabot in #282
• Bump minimist from 1.2.5 to 1.2.6 in /udms/functions by @dependabot in #281
• Reduce permissions for pubsub by @noursaidi in #273
• Make gateway error structure more flexible and single test runner by @grafnu in #277
• Cleaning up error example by @grafnu in #287
• Add MessageUpgrader to validator by @grafnu in #286
• Revert broken change by @grafnu in #292
• Send out model and config messages through registrar by @grafnu in #293
• Send validation results to audit pubSub stream by @grafnu in #294
• Add site_defaults.json in site model directory, which can supply default values to all Metadata. by @johnrandolph in #288
• Update clone_model by @johnrandolph in #297
• Delta X1 Examples by @grafnu in #298
• Refactoring of sequence testing code by @grafnu in #299
• Bump async from 2.6.3 to 2.6.4 in /udms by @dependabot in #302
• Discovery Scanning & Enumeration by @grafnu in #235
• Fix directory management by @grafnu in #303
• Updates to Pubber Swarm by @grafnu in #304
• Merge UDMIF into faucetsdn UDMI by @slevertbiot in #296
• Fix discovery and pubber race conditions by @grafnu in #311
• documentation updates by @noursaidi in #312
• add reflect region to pubber cloudiotconfig by @noursaidi in #317
• move gcp_reflect_key to validator/rsa_private by @noursaidi in #320
• fix front page links and change check_links by @noursaidi in #318
• change bin/clone_model output into /sites directory from root by @noursaidi in #322
• fix pubber null exception by @noursaidi in #324
• Bump ansi-regex from 3.0.0 to 3.0.1 in /udmif/event-handler by @dependabot in #305
• Bump minimist from 1.2.5 to 1.2.6 in /udmif/event-handler by @dependabot in #306
• Bump node-forge from 1.2.1 to 1.3.1 in /udmif/web by @dependabot in #307
• Bump minimist from 1.2.5 to 1.2.6 in /udmif/api by @dependabot in #308
• Bump async from 2.6.3 to 2.6.4 in /udmif/web by @dependabot in #309
• Bump minimist from 1.2.5 to 1.2.6 in /udmif/web by @dependabot in #310
• Adding google auth to udmif and enhancing IaC by @slevertbiot in #314
• Add some links to metadata from site model by @noursaidi in #330
• Expand list of error categories by @noursaidi in #332
• Categorise specification index page by @noursaidi in #335
• make pubsub pusher optional by @noursaidi in #325
• Fix firebase function udmi_update for retrieving stored configs by @noursaidi in #315
• delete tests/event_discovery.json directory by @noursaidi in #336
• Change examples according to latest schema version by @noursaidi in #323
• Include UDMI version of deployed cloud functions by @grafnu in #339
• Add additional pubber opts by @noursaidi in #338
• Fix schema for min_loglevel, etc by @johnrandolph in #300
• Fix pubber for proxy device through gateway, and also periodic discovery timing by @grafnu in #341
• Cleanup shutdown/startup process by @grafnu in #342
• Shell change to be more explicit about shell numeric comparisons by @johnrandolph in #301
• Script to delete bad tags from the repo by @grafnu in #347
• Add dryrun option -n by @johnrandolph in #349
• Basic unit test framework for the validator tool by @grafnu in #354
• Bump eventsource from 1.1.0 to 1.1.1 in /udms by @dependabot in #348
• Bump protobufjs from 6.11.2 to 6.11.3 in /dashboard/functions by @dependabot in #351
• Bump protobufjs from 6.10.2 to 6.11.3 in /udms/functions by @dependabot in #352
• Bump protobufjs from 6.10.2 to 6.11.3 in /udms by @dependabot in #353
• Remove deprecated udms tests (slow and flaky) by @grafnu in #355
• Validate pointset state missing points by @grafnu in #356
• Need to shift by number of options parsed by @johnrandolph in #350
• Add sequence test to make sure config messages are properly acked by a client. by @grafnu in #358
• add no_hardware to pubber options by @noursaidi in #340
• Add device discovery ancillary by @grafnu in #363
• Downgrade config generation by @grafnu in #362
• add a discovery event example from a bacnet scan by @gnmerritt in #370
• Redact some more expected out for site tests by @grafnu in #375
• Add validation to Registrar. Add RegistrarTest to exercise it. by @johnrandolph in #361
• Update discovery system fields by @grafnu in #374
• pass arguments to gcloud deploy by @noursaidi in #357
• Add enabled pubber options to startup log by @noursaidi in #369
• default registrar to block extra devices by @noursaidi in #382
• Make hardware.make and hardware.model required by @noursaidi in #381
• add pubber missingPoint and noConfigAck options by @noursaidi in #368

New Contributors

• @slevertbiot made their first contribution in #296
• @gnmerritt made their first contribution in #370

Full Changelog: 1.3.13...1.3.14