v2.4.4: General improvements in AI assistant

Added

• Introduced a new configuration option for controlling the invocation of Nuclio functions.
  (#6146)

Changed

• Relocated SAM masks decoder to frontend operation.
  (#6019)
• Switched person-reidentification-retail-0300 and faster_rcnn_inception_v2_coco Nuclio functions with person-reidentification-retail-0277 and faster_rcnn_inception_resnet_v2_atrous_coco respectively.
  (#6129)
• Upgraded OpenVINO-based Nuclio functions to utilize the OpenVINO 2022.3 runtime.
  (#6129)

Fixed

• Resolved issues with tracking multiple objects (30 and more) using the TransT tracker.
  (#6073)
• Addressed azure.core.exceptions.ResourceExistsError: The specified blob already exists.
  (#6082)
• Corrected image scaling issues when transitioning between images of different resolutions.
  (#6081)
• Fixed inaccurate reporting of completed job counts.
  (#6098)
• Allowed OpenVINO-based Nuclio functions to be deployed to Kubernetes.
  (#6129)
• Improved skeleton size checks after drawing.
  (#6156)
• Fixed HRNet CPU serverless function.
  (#6150)
• Prevented sending of empty list of events.
  (#6154)

Full Changelog: v2.4.3...v2.4.4

v2.4.3: Small infrastructure improvements

Changed

• Docker images no longer include Ubuntu package sources or FFmpeg/OpenH264 sources
  (#6040)
• TUS chunk size changed from 100 MB to 2 MB
  (#6058)

Full Changelog: v2.4.2...v2.4.3

v2.4.2: Segment Anything Model in CVAT

• Now SAM is available in CVAT self-hosted solution.
  Read more in The Facebook Segment Anything Model is now available in the self-hosted version of CVAT.
  

• Support for Azure Blob Storage connection string: This update adds support for Connection String authentication for Azure Blob Storage. This means that you can use Azure Blob Storage on the IoT Edge of an edge device.

• The issue related to webhook events not being sent has been resolved.

New Contributors

• @suzusuzu made their first contribution in #4649
• @Bassileios made their first contribution in #5731

Full Changelog: v2.4.1...v2.4.2

v2.4.1: Optimized annotations fetching

Fixed

• Optimized annotations fetching up to 10 times (#5974)
• Incorrect calculation of working time in analytics (#5973)

v2.4.0: 3D Cuboids interpolation, advanced analytics, and PyTorch dataset adapter in SDK

In this release, we’ve introduced new features based on our vision and suggestions in the CVAT community. Thank you for reaching out and providing us with valuable feedback. Here is the list of features we are shipping in the CVAT v2.4.0

• Added the grid view and support of the contextual images for 2D and 3D tasks. For more information, see Contextual images.

  

• Added Interpolation for 3D cuboids. Also, annotation can be exported and imported in Datumaro and Supervisely Point Cloud formats.

• Added Yolo v7 serverless functionally for automated annotation.

• Collections in server API were redesigned for improved performance.

• Added simple filters for collection endpoints in API. For example, now you can filter the tasks by username: /tasks?project_id=42&user=myusername

• Improved analytics and enriched it with the following features: log collection from UI and server, exceptions collection, user activity visualization, aggregation of user and job working time, and log filtering for debugging purposes. Analytics are now based on ClickHouse + Vector + Grafana.

  

• Improved the work of the Pytorch adapter also known as the cvat_sdk.pytorch module, which allows you to use a CVAT project or task directly as a PyTorch-compatible dataset, eliminating the need for intermediate representation. For more information, see CVAT SDK Pytorch Adapter.

• Improved high-level SDK APIs for task data uploading. The default data source is now the local file system. Added an option to wait for data processing to finish after data uploading, the option is turned on by default.

• Added high-level API for working with organizations. For more information, see High-level API.

New Contributors

• @scottykwok made their first contribution in #5370
• @Bytestorm5 made their first contribution in #5558
• @hardikdava made their first contribution in #5552
• @michael-selasi-dzamesi made their first contribution in #5360
• @waqarsqureshi made their first contribution in #4665
• @MyNameIsFu made their first contribution in #5005
• @mats16 made their first contribution in #5533
• @vainkop made their first contribution in #5585
• @ddx-day made their first contribution in #5059
• @Sothatsit made their first contribution in #5609
• @saifkhichi96 made their first contribution in #5805
• @FObermaier made their first contribution in #5835
• @RyanHir made their first contribution in #5848

Full Changelog: v2.3.0...v2.4.0

v2.3.0: Brush tool, WebHooks, and Social auth

In this release, we’ve introduced new features based on our vision and suggestions in the CVAT community, plus addressed more than 20+ reported bugs. Thank you for reaching out and providing us with valuable feedback. Here is the list of features we are shipping:

• Added the Brush tool to create pixel masks for disjoint objects with multiple parts: a house hiding behind trees, a car behind a pedestrian, or a pillar behind a traffic sign. Read more.

  

• Added Webhooks for Projects and Organizations. Configure them to handle application notifications about changes in a specific project or organization. Read more.

  

• Added sorting by Z-Order: farthest from the camera objects go on the top of the list. Now sorted objects have an additional indication on the objects sidebar.

  

• Enabled leveraging of NVIDIA GPU for YOLO v5 serverless function. Now you can annotate with YOLO faster.

• Added social accounts authentication. Now you can log in to CVAT using your social auth accounts:

  • For App CVAT: Google and GitHub.
  • For local version: Google, GitHub, and the possibility to configure Social Auth with Django services.

• Added email authentication. Now you can authenticate in CVAT with your email instead of login.

  

• Added Propagation backward to the Confirm Propagation widget, now propagation works both ways.

  

New Contributors

• @AlexeyAlexeevXperienceAI made their first contribution in #4824
• @rhee-elten made their first contribution in #4947
• @KoheiKanagu made their first contribution in #4659
• @arvfilippov made their first contribution in #5014
• @saurabheights made their first contribution in #5030
• @tdhooghe made their first contribution in #4960
• @alex4men made their first contribution in #5101
• @inpv made their first contribution in #5192
• @ftconan made their first contribution in #4647
• @arkravchuk made their first contribution in #4712
• @mdacoca made their first contribution in #5269

Full Changelog: v2.2.0...v2.3.0
CHANGELOG.md: https://github.com/opencv/cvat/blob/v2.3.0/CHANGELOG.md

v2.2.0: Skeletons and SDK

Summary

• Human Pose, Facial Landmarks, and similar use cases. See annotation with skeletons. Import and export of COCO Keypoints format.

  

• Frame deleting in a job

  

• Better tags visualization in classification mode

  

• Serverless functions can return objects with attributes

• CVAT SDK on PyPI. Install using pip install cvat-sdk

• CVAT CLI on PyPI. Install using pip install cvat-cli

• Improved helm chart

What's Changed

• Added ATLANTIS in README. by @smhassanerfani in #4423
• fixed: Permission error occured when accessing the JobCommits #4434 by @k1won in #4435
• fixed: job assignee can remove or update any issue created by the tas… by @k1won in #4436
• Feature/fixed build macos by @evekeen in #4414
• Fixed bug: Incorrect point deletion with keyboard shortcut by @klakhov in #4420
• Enhanced filtration/sorting for tasks/projects/tasks in projects/cloud storages by @bsekachev in #4409
• Tus for task annotations import by @klakhov in #4327
• Bump pillow from 9.0.0 to 9.0.1 in /utils/dataset_manifest by @dependabot in #4447
• Bump pillow from 9.0.0 to 9.0.1 in /utils/dicom_converter by @dependabot in #4446
• Intel® Bug Bounty Program by @nmanovic in #4454
• Remote files test by @azhavoro in #4443
• Added missing geos dependency by @evekeen in #4451
• Update REST API documentation by @Marishka17 in #4391
• Improve REST API testing system by @kirill-sizov in #4403
• Better readme to Helm chart by @kbegiedza in #4366
• fix linter issue by @Marishka17 in #4488
• Update documentation. Update sections about pages by @TOsmanov in #4480
• REST API tests: patch tasks, post/patch issues by @ActiveChooN in #4465
• Tus for project dataset by @klakhov in #4485
• Support paginated list for job commits #4476 by @k1won in #4482
• Add REST API GET, POST, PATCH tests for cloud storage by @Marishka17 in #4353
• Bump minimist from 1.2.5 to 1.2.6 in /cvat-core by @dependabot in #4509
• Bump minimist from 1.2.5 to 1.2.6 in /cvat-ui by @dependabot in #4510
• Bump minimist from 1.2.5 to 1.2.6 in /tests by @dependabot in #4511
• Fixed bug: Draw new label/tag by shortcut after annotate a tag blocks "Rectangle" selection button in side-bar by @klakhov in #4517
• fixed: Unable to upload annotations #4459 by @k1won in #4513
• Fix AI Tools by @amteusch in #4505
• Support CVAT 2.X deployment using helm by @se-wo in #4448
• fix build dependencies for Siammask by @VRichardJP in #4486
• Fix filter for getting cloud storage on task creation page by @Marishka17 in #4541
• EXIF orientation support by @ActiveChooN in #4529
• REST API tests: project accessibility by @ivk in #4496
• Bump moment from 2.29.1 to 2.29.2 by @dependabot in #4559
• Bump ansi-regex from 5.0.0 to 5.0.1 in /tests by @dependabot in #4566
• Bump ansi-regex from 3.0.0 to 3.0.1 in /cvat-core by @dependabot in #4565
• Revert Open3D to 0.11.2 by @ngaloppo in #4639
• fix auto-annotation group_id issue (#3676) by @zwfcrazy in #4579
• Hotfix: fix container name by @kirill-sizov in #4814
• Fix docker-compose.https.yml service names by @pockethook in #4847
• Fixed hot reload when develop with yarn by @bsekachev in #4825
• Update guide by @azhavoro in #4812
• Fix rest api test by @kirill-sizov in #4871
• SDK layer 2 - cover RC1 usecases by @zhiltsov-max in #4813
• Added stylelint check to precommit git hook by @bsekachev in #4826
• Added track removing confirmation by @bsekachev in #4846
• Added dumping a skeleton on a created resource, fixed some styles by @bsekachev in #4829
• Fixed project filtration by @bsekachev in #4878
• [WIP] Fix github pages base URL by @W-Schmitt in #4877
• Adjusted application links by @bsekachev in #4880
• Some fixes for skeleton patch related with merge & delete, undo/redo by @bsekachev in #4875
• Fixed actions_users/case_38_feedback_button by @klakhov in #4885
• Fixed jest tests by @bsekachev in #4887
• Extend COCO format to skeletons by @yasakova-anastasia in #4821
• Fixed issue: Maximum callstack exceed by @bsekachev in #4836
• Added some JEST tests to cover skeleton basic features by @bsekachev in #4865
• Added end-to-end Cypress tests for Skeletons pipeline by @bsekachev in #4892
• Initial version of update_version.py script to bump CVAT version by @azhavoro in #4889
• Add support for Oracle OCI Buckets by @rodrigoberriel in #4876
• updated the FAQ.md by @chernov-a in #4902
• SDK alpha 1 release by @zhiltsov-max in #4903
• Fix workflows after cvat container was renamed by @nmanovic in #4848
• Fixed invocation of serverless functions by @azhavoro in #4907
• Fixed redrawing a skeleton (Shift+N) by @bsekachev in #4906
• Align server api, sdk and cli versions to 2.1.0 by @zhiltsov-max in #4913
• Add host schema auto-detection in SDK by @zhiltsov-max in #4910
• Fix python3.7 compatibility by @zhiltsov-max in #4919
• Bump sdk version and update deps by @zhiltsov-max in #4923
• Fix bug with removing attributes by @yasakova-anastasia in #4927
• updated installation guide by @azhavoro in #4926
• Some documentation added for skeletons feature by @bsekachev in #4925
• Update COCO documentation by @yasakova-anastasia in #4908
• Update workflow configs by @kirill-sizov in #4930
• Fixed missing notification on cloud storage creation page when manifest file is required by @Marishka17 in #4921
• fix type declaration of private fields in cvat-canvas which are possibly null by @tjdans1114 in #4932

New Contributors

• @smhassanerfani made their first contribution in #4423
• @evekeen made their first contribution in #4414
• @kbegiedza made their first contribution in #4366
• @amteusch made their first contribution in #4505
• @se-wo made their first contribution in #4448
• @VRichardJP made their first contribution in #4486
• @ivk made their first contribution in #4496
• @ngaloppo made their first contribution in #4639
• @zwfcrazy made their first contribution in #4579
• @pockethook made their first contribution in #4847
• @W-Schmitt made their first contribution in #4877
• @rodrigoberriel made their first contribution in #4876
• @chernov-a made their first contribution in #4902
• @tjdans1114 made their first contribution in #4932

Full Changelog: https://github.com/opencv/cvat/...

v2.1.0: Advanced filtration and sorting

Added

• Task annotations importing via chunk uploads (#4327)
• Advanced filtration and sorting for a list of tasks/projects/cloudstorages (#4403)
• Project dataset importing via chunk uploads (#4485)
• Support paginated list for job commits (#4482)

Changed

• Added missing geos dependency into Dockerfile (#4451)
• Improved helm chart readme (#4366)
• Added helm chart support for CVAT 2.X and made ingress compatible with Kubernetes >=1.22 (#4448)

Fixed

• Permission error occured when accessing the JobCommits (#4435)
• job assignee can remove or update any issue created by the task owner (#4436)
• Bug: Incorrect point deletion with keyboard shortcut (#4420)
• some AI Tools were not sending responses properly (#4432)
• Unable to upload annotations (#4513)
• Fix build dependencies for Siammask (#4486)
• Bug: Exif orientation information handled incorrectly (#4529)

New Contributors

• @smhassanerfani made their first contribution in #4423
• @evekeen made their first contribution in #4414
• @kbegiedza made their first contribution in #4366
• @amteusch made their first contribution in #4505
• @se-wo made their first contribution in #4448
• @VRichardJP made their first contribution in #4486
• @ivk made their first contribution in #4496

v2.0.0: Advanced authorization and organizations

Summary

• Permissions management system using open policy agent (https://www.openpolicyagent.org/). Now it is possible to create organizations and work on projects, tasks, and jobs in a team.

  

• Rotated bounding boxes (https://openvinotoolkit.github.io/cvat/v2.0.0/docs/manual/advanced/annotation-with-rectangles/#rotation-rectangle)

  

• Ellipses (https://openvinotoolkit.github.io/cvat/v2.0.0/docs/manual/advanced/annotation-with-ellipses/)

  

• Jobs page with filtration capabilities (https://openvinotoolkit.github.io/cvat/v2.0.0/docs/manual/basics/jobs-page/)

  

• Import datasets in public formats like MS COCO, Pascal VOC, YOLO into a project (https://openvinotoolkit.github.io/cvat/v2.0.0/docs/manual/advanced/export-import-datasets/#import-dataset)

  

• Google Cloud Storage support in UI (https://openvinotoolkit.github.io/cvat/v2.0.0/docs/manual/basics/attach-cloud-storage/#using-google-cloud-storage).

  

• OpenCV.js TrackerMIL tracker (https://openvinotoolkit.github.io/cvat/v2.0.0/docs/manual/advanced/opencv-tools/#trackermil)

  

• Import and export new dataset formats: KITTI, LFW, Cityscapes, Open Images v6 (https://openvinotoolkit.github.io/cvat/v2.0.0/docs/manual/advanced/formats/)

• YOLOv5 serverless function for automatic annotation. Possibility to automatically annotate tags and attributes using serverless functions (https://openvinotoolkit.github.io/cvat/v2.0.0/docs/manual/advanced/serverless-tutorial/)

• Player option: Smooth image when zoom-in (left: smoothing, right: without smoothing)

  

• Options to change font size & position of text labels on the canvas

  

• API versioning scheme: accept header versioning instead of namespace versioning. The new version of REST API is v2.0.0-alpha. We are not going to support backward compatibility for now. Please expect that it will be changed even without its version update.

Added

• Handle attributes coming from nuclio detectors (#3917)
• Add additional environment variables for Nuclio configuration (#3894)
• Add KITTI segmentation and detection format (#3757)
• Add LFW format (#3770)
• Add Cityscapes format (#3758)
• Add Open Images V6 format (#3679)
• Rotated bounding boxes (#3832)
• Player option: Smooth image when zoom-in, enabled by default (#3933)
• Google Cloud Storage support in UI (#3919)
• Add project tasks pagination (#3910)
• Add remove issue button (#3952)
• Data sorting option (#3937)
• Options to change font size & position of text labels on the canvas (#3972)
• Add "tag" return type for automatic annotation in Nuclio (#3896)
• Helm chart: Make user-data-permission-fix optional (#3994)
• Advanced identity access management system, using open policy agent (#3788)
• Organizations to create "shared space" for different groups of users (#3788)
• Dataset importing to a project (#3790)
• User is able to customize information that text labels show (#4029)
• Support for uploading manifest with any name (#4041)
• Added information about OpenVINO toolkit to login page (#4077)
• Support for working with ellipses (#4062)
• Add several flags to task creation CLI (#4119)
• Add YOLOv5 serverless function for automatic annotation (#4178)
• Add possibility to change git repository and git export format from already created task (#3886)
• Basic page with jobs list, basic filtration to this list (#4258)
• Added OpenCV.js TrackerMIL as tracking tool (#4200)
• Ability to continue working from the latest frame where an annotator was before (#4297)
• GET /api/jobs/<id>/commits was implemented (#4368)
• Advanced filtration and sorting for a list of jobs (#4319)

Changed

• Users don't have access to a task object anymore if they are assigned only on some jobs of the task (#3788)
• Different resources (tasks, projects) are not visible anymore for all CVAT instance users by default (#3788)
• API versioning scheme: using accept header versioning instead of namespace versioning (#4239)
• Replaced 'django_sendfile' with 'django_sendfile2' (#4267)
• Use drf-spectacular instead of drf-yasg for swagger documentation (#4210)

Deprecated

• Job field "status" is not used in UI anymore, but it has not been removed from the database yet (#3788)

Removed

• Review rating, reviewer field from the job instance (use assignee field together with stage field instead) (#3788)
• Training django app (#4330)
• v1 api version support (#4332)

Fixed

• Fixed Interaction handler keyboard handlers (#3881)
• Points of invisible shapes are visible in autobordering (#3931)
• Order of the label attributes in the object item details(#3945)
• Order of labels in tasks and projects (#3987)
• Fixed task creating with large files via webpage (#3692)
• Added information to export CVAT_HOST when performing local installation for accessing over network (#4014)
• Fixed possible color collisions in the generated colormap (#4007)
• Original pdf file is deleted when using share (#3967)
• Order in an annotation file(#4087)
• Fixed task data upload progressbar (#4134)
• Email in org invitations is case sensitive (#4153)
• Caching for tasks and jobs can lead to an exception if its assignee user is removed (#4165)
• Added intelligent function when paste labels to another task (#4161)
• Uncaught TypeError: this.el.node.getScreenCTM() is null in Firefox (#4175)
• Bug: canvas is busy when start playing, start resizing a shape and do not release the mouse cursor (#4151)
• Bug: could not receive frame N. TypeError: Cannot read properties of undefined (reding "filename") (#4187)
• Cannot choose a dataset format for a linked repository if a task type is annotation (#4203)
• Fixed tus upload error over https (#4154)
• Issues disappear when rescale a browser (#4189)
• Auth token key is not returned when registering without email verification (#4092)
• Error in create project from backup for standard 3D ann...

v2.0.0-alpha

Summary

• Added OpenVINO logo and links to OpenVINO toolkit to the CVAT login page

  

• Implemented advanced identity access management system (IAM) using Open Policy Agent. Now CVAT has configurable rules to provide access to different resources on the server. Users can create organizations to manage resources together. We had more than 15 issues on GitHub which described different use cases from community and Intel customers (e.g., #3950, #2708, #2637, #2681).

  

• Implemented rotated bounding boxes. The feature was requested by our community multiple times to annotate objects in different scenarios.

  

• Added new annotation formats for import/export of datasets: KITTI, LFW, Cityscapes, Open Images v6

• Implemented backup of projects to move them from one CVAT instance to another easily (previously it was implemented only for annotation tasks):

  

• Implemented import of datasets. Now it is possible to create a project from datasets in MS COCO, Pascal VOC, ImageNet and other formats.

Details

Added

• Add additional environment variables for Nuclio configuration (#3894)
• Add KITTI segmentation and detection format (#3757)
• Add LFW format (#3770)
• Add Cityscapes format (#3758)
• Add Open Images V6 format (#3679)
• Rotated bounding boxes (#3832)
• Player option: Smooth image when zoom-in, enabled by default (#3933)
• Google Cloud Storage support in UI (#3919)
• Add project tasks paginations (#3910)
• Add remove issue button (#3952)
• Data sorting option (#3937)
• Options to change font size & position of text labels on the canvas (#3972)
• Add "tag" return type for automatic annotation in Nuclio (#3896)
• Advanced identity access management system, using open policy agent (#3788)
• Organizations to create "shared space" for different groups of users (#3788)
• Dataset importing to a project (#3790)
• User is able to customize information that text labels show (#4029)
• Support for uploading manifest with any name (#4041)
• Added information about OpenVINO toolkit to login page (#4077)

Changed

• Users don't have access to a task object anymore if they are assigneed only on some jobs of the task (#3788)
• Different resources (tasks, projects) are not visible anymore for all CVAT instance users by default (#3788)

Deprecated

• Job field "status" is not used in UI anymore, but it has not been removed from the database yet (#3788)

Removed

• Review rating, reviewer field from the job instance (use assignee field together with stage field instead) (#3788)

Fixed

• Fixed Interaction handler keyboard handlers (#3881)
• Points of invisible shapes are visible in autobordering (#3931)
• Order of the label attributes in the object item details(#3945)
• Order of labels in tasks and projects (#3987)
• Fixed task creating with large files via webpage (#3692)
• Added information to export CVAT_HOST when performing local installation for accessing over network (#4014)
• Fixed possible color collisions in the generated colormap (#4007)
• Original pdf file is deleted when using share(#3967)

Security

• Updated ELK to 6.8.22 which uses log4j 2.17.0 (#4052)