{"payload":{"feedbackUrl":"https://github.com/orgs/community/discussions/53140","repo":{"id":723015178,"defaultBranch":"develop","name":"multimodal-maestro","ownerLogin":"roboflow","currentUserCanPush":false,"isFork":false,"isEmpty":false,"createdAt":"2023-11-24T13:28:57.000Z","ownerAvatar":"https://avatars.githubusercontent.com/u/53104118?v=4","public":true,"private":false,"isOrgOwned":true},"refInfo":{"name":"","listCacheKey":"v0:1705962144.0","currentOid":""},"activityList":{"items":[{"before":"6b30a879b1488b5cc9188c3c4c17cc99461030ba","after":"88a274b9ec32216ac8abf20a2ddf36d575a413b2","ref":"refs/heads/gh-pages","pushedAt":"2024-01-31T07:32:32.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Deployed 37848b0 with MkDocs version: 1.5.3","shortMessageHtmlLink":"Deployed 37848b0 with MkDocs version: 1.5.3"}},{"before":"d1dfcd403a21f1e60820c30427cfc69a1e884272","after":"37848b0ade155ff5ce0335b710bba6eed40ea5c0","ref":"refs/heads/develop","pushedAt":"2024-01-31T07:31:56.000Z","pushType":"pr_merge","commitsCount":2,"pusher":{"login":"SkalskiP","name":"Piotr Skalski","path":"/SkalskiP","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/26109316?s=80&v=4"},"commit":{"message":"Merge pull request #23 from roboflow/add-zoominfo\n\nAdd ZoomInfo integration","shortMessageHtmlLink":"Merge pull request #23 from roboflow/add-zoominfo"}},{"before":null,"after":"0ca9970ef0641be78b0dfa6301d23b27555dede1","ref":"refs/heads/dependabot/pip/pillow-10.2.0","pushedAt":"2024-01-22T22:22:24.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"dependabot[bot]","name":null,"path":"/apps/dependabot","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/29110?s=80&v=4"},"commit":{"message":"Bump pillow from 10.1.0 to 10.2.0\n\nBumps [pillow](https://github.com/python-pillow/Pillow) from 10.1.0 to 10.2.0.\n- [Release notes](https://github.com/python-pillow/Pillow/releases)\n- [Changelog](https://github.com/python-pillow/Pillow/blob/main/CHANGES.rst)\n- [Commits](https://github.com/python-pillow/Pillow/compare/10.1.0...10.2.0)\n\n---\nupdated-dependencies:\n- dependency-name: pillow\n dependency-type: indirect\n...\n\nSigned-off-by: dependabot[bot] ","shortMessageHtmlLink":"Bump pillow from 10.1.0 to 10.2.0"}},{"before":null,"after":"7e004db13030417cbabef4071c553b852fd81475","ref":"refs/heads/dependabot/pip/jinja2-3.1.3","pushedAt":"2024-01-11T21:55:52.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"dependabot[bot]","name":null,"path":"/apps/dependabot","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/29110?s=80&v=4"},"commit":{"message":"Bump jinja2 from 3.1.2 to 3.1.3\n\nBumps [jinja2](https://github.com/pallets/jinja) from 3.1.2 to 3.1.3.\n- [Release notes](https://github.com/pallets/jinja/releases)\n- [Changelog](https://github.com/pallets/jinja/blob/main/CHANGES.rst)\n- [Commits](https://github.com/pallets/jinja/compare/3.1.2...3.1.3)\n\n---\nupdated-dependencies:\n- dependency-name: jinja2\n dependency-type: indirect\n...\n\nSigned-off-by: dependabot[bot] ","shortMessageHtmlLink":"Bump jinja2 from 3.1.2 to 3.1.3"}},{"before":null,"after":"fe70022b3618425b41b5b1335e33658eb947b428","ref":"refs/heads/add-zoominfo","pushedAt":"2023-12-21T15:26:08.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"capjamesg","name":"James","path":"/capjamesg","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/37276661?s=80&v=4"},"commit":{"message":"add zoominfo","shortMessageHtmlLink":"add zoominfo"}},{"before":null,"after":"1be83c6097e73f85a3e60e22eba08878a05ba608","ref":"refs/heads/dependabot/pip/transformers-4.36.0","pushedAt":"2023-12-20T21:18:23.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"dependabot[bot]","name":null,"path":"/apps/dependabot","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/29110?s=80&v=4"},"commit":{"message":"Bump transformers from 4.35.2 to 4.36.0\n\nBumps [transformers](https://github.com/huggingface/transformers) from 4.35.2 to 4.36.0.\n- [Release notes](https://github.com/huggingface/transformers/releases)\n- [Commits](https://github.com/huggingface/transformers/compare/v4.35.2...v4.36.0)\n\n---\nupdated-dependencies:\n- dependency-name: transformers\n dependency-type: direct:production\n...\n\nSigned-off-by: dependabot[bot] ","shortMessageHtmlLink":"Bump transformers from 4.35.2 to 4.36.0"}},{"before":"3422005c5f8a42a20260e7018a35ee329465c5b1","after":"c27f3bd1ecaa330acd2bb6638b68d43d45a4d38f","ref":"refs/heads/feature/pipelines","pushedAt":"2023-12-04T17:46:50.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"SkalskiP","name":"Piotr Skalski","path":"/SkalskiP","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/26109316?s=80&v=4"},"commit":{"message":"Update site description and improve code clarity in sam_segmentation","shortMessageHtmlLink":"Update site description and improve code clarity in sam_segmentation"}},{"before":"1157fc5ccf82cd842c2c1f1fe2366541fb5ee724","after":"3422005c5f8a42a20260e7018a35ee329465c5b1","ref":"refs/heads/feature/pipelines","pushedAt":"2023-12-04T17:39:25.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"SkalskiP","name":"Piotr Skalski","path":"/SkalskiP","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/26109316?s=80&v=4"},"commit":{"message":"Remove old files and refactor code for modularity\n\nDeleted 'get_started.md', 'lmms.md', 'markers.md', 'visualizers.md', and 'visualizers.py' due to changes in the project structure and features. Extracted 'extract_mark_ids' method and placed it in 'sam_segmentation.py' for better coherence. Modified 'maestro/__init__.py' and 'mkdocs.yaml' to reflect current file structure and update some definitions. Furthermore, added new features to 'sam_segmentation.py'. These changes improve code modularity and update the project with new features.","shortMessageHtmlLink":"Remove old files and refactor code for modularity"}},{"before":"71943ee1c5cd90284d5ac86e49b0a8c16f86b153","after":"1157fc5ccf82cd842c2c1f1fe2366541fb5ee724","ref":"refs/heads/feature/pipelines","pushedAt":"2023-12-04T17:00:56.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"SkalskiP","name":"Piotr Skalski","path":"/SkalskiP","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/26109316?s=80&v=4"},"commit":{"message":"Refactor code for better modularity and add new features\n\nDeleted the primitives.py and postprocessing.text.py files along with their corresponding tests as their functionalities have been refactored. parse_mark_id method from the deleted files have been moved to sam_segmentation.py which is a simplified version of the extract_marks_in_brackets method and is more suitable for the task at hand. extract_relevant_masks has been replaced by a process method in SamResponseProcessor which extracts the relevant mark ids from the text and uses them to index the detections object.\n\nThe mark generating classes have been moved to the wrappers directory as they are effectively serving as wrappers around existing models. Made these changes to make the classes more modular, easy to understand and use. They can be extended in the future to include more models other than SAM.\n\nAlso, created two new abstract base classes BasePromptCreator and BaseResponseProcessor in base.py file under pipelines directory. These two classes would be used to ensure a consistent structure across different pipelines.\n\nIn maestro/__init__.py, SegmentAnythingMarkGenerator was renamed to SegmentAnything to adhere to the new structure. Bumped the version of Maestro to 0.2.0rc1 from 0.1.1rc1 reflecting the amount of changes made. Finally, updated README.md to reflect the changes made to the API but the new API usage example still needs to be added.","shortMessageHtmlLink":"Refactor code for better modularity and add new features"}},{"before":"69a0892ad97c8736a679743fd40f4c07b7114621","after":"6b30a879b1488b5cc9188c3c4c17cc99461030ba","ref":"refs/heads/gh-pages","pushedAt":"2023-12-04T12:07:53.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Deployed d1dfcd4 with MkDocs version: 1.5.3","shortMessageHtmlLink":"Deployed d1dfcd4 with MkDocs version: 1.5.3"}},{"before":"85b08abc431f64eeedfb245e51b30d0bedee3477","after":"d1dfcd403a21f1e60820c30427cfc69a1e884272","ref":"refs/heads/develop","pushedAt":"2023-12-04T12:07:24.000Z","pushType":"pr_merge","commitsCount":2,"pusher":{"login":"SkalskiP","name":"Piotr Skalski","path":"/SkalskiP","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/26109316?s=80&v=4"},"commit":{"message":"Merge pull request #20 from roboflow/bug/handle_empty_mask_edge_case_on_masks_to_marks\n\nHandle empty mask edge case in postprocessing.","shortMessageHtmlLink":"Merge pull request #20 from roboflow/bug/handle_empty_mask_edge_case_…"}},{"before":null,"after":"2817b5317a58d40aaa18487f64d3b67aa6abaf33","ref":"refs/heads/bug/handle_empty_mask_edge_case_on_masks_to_marks","pushedAt":"2023-12-04T12:03:02.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"SkalskiP","name":"Piotr Skalski","path":"/SkalskiP","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/26109316?s=80&v=4"},"commit":{"message":"Handle empty mask edge case in postprocessing.","shortMessageHtmlLink":"Handle empty mask edge case in postprocessing."}},{"before":"f419219db0ed079463f73bb6126e56762a7de5fb","after":"69a0892ad97c8736a679743fd40f4c07b7114621","ref":"refs/heads/gh-pages","pushedAt":"2023-12-04T11:48:08.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Deployed 85b08ab with MkDocs version: 1.5.3","shortMessageHtmlLink":"Deployed 85b08ab with MkDocs version: 1.5.3"}},{"before":"5b055e57fe950ddb8d4f116be6cb3d762d4cc661","after":"85b08abc431f64eeedfb245e51b30d0bedee3477","ref":"refs/heads/develop","pushedAt":"2023-12-04T11:47:40.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"SkalskiP","name":"Piotr Skalski","path":"/SkalskiP","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/26109316?s=80&v=4"},"commit":{"message":"Update README.md","shortMessageHtmlLink":"Update README.md"}},{"before":"2cb758cc5fe59b84fb0f8bad6363c204bd42222e","after":"f419219db0ed079463f73bb6126e56762a7de5fb","ref":"refs/heads/gh-pages","pushedAt":"2023-12-04T11:45:20.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Deployed 5b055e5 with MkDocs version: 1.5.3","shortMessageHtmlLink":"Deployed 5b055e5 with MkDocs version: 1.5.3"}},{"before":"80f3294cb82c0812ab3da1a69acf4d3a31d3f089","after":"5b055e57fe950ddb8d4f116be6cb3d762d4cc661","ref":"refs/heads/develop","pushedAt":"2023-12-04T11:44:50.000Z","pushType":"pr_merge","commitsCount":2,"pusher":{"login":"SkalskiP","name":"Piotr Skalski","path":"/SkalskiP","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/26109316?s=80&v=4"},"commit":{"message":"Merge pull request #19 from roboflow/feature/grounding_dino_and_gpt4_vision_cookbook\n\nAdd new \"grounding_dino_and_gpt4_vision\" notebook","shortMessageHtmlLink":"Merge pull request #19 from roboflow/feature/grounding_dino_and_gpt4_…"}},{"before":null,"after":"98d5878ecd93dbbac5c57b1bcf437f1382422a2f","ref":"refs/heads/feature/grounding_dino_and_gpt4_vision_cookbook","pushedAt":"2023-12-04T11:42:58.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"SkalskiP","name":"Piotr Skalski","path":"/SkalskiP","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/26109316?s=80&v=4"},"commit":{"message":"Add new \"grounding_dino_and_gpt4_vision\" notebook","shortMessageHtmlLink":"Add new \"grounding_dino_and_gpt4_vision\" notebook"}},{"before":null,"after":"71943ee1c5cd90284d5ac86e49b0a8c16f86b153","ref":"refs/heads/feature/pipelines","pushedAt":"2023-12-04T11:02:51.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"SkalskiP","name":"Piotr Skalski","path":"/SkalskiP","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/26109316?s=80&v=4"},"commit":{"message":"Add Sam segmentation pipeline classes\n\nThis commit introduces two new classes, SamPromptCreator and SamResponseProcessor, in sam_segmentation.py.","shortMessageHtmlLink":"Add Sam segmentation pipeline classes"}},{"before":"80910a174f55a6d4b76cb794b2c67311cdc7c28d","after":"2cb758cc5fe59b84fb0f8bad6363c204bd42222e","ref":"refs/heads/gh-pages","pushedAt":"2023-12-01T16:50:59.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Deployed 80f3294 with MkDocs version: 1.5.3","shortMessageHtmlLink":"Deployed 80f3294 with MkDocs version: 1.5.3"}},{"before":"70b9d7cf407f4a7187e2fb35b2fa03b46e77f952","after":"80f3294cb82c0812ab3da1a69acf4d3a31d3f089","ref":"refs/heads/develop","pushedAt":"2023-12-01T16:50:32.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"SkalskiP","name":"Piotr Skalski","path":"/SkalskiP","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/26109316?s=80&v=4"},"commit":{"message":"Add redesigned API infographic to `README.md`","shortMessageHtmlLink":"Add redesigned API infographic to README.md"}},{"before":"9ef6614a7dc3ca5fac1e513ada6abeae5fbac345","after":"80910a174f55a6d4b76cb794b2c67311cdc7c28d","ref":"refs/heads/gh-pages","pushedAt":"2023-12-01T13:49:09.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Deployed 70b9d7c with MkDocs version: 1.5.3","shortMessageHtmlLink":"Deployed 70b9d7c with MkDocs version: 1.5.3"}},{"before":"971dc70f018d6b245dbdb2cba7bab9de85a56ecc","after":"70b9d7cf407f4a7187e2fb35b2fa03b46e77f952","ref":"refs/heads/develop","pushedAt":"2023-12-01T13:48:40.000Z","pushType":"pr_merge","commitsCount":3,"pusher":{"login":"SkalskiP","name":"Piotr Skalski","path":"/SkalskiP","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/26109316?s=80&v=4"},"commit":{"message":"Merge pull request #15 from roboflow/feature/guided_sam_mask_generation\n\nfeature/guided sam mask generation","shortMessageHtmlLink":"Merge pull request #15 from roboflow/feature/guided_sam_mask_generation"}},{"before":"faaa22e77952de16c1b94ee6b781d789f7c27663","after":"392f4242defb42c6e492a051a23b17fbb430068f","ref":"refs/heads/feature/guided_sam_mask_generation","pushedAt":"2023-12-01T13:44:17.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"SkalskiP","name":"Piotr Skalski","path":"/SkalskiP","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/26109316?s=80&v=4"},"commit":{"message":"Bump version and add ability to guide segmentation with mask.","shortMessageHtmlLink":"Bump version and add ability to guide segmentation with mask."}},{"before":null,"after":"faaa22e77952de16c1b94ee6b781d789f7c27663","ref":"refs/heads/feature/guided_sam_mask_generation","pushedAt":"2023-12-01T13:08:03.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"SkalskiP","name":"Piotr Skalski","path":"/SkalskiP","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/26109316?s=80&v=4"},"commit":{"message":"Update README and refine segmentation functionality\n\nUpdated the README to fix a typographical error and added another task to the upcoming roadmap. Made adjustments to the segmentation method in 'sam.py' to handle mask-guided segmentation and improved the sorting logic in 'mask.py'.","shortMessageHtmlLink":"Update README and refine segmentation functionality"}},{"before":"9bf99e3ae6476bc991ce1e36a0894fee8f050b13","after":"9ef6614a7dc3ca5fac1e513ada6abeae5fbac345","ref":"refs/heads/gh-pages","pushedAt":"2023-11-30T19:27:17.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Deployed 971dc70 with MkDocs version: 1.5.3","shortMessageHtmlLink":"Deployed 971dc70 with MkDocs version: 1.5.3"}},{"before":"6b6918dc362cadbb7e1d23f653a240d2c1b3c7fc","after":"971dc70f018d6b245dbdb2cba7bab9de85a56ecc","ref":"refs/heads/develop","pushedAt":"2023-11-30T19:26:49.000Z","pushType":"pr_merge","commitsCount":2,"pusher":{"login":"SkalskiP","name":"Piotr Skalski","path":"/SkalskiP","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/26109316?s=80&v=4"},"commit":{"message":"Merge pull request #12 from eltociear/patch-1\n\nUpdate welcome.yml","shortMessageHtmlLink":"Merge pull request #12 from eltociear/patch-1"}},{"before":"a3bb7c1789121f79fef27d9a41a5293e6ee32ba5","after":"9bf99e3ae6476bc991ce1e36a0894fee8f050b13","ref":"refs/heads/gh-pages","pushedAt":"2023-11-30T18:03:42.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Deployed 6b6918d with MkDocs version: 1.5.3","shortMessageHtmlLink":"Deployed 6b6918d with MkDocs version: 1.5.3"}},{"before":"0d3a1a1c4d6f0354fda29f888615f430419525a3","after":"6b6918dc362cadbb7e1d23f653a240d2c1b3c7fc","ref":"refs/heads/develop","pushedAt":"2023-11-30T18:03:12.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"SkalskiP","name":"Piotr Skalski","path":"/SkalskiP","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/26109316?s=80&v=4"},"commit":{"message":"Updated the roadmap section in the README to reflect changes in the project's direction. Replaced 'LLaVA demo' with 'CovVLM demo' and 'Qwen-VL demo' due to changes in the APIs we are showcasing. Added 'Rewriting the maestro API' and 'GroundingDINO prompting strategy' as part of future deliverables. Additionally, updated the acknowledgement section to include the paper 'The Dawn of LMMs: Preliminary Explorations with GPT-4V(ision)'.","shortMessageHtmlLink":"Updated the roadmap section in the README to reflect changes in the p…"}},{"before":"3c263852b37bcb32b9b320040bb620254f765506","after":"a3bb7c1789121f79fef27d9a41a5293e6ee32ba5","ref":"refs/heads/gh-pages","pushedAt":"2023-11-30T17:48:35.000Z","pushType":"force_push","commitsCount":0,"pusher":{"login":"github-actions[bot]","name":null,"path":"/apps/github-actions","primaryAvatarUrl":"https://avatars.githubusercontent.com/in/15368?s=80&v=4"},"commit":{"message":"Deployed 0d3a1a1 with MkDocs version: 1.5.3","shortMessageHtmlLink":"Deployed 0d3a1a1 with MkDocs version: 1.5.3"}},{"before":"4c006ec5f76efbbd86bc9d81295c704fa348ddae","after":"0d3a1a1c4d6f0354fda29f888615f430419525a3","ref":"refs/heads/develop","pushedAt":"2023-11-30T17:48:05.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"SkalskiP","name":"Piotr Skalski","path":"/SkalskiP","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/26109316?s=80&v=4"},"commit":{"message":"Update link to cookbook in README.md","shortMessageHtmlLink":"Update link to cookbook in README.md"}}],"hasNextPage":true,"hasPreviousPage":false,"activityType":"all","actor":null,"timePeriod":"all","sort":"DESC","perPage":30,"cursor":"djE6ks8AAAAD7b_4fQA","startCursor":null,"endCursor":null}},"title":"Activity · roboflow/multimodal-maestro"}