3D implementation of GLaMM

[remvanthull]

Hi!

I have been experimenting with your model for quite some time now, specifically on medical imaging data.

I am currently working on looking into possibilities of extending your architecture such that it would be able to encode sequences of images and decode these accordingly to obtain 3D segmentations.

I was curious if you maybe have a take on how to tackle this. It would greatly help me, as I am doing my master's thesis on LMMs in medical imaging with your model as the main focus of interest! :)

Thank you in advance,
Rachel

[mmaaz60]

Hi @remvanthull,

Thank you for your interest in our work. Your project looks interesting. A simple approach could be to replace image encoder with something like UNETR++ encoder and segmentation decoder with something like MedSAM.

Please do share any updates that you may have in your project. Thank you and Good Luck!