[Feature Request]: Auto-set distance metric based on embedding function

[atroyn]

Describe the problem

It's up to the user to select the distance metric they use with their collection. However, embedding models are trained with a pre-determined similarity metric. By knowing the embedding function, we should automatically know the required distance metric. Chroma defaults to the L2 metric which isn't right for many embedding models.

Describe the proposed solution

When the user sets an embedding function on a collection, we should have a property on that EF which the collection readts to automatically select the right distance metric if available, unless it's overriden by collection params.

This is slightly hairy when loading a collection. We should error if you try to load with the wrong distance metric.

Alternatives considered

Leaving it as-is.

Importance

would make my life easier

Additional Information

No response

[BalasubramanyamEvani]

I can work on this. It would be great if you could share any pointers regarding which files I should focus on to implement this.

[atroyn]

@BalasubramanyamEvani thanks for proposing, we might want #2034 to land first.