Feature: Add ability to use a separate python environment in local executor

[Gr3atWh173]

Why are these changes needed?

To execute code inside a python virtual environment so that the base environment isn't polluted by unwanted dependencies.

Related issue number

Solves #2613

Checks

• I've included any doc changes needed for https://microsoft.github.io/autogen/. See https://microsoft.github.io/autogen/docs/Contribute#documentation to build and test documentation locally.
• I've added tests (if relevant) corresponding to the changes introduced in this PR.
• I've made sure all auto checks have passed.

[Gr3atWh173]

@microsoft-github-policy-service agree

[ekzhu]

Shall we update the execution_policies argument so it can supply the executable binary for Python?

[Gr3atWh173]

Right now an execution policy is defined as a str to bool mapping. I think it will be a breaking change to change its type. IMO a better solution is to pass a environment context object to the executor. It won't break existing code that depends on Autogen and solve the issues I'm having with handling different venv directory structures for Windows and Unix systems.

[codecov-commenter]

Codecov Report

Attention: Patch coverage is 25.00000% with 15 lines in your changes are missing coverage. Please review.

Project coverage is 15.75%. Comparing base (372ac1e) to head (1dff475).
Report is 5 commits behind head on main.

Files	Patch %	Lines
autogen/coding/local_commandline_code_executor.py	16.66%	10 Missing ⚠️
autogen/code_utils.py	37.50%	5 Missing ⚠️

Additional details and impacted files

@@             Coverage Diff             @@
##             main    #2615       +/-   ##
===========================================
- Coverage   33.11%   15.75%   -17.37%     
===========================================
  Files          86       86               
  Lines        9108     9128       +20     
  Branches     1938     2093      +155     
===========================================
- Hits         3016     1438     -1578     
- Misses       5837     7642     +1805     
+ Partials      255       48      -207     

Flag	Coverage Δ
unittests	15.75% <25.00%> (-17.37%)	⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[Gr3atWh173]

Needed to add a special case for Windows because of how CreateProcessW() works internally. Here's a good explainer on why adding the interpreter to PATH was not working: python/cpython#105889 (comment)

[ekzhu]

Thanks for the PR! A few questions:

1. Does this only work with Python virtual environment not Anaconda?
2. Can you add a code block example in the doc string for how to use the virtual_env_context argument?
3. Can you update the documentation in website/docs/topics/code-execution/cli-code-executor.ipynb for an example on how to use this?

[Gr3atWh173]

I don't think these changes will work with Anaconda since it doesn't use venv to manage environments IIRC

[ekzhu]

Thanks @Gr3atWh173 can you add your discord handle so we can connect with you on AutoGen's discord server: #2310