[Executor] Convert sync generator to async generator

[thy09]

Description

Quick fix for the issue #3069

This pull request primarily focuses on changes to the promptflow-core package to improve handling of synchronous and asynchronous iterators. The most significant changes include the creation of a new function sync_iterator_to_async in async_utils.py and its subsequent integration into the flow_executor.py module.

Here are the key changes, grouped by theme:

Addition of new utility function:

• src/promptflow-core/promptflow/_utils/async_utils.py: A new function sync_iterator_to_async has been added. This function converts a synchronous iterator to an asynchronous one using a thread pool executor.

Changes to the flow_executor.py module:

• src/promptflow-core/promptflow/executor/flow_executor.py: The sync_iterator_to_async function has been imported from async_utils.py and integrated into several methods. [1] [2] [3] [4] [5]

• src/promptflow-core/promptflow/executor/flow_executor.py: The type GeneratorType has been replaced with Iterator and AsyncGeneratorType with AsyncIterator in several methods. This change reflects the shift towards using the more general Iterator and AsyncIterator types. [1] [2] [3] [4]

These changes enhance the flexibility of the promptflow-core package by allowing it to handle both synchronous and asynchronous iterators effectively.

All Promptflow Contribution checklist:

• The pull request does not introduce [breaking changes].
• CHANGELOG is updated for new features, bug fixes or other significant changes.
• I have read the contribution guidelines.
• Create an issue and link to the pull request to get dedicated review from promptflow team. Learn more: suggested workflow.

General Guidelines and Best Practices

• Title of the pull request is clear and informative.
• There are a small number of commits, each of which have an informative message. This means that previously merged commits do not appear in the history of the PR. For more information on cleaning up the commits in your PR, see this page.

Testing Guidelines

• Pull request includes test coverage for the included changes.

[github-actions]

promptflow SDK CLI Azure E2E Test Result heta/sync-to-async

  4 files    4 suites   4m 10s ⏱️
242 tests 205 ✅  37 💤 0 ❌
968 runs  820 ✅ 148 💤 0 ❌

Results for commit b80d729.

♻️ This comment has been updated with latest results.

[github-actions]

promptflow-core test result

0 tests   0 ✅  0s ⏱️
0 suites  0 💤
0 files    0 ❌

Results for commit b80d729.

♻️ This comment has been updated with latest results.

[github-actions]

SDK CLI Global Config Test Result heta/sync-to-async

6 tests   6 ✅  1m 17s ⏱️
1 suites  0 💤
1 files    0 ❌

Results for commit b80d729.

♻️ This comment has been updated with latest results.

[github-actions]

Executor Unit Test Result heta/sync-to-async

796 tests   796 ✅  3m 44s ⏱️
  1 suites    0 💤
  1 files      0 ❌

Results for commit b80d729.

♻️ This comment has been updated with latest results.

[github-actions]

Executor E2E Test Result heta/sync-to-async

243 tests   238 ✅  5m 38s ⏱️
  1 suites    5 💤
  1 files      0 ❌

Results for commit b80d729.

♻️ This comment has been updated with latest results.

[github-actions]

SDK CLI Test Result heta/sync-to-async

    4 files      4 suites   1h 3m 35s ⏱️
  715 tests   674 ✅  41 💤 0 ❌
2 860 runs  2 696 ✅ 164 💤 0 ❌

Results for commit b80d729.

♻️ This comment has been updated with latest results.