[PR #61] [MERGED] Introduce the possibility to add asynchronous steps #85

Closed
opened 2026-01-23 11:22:01 +01:00 by admin · 0 comments
Owner

📋 Pull Request Information

Original PR: https://github.com/code-rhapsodie/dataflow-bundle/pull/61
Author: @matyo91
Created: 3/31/2021
Status: Merged
Merged: 4/21/2021
Merged by: @jeremycr

Base: masterHead: async


📝 Commits (1)

  • d616dab Introduce the possibility to add asynchronous steps

📊 Changes

6 files changed (+348 additions, -4 deletions)

View changed files

📝 README.md (+19 -1)
Tests/DataflowType/Dataflow/AMPAsyncDataflowTest.php (+49 -0)
📝 composer.json (+2 -0)
src/DataflowType/AMPAsyncDataflowBuilder.php (+83 -0)
📝 src/DataflowType/AbstractDataflowType.php (+7 -3)
src/DataflowType/Dataflow/AMPAsyncDataflow.php (+188 -0)

📄 Description

This should solve #60.

What this PR introduce :

  • you can execute step synchronous and asynchronous way by using coroutines and Generators.
  • you can have a control on your pipe flow with multiples factors :
    • you can "scale" your steps to limit back pressure issues.
    • you can customise a new option : loopInterval to set the event loop tick interval in milliseconds.
    • you can customise a new option : emitInterval to tell when the reader should emit the next item to process.
  • this new feature is retro-compatible with the existing solution, as all step are by default scaled at 1 and prevent order when writing to the output.

🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.

## 📋 Pull Request Information **Original PR:** https://github.com/code-rhapsodie/dataflow-bundle/pull/61 **Author:** [@matyo91](https://github.com/matyo91) **Created:** 3/31/2021 **Status:** ✅ Merged **Merged:** 4/21/2021 **Merged by:** [@jeremycr](https://github.com/jeremycr) **Base:** `master` ← **Head:** `async` --- ### 📝 Commits (1) - [`d616dab`](https://github.com/code-rhapsodie/dataflow-bundle/commit/d616dabf937892fbff95b2bf608f69e233c50eac) :sparkles: Introduce the possibility to add asynchronous steps ### 📊 Changes **6 files changed** (+348 additions, -4 deletions) <details> <summary>View changed files</summary> 📝 `README.md` (+19 -1) ➕ `Tests/DataflowType/Dataflow/AMPAsyncDataflowTest.php` (+49 -0) 📝 `composer.json` (+2 -0) ➕ `src/DataflowType/AMPAsyncDataflowBuilder.php` (+83 -0) 📝 `src/DataflowType/AbstractDataflowType.php` (+7 -3) ➕ `src/DataflowType/Dataflow/AMPAsyncDataflow.php` (+188 -0) </details> ### 📄 Description This should solve #60. What this PR introduce : - you can execute step synchronous and asynchronous way by using coroutines and Generators. - you can have a control on your pipe flow with multiples factors : - you can "scale" your steps to limit `back pressure` issues. - you can customise a new option : `loopInterval` to set the event loop `tick` interval in milliseconds. - you can customise a new option : `emitInterval` to tell when the reader should emit the next item to process. - this new feature is retro-compatible with the existing solution, as all step are by default scaled at 1 and prevent order when writing to the output. --- <sub>🔄 This issue represents a GitHub Pull Request. It cannot be merged through Gitea due to API limitations.</sub>
admin added the pull-request label 2026-01-23 11:22:01 +01:00
admin closed this issue 2026-01-23 11:22:02 +01:00
Sign in to join this conversation.
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: code-rhapsodie/dataflow-bundle#85