com.philiprehberger:worker-pool
v0.2.0680 downloadsMIT
Coroutine-based worker pool for parallel batch processing with backpressure
$
implementation com.philiprehberger:worker-poolREADME
worker-pool
Coroutine-based worker pool for parallel batch processing with backpressure.
Installation
Gradle (Kotlin DSL)
implementation("com.philiprehberger:worker-pool:0.2.0")
Maven
<dependency>
<groupId>com.philiprehberger</groupId>
<artifactId>worker-pool</artifactId>
<version>0.2.0</version>
</dependency>
Usage
import com.philiprehberger.workerpool.*
val results = workerPool<String, Int>(concurrency = 5) {
urls.forEach { url -> submit(url) { fetchSize(it) } }
onProgress { done, total -> println("$done/$total") }
}
// With per-task timeout
import kotlin.time.Duration.Companion.seconds
val results = workerPool<String, Int>(concurrency = 5, timeout = 10.seconds) {
urls.forEach { url -> submit(url) { fetchSize(it) } }
onError { url, e -> println("Failed: $url — ${e.message}") }
}
// Simple list parallel map
val sizes = urls.parallelMap(concurrency = 10) { fetchSize(it) }
API
| Function / Class | Description |
|---|---|
workerPool(concurrency, timeout?) { } | Process tasks with bounded parallelism and optional per-task timeout |
WorkerPoolScope.submit(input, task) | Submit a task |
WorkerPoolScope.onProgress { completed, total -> } | Progress callback |
List<T>.parallelMap(concurrency, transform) | Parallel list mapping |
Development
./gradlew test
./gradlew build
Support
If you find this project useful: