Skip to content

feat(taskworker): Better Testing Support#736

Merged
george-sentry merged 28 commits into
mainfrom
george/push-taskbroker/testing-activations-custom-sizes
Jul 1, 2026
Merged

feat(taskworker): Better Testing Support#736
george-sentry merged 28 commits into
mainfrom
george/push-taskbroker/testing-activations-custom-sizes

Conversation

@george-sentry

@george-sentry george-sentry commented Jun 30, 2026

Copy link
Copy Markdown
Member

Linear

Refs STREAM-1143

Description

Right now, we can only test processing pools by running a "generator" deployment that produces activations for a particular task over and over again.

We would like to be able to test various scenarios, like...

  • Every activation is some random b ∈ [b₁, b₂, ..., bₙ] bytes in size
  • Every activation takes some random t ∈ [t₁, t₂, ..., tₙ] seconds to run
  • Or both?

We also need a way to run "canary" tasks in any processing pool regardless of what tasks the application defines.

@george-sentry george-sentry requested a review from a team as a code owner June 30, 2026 00:36
@linear-code

linear-code Bot commented Jun 30, 2026

Copy link
Copy Markdown

STREAM-1143

Comment thread clients/python/src/taskbroker_client/task.py
Comment thread clients/python/src/taskbroker_client/task.py
Comment thread clients/python/src/taskbroker_client/task.py
Comment thread clients/python/src/taskbroker_client/worker/worker.py Outdated
Comment thread clients/python/src/taskbroker_client/worker/worker.py Outdated
Comment thread clients/python/src/taskbroker_client/task.py
Comment thread clients/python/src/taskbroker_client/canary.py
Co-authored-by: Mark Story <mark@mark-story.com>
…eorge/push-taskbroker/testing-activations-custom-sizes
Comment thread clients/python/src/taskbroker_client/task.py

@cursor cursor Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cursor Bugbot has reviewed your changes and found 1 potential issue.

Fix All in Cursor

❌ Bugbot Autofix is OFF. To automatically fix reported issues with cloud agents, enable autofix in the Cursor dashboard.

Reviewed by Cursor Bugbot for commit 266a5f1. Configure here.

Comment thread clients/python/src/taskbroker_client/task.py Outdated
Comment thread clients/python/src/taskbroker_client/task.py Outdated
Comment thread clients/python/src/taskbroker_client/task.py Outdated
Comment thread clients/python/src/taskbroker_client/app.py
@george-sentry george-sentry merged commit 6a8f0f3 into main Jul 1, 2026
29 checks passed
@george-sentry george-sentry deleted the george/push-taskbroker/testing-activations-custom-sizes branch July 1, 2026 00:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants