Skip to content

HDDS-15579. Replace SimpleSpanProcessor with BatchSpanProcessor#10569

Open
sravani-revuri wants to merge 5 commits into
apache:masterfrom
sravani-revuri:HDDS-15579
Open

HDDS-15579. Replace SimpleSpanProcessor with BatchSpanProcessor#10569
sravani-revuri wants to merge 5 commits into
apache:masterfrom
sravani-revuri:HDDS-15579

Conversation

@sravani-revuri

Copy link
Copy Markdown
Contributor

What changes were proposed in this pull request?

while running tracing while creating 100000 keys.
with tracing enabled it currently takes around 25-30 min but with it off it takes around 1-2 min.
currently we are using simplespanprocessor which works synchronously for spans being exported , therefore taking so long.

We should change usage to batchspanprocessor which does the same thing asynchronously

What is the link to the Apache JIRA

https://issues.apache.org/jira/browse/HDDS-15579

How was this patch tested?

Manual test.

Command:

bash-5.1$ ozone freon rk --num-of-volumes 1 --num-of-buckets 1 --num-of-keys 100000 --num-of-threads 24 --key-size 1KB

BEFORE:

***************************************************
Status: Success
Git Base Revision: 9d50c6884666e794e45102260a4017bb31802e1b
Number of Volumes created: 1
Number of Buckets created: 1
Number of Keys added: 100000
Average Time spent in volume creation: 00:00:00,002
Average Time spent in bucket creation: 00:00:00,000
Average Time spent in key creation: 00:07:39,104
Average Time spent in key write: 00:00:00,298
Total bytes written: 102400000
Total Execution time: 00:36:29,767
***************************************************

AFTER:

***************************************************
Status: Success
Git Base Revision: 9d50c6884666e794e45102260a4017bb31802e1b
Number of Volumes created: 1
Number of Buckets created: 1
Number of Keys added: 100000
Average Time spent in volume creation: 00:00:00,001
Average Time spent in bucket creation: 00:00:00,000
Average Time spent in key creation: 00:00:11,312
Average Time spent in key write: 00:00:00,216
Total bytes written: 102400000
Total Execution time: 00:00:57,661
***************************************************

@sravani-revuri

Copy link
Copy Markdown
Contributor Author

@sumitagrawl , could you please review these changes.

Comment thread hadoop-ozone/cli-shell/src/main/java/org/apache/hadoop/ozone/shell/Shell.java Outdated
@adoroszlai adoroszlai changed the title HDDS-15579. Move from simplespanprocessor to batchspanprocessor. HDDS-15579. Replace SimpleSpanProcessor with BatchSpanProcessor Jun 22, 2026
@sravani-revuri sravani-revuri marked this pull request as ready for review June 22, 2026 09:24
@errose28 errose28 requested a review from sumitagrawl June 22, 2026 16:21
@adoroszlai

Copy link
Copy Markdown
Contributor

@sumitagrawl please take a look

@sarvekshayr sarvekshayr left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @sravani-revuri for the improvement.

This reverts commit 9fcff8c.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants