Skip to content

Commit

Permalink
[MINOR] improvement(spark-client): Refactor RssShuffleManager for spa…
Browse files Browse the repository at this point in the history
…rk v2 and v3 to reduce redundant code (#2330)

### What changes were proposed in this pull request?

Refactor and abstract the same code into base class.

### Why are the changes needed?

Reduce the redundant code and simplify the development in rss spark-client scope.

The Spark version unrelated code should be placed into RssShuffleManagerBase class, for this RssShuffleManager Class, it should only maintains the spark api related codes.

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

- Existing UTs.
- Our test cluster, tested both spark v2 and v3 version.
  • Loading branch information
maobaolong authored Jan 9, 2025
1 parent 5b7d18c commit 43879ca
Show file tree
Hide file tree
Showing 3 changed files with 521 additions and 820 deletions.
Loading

0 comments on commit 43879ca

Please sign in to comment.