Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

persist: add support for columnar decode to s3 bench tool #27365

Closed
wants to merge 1 commit into from

Conversation

danhhz
Copy link
Contributor

@danhhz danhhz commented May 30, 2024

This needs a schema and relies on a pretty major hack of hardcoding
lineitem, which is what I've been testing with.

I'm also trying to start standardizing on fetch/parse/decode as the
jargon for s3-to-bytes/bytes-to-arrow/arrow-to-KV respectively.

Motivation

  • This PR adds a feature that has not yet been specified.

Tips for reviewer

Checklist

@danhhz danhhz force-pushed the persist_bench_decode branch 2 times, most recently from f8d039b to 207bba0 Compare May 31, 2024 15:59
@danhhz danhhz changed the title [DNM] experiments persist: add support for columnar decode to s3 bench tool May 31, 2024
@danhhz danhhz force-pushed the persist_bench_decode branch from 207bba0 to 0d6eb2f Compare July 19, 2024 19:53
This needs a schema and relies on a pretty major hack of hardcoding
lineitem, which is what I've been testing with.

I'm also trying to start standardizing on fetch/parse/decode as the
jargon for s3-to-bytes/bytes-to-arrow/arrow-to-KV respectively.
@danhhz danhhz force-pushed the persist_bench_decode branch from 0d6eb2f to 74019a9 Compare August 20, 2024 14:27
@danhhz
Copy link
Contributor Author

danhhz commented Jan 13, 2025

Cleaning up old PRs

@danhhz danhhz closed this Jan 13, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant