Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

v0.8.0 Blog #88

Open
wants to merge 3 commits into
base: master
Choose a base branch
from
Open

v0.8.0 Blog #88

wants to merge 3 commits into from

Conversation

andyfengHKU
Copy link
Contributor

No description provided.

@andyfengHKU andyfengHKU changed the title initial draft v0.8.0 Blog Jan 22, 2025
Comment on lines 24 to 27
**Skip errorneous rows**
Previously we have supported skip errorneous rows when bulk inserting into table through CSV and Parquet files. We extend this support to DataFrame in this release.

**Support skip limit rows**

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't have edit access to this repo to putting my first draft here

Suggested change
**Skip errorneous rows**
Previously we have supported skip errorneous rows when bulk inserting into table through CSV and Parquet files. We extend this support to DataFrame in this release.
**Support skip limit rows**
**Skip errorneous rows**
Previously we have supported skip errorneous rows when bulk inserting into tables from files (e.g. CSV and Parquet). We extend this support to Python DataFrames (PyArrow, Polars, Pandas) in this release.
**Support skip limit rows**
We now have the ability to use the `SKIP` and `LIMIT` parameters when scanning from Pandas-backed dataframes. The `SKIP` parameter allows the first `n` rows of the dataframe to be skipped, while the `LIMIT` parameter ensures that at most `n` rows of the dataframe are scanned. Before we only supported using those parameters when scanning from PyArrow-backed dataframes, we can use these parameters for all Python Dataframes.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants