Skip to content

Releases: chmp/serde_arrow

0.12.3

02 Jan 19:26
5f4c543
Compare
Choose a tag to compare
  • Add arrow=54 support

0.12.2

26 Oct 17:53
067885a
Compare
Choose a tag to compare

Bug fixes:

  • Fixed deserialization from sliced arrays (#248). Note that the current solution requires up front work when constructing the array deserializers, as described in the issue. The removal of the performance penalty is tracked in (#250)

Thanks

  • @jkylling for reporting (#248) and for discussing potential solutions

0.12.1

13 Oct 09:37
ca9f18a
Compare
Choose a tag to compare

New features

  • Add support for various jiff types (jiff::Date, jiff::Time, jiff::DateTime, jiff::Timestamp, jiff::Span, jiff::SignedDuration)
  • Add support for tracing lists as List instead of LargeList by setting sequence_as_large_list to false in TracingOptions
  • Add support for tracing strings and strings in dictionaries as Utf8 instead of LargeUtf8 by setting strings_as_large_utf8 to false in TracingOptions
  • Add support to auto-detect dates (2024-09-30, mapped to Date32) and times (12:00:00, mapped to Time64(Nanosecond))) in from_samples
  • Improved error messages for non self describing types (chrono::*, uuid::Uuid, std::net::IpAddr)

Thanks

The following people contributed to this release:

  • @jkylling added support for tracing lists as List and strings as Utf8

v0.12.0

30 Sep 16:20
Compare
Choose a tag to compare

Refactor the underlying implementation to prepare for further development

New features

  • Add Binary, LargeBinary, FixedSizeBinary(n), FixedSizeList(n) support for arrow2
  • Add support to serialize / deserialize bool from integer arrays
  • Add a helper to construct Bool8 arrays
  • Include the path of the field that caused an error in the error message
  • Include backtrace information only for the debug representations of errors

API changes

  • Use impl serde::Serialize instead of &(impl serde::Serialize + ?Sized)
  • Use &[FieldRef] instead of &[Field] in arrow APIs

Removed deprecated API

  • Remove serde_arrow::schema::Schema
  • Remove serde_arrow::ArrowBuilder and serde_arrow::Arrow2Builder
  • Remove from_arrow_fields / to_arrow_fields for SerdeArrowSchema, use the TryFrom conversions to convert between fields and SerdeArrowSchema
  • Remove SerdeArrowSchema::new(), Overwrites::new()

v0.12.0-rc.1: Merge pull request #237 from chmp/release/0.12.0-rc.1

22 Sep 19:47
85c040d
Compare
Choose a tag to compare

Refactor the underlying implementation to prepare for further development

New features

  • Add Binary, LargeBinary, FixedSizeBinary(n), FixedSizeList(n) support for arrow2
  • Add support to serialize / deserialize bool from integer arrays
  • Add a helper to construct Bool8 arrays
  • Include the path of the field that caused an error in the error message
  • Include backtrace information only for the debug representations of errors

API changes

  • Use impl serde::Serialize instead of &(impl serde::Serialize + ?Sized)
  • Use &[FieldRef] instead of &[Field] in arrow APIs

Removed deprecated API

  • Remove serde_arrow::schema::Schema
  • Remove serde_arrow::ArrowBuilder and serde_arrow::Arrow2Builder
  • Remove from_arrow_fields / to_arrow_fields for SerdeArrowSchema, use the TryFrom conversions to convert between fields and SerdeArrowSchema
  • Remove SerdeArrowSchema::new(), Overwrites::new()

v0.11.8

22 Sep 19:02
d77d5e4
Compare
Choose a tag to compare
  • Add arrow=53 support

Thanks

The following people contributed to this release:

v0.11.7

31 Aug 15:10
4df3f9c
Compare
Choose a tag to compare
  • Fix tracing of JSON mixing nulls with non-null data

v0.11.6

13 Jun 20:30
eb8d37a
Compare
Choose a tag to compare
  • Add arrow=52 support
  • Add support for Binary, LargeBinary (only arrow)
  • Add support for FixedSizeBinary(n) (only arrow>=47)
  • Add support for FixedSizeList(n) (only arrow)
  • Add support to overwrite field definitions with TracingOptions::overwrite
  • Add support to serialize enums without data (e.g., enum E { A, B, C}) as strings by setting the corresponding field to a string value (Utf, LargeUtf, Dictionary(_, Utf8), Dictionary(_, LargeUtf8)
  • Allow to trace enums without data as dictionary encoded strings by setting enums_without_data_as_strings to true in TracingOptions

v0.11.5

02 Jun 11:00
c436f51
Compare
Choose a tag to compare
  • Add serde_arrow::Serializer
  • Add support for new type wrappers, tuples and tuple structs to serde_arrow::Deserializer
  • Add a generic serde_arrow::ArrayBuilder with support for both arrow and arrow2
  • Implement TryFrom<&[Field]> (arrow and arrow2) and TryFrom<&[FieldRef]> (arrow only) for SerdeArrowSchema
  • Implement TryFrom<&SerdeArrowSchema> for Vec<Field> and Vec<FieldRef> for arrow

v0.11.4

27 May 19:17
3b085fd
Compare
Choose a tag to compare
  • Add serde_arrow::Deserializer