1. user can choose to show nested type when write to csv 2. Add features to show struct type data as json format

[awol2005ex]

1. user can choose to show nested type when write to csv 2. Add features to show struct type data as json format

[tustvold]

I'm not sure about this, we already have arrow_json which provides this functionality?

Perhaps you could file a ticket explaining what you're wanting to do and we can go from there?

[awol2005ex]

I'm not sure about this, we already have arrow_json which provides this functionality?

Perhaps you could file a ticket explaining what you're wanting to do and we can go from there?

I just want to export orc file in hive acid table to csv ,And the file has struct type field and can't be export

[tustvold]

CSV cannot typically be used to represent structured data, have you considered using arrow_json?

TBC we could add a way to serialize JSON into CSV, its a little odd and I suspect it will confuse some readers as CSV has non-standardized escaping rules, but that would need to be done using the arrow_json machinery - we can't be maintaining two JSON serializers

[awol2005ex]

CSV cannot typically be used to represent structured data, have you considered using arrow_json?

TBC we could add a way to serialize JSON into CSV, its a little odd and I suspect it will confuse some readers as CSV has non-standardized escaping rules, but that would need to be done using the arrow_json machinery - we can't be maintaining two JSON serializers

ok

[alamb]

Thank you for this contribution @awol2005ex

I think this pR would also need some tests that show what it is attemping to do.

But in general I agree with @tustvold that the idea of writing structured data to CSV is likely not a good addition to this crate as there is no standard (either doc or reference implementation) to refer to and seems like a very specialized (one off) usecase

It does seem reasonable to me to allow user defined formatting for customizing output.
If you wanted to add some API to allow a custom formatter that would likely be a better fit for this crate

[alamb]

Marking as draft as I think this PR is no longer waiting on feedback. Please mark it as ready for review when it is ready for another look