Language vs tool features

[dachafra]

issue: Should we, and if so, how do we make a distinction between language and tool features?

suggestion: Survival of the fittest?

[VladimirAlexiev]

Modularization of the whole conversion process is a great idea. so that teams can innovate in specific areas without having to implement complete converters from scratch.

Draft list of modules:

• input parser
• input reader with streaming (batching, chunking)
• transformation parser
• transformation engine that applies all relevant maps on a chunk of input
• function evaluator
• output constructor (as memory model of one chunk)
• output serializers to different formats
• output writers to file or different storages

[dachafra]

Let's transfer to the best-practices repo, although IMO in languages should be an agreement, while optimizations and other techniques are part of each implementation/engine and related use-cases