Usage (seecli.py
):
python cli.py fit ...
python cli.py predict ...
- use
TrainingConfig
inutils.py
to set (hyper)parameters dataset.py
- dataset wrapper implementation, the expected data format is described inMultiModalDataset
.MultiModalTestDataset
may be useful for batch inference, not really needed for online inferenceMultiModalClassifier
inmodel.py
implements the architecture itself. Metrics and a loss function are also defined therecli.py
implements a training loop and offline prediction. Note thatLabelEncoder
andMinMaxScaler
used for tabular data processing are also pickled to be reused on inference.
Not intended to be as a go-to solution, but rather a comprehensive example of a custom multimodal model that handles both text and tabular data simultaneously. In Pytorch-Lightning