MMTrans Source Code

Source code related to MMTrans:

(1)  MMtrans: 

               a. modules: model related code.

               b. DataOutput.py:  input data pipeline.

               c. Train.py: train the model.

               d. Evaluation.py: evaluate the model.

               e. EvaluationMetrics.py: automated evaluation metrics adopted in the experiment.

               f. Configs.py: model hyper-parameters setup.

(2) tokenization: model data tokenization related.