DataMerge, a command line tool to interpolate data files of time series... and much more

DataMerge

DataMerge is a linux command line which allows to merge a number of datafiles organised in columns indexed in a one-dimensional way into a single dataset. It can handle files of data tabulated on different grids, by using interpolation methods. E.g., data recorded every 10 seconds and data recorded every 15 seconds can be interpolated into either grid. Interpolation can be linear between adjacent points, or use a least-square approximation on a moving window. It also allows to process columns individually, perform cross-column calculations or change the unit in which quantities are expressed. Several other methods also allow to perform cross-row calculations, such as finite differences or normalisation by an automatically detected entry row.

Functionalities

• Interpolate between datasets
• Select values
• Normalise data by value reached at some timepoint
• Multiple columns bulk management
• Multicolumn statistics (expanded in v1.1.0)
• Calculate finite differences
• Cumulate values across rows (new in v1.1.0)
• Interpolate between datasets with LOESS
• Calculate derivatives with LOESS

See the DataMerge wiki for more!

Example

datamerge -f \
 	--reference example/dataset_sampling_3.tsv 'time_sampling_3' \
 		'line_sampling_3 time_sampling_3 sinusoidal exponential' \
 	--input example/dataset_sampling_7.tsv 'time_sampling_7' \
 		'line_sampling_7 time_sampling_7 cosinusoidal exponential_sampling_7'	\
 	-o example/linear_interpolation.tsv 'time' \
 		'sinusoidal cosinusoidal exponential exponential-exponential_sampling_7 sinusoidal^2+cosinusoidal^2'

Sample from output:

time	sinusoidal	cosinusoidal	exponential	exponential-exponential_sampling_7	sinusoidal^2+cosinusoidal^2  
0	0	na	1	na	na  
3	0.187381	0.96325	1.03045	-0.000525714	0.962962  
6	0.368125	0.911084	1.06184	-0.000524286	0.96559  
9	0.535827	0.83509	1.09417	-0.00034	0.984485  
12	0.684547	0.711437	1.1275	-0.00067	0.974748  
15	0.809017	0.587785	1.16183	0	1  
18	0.904827	0.416183	1.19722	-0.000717143	0.99192  

Available from https://gricad-gitlab.univ-grenoble-alpes.fr/etiennej/datamerge

(C) J Etienne 2012-2022

DataMerge is released under GPL 2 licence. DataMerge logo CC-BY 4.0 based on original work by Delapouite