Published November 9, 2025 | Version v1

Software and Dataset For Fine-Tuning a local LLM for Thermo-Electric Generators with QLoRA: from generalist to specialist

Description

This document provides a comprehensive guide to the software and datasets contained in
this repository. These resources were developed for the research presented in the article: "[Ar-
ticle Title Fine-Tuning a local LLM for Thermo-Electric Generators with QLoRA: from gener-
alist to specialist:;Preprinthttps://www.preprints.org/manuscript/202511.1348 ]". 

This work presents a complete pipeline for transforming general-purpose
Large Language Models (LLMs) into specialized technical assistants for thermoelectric genera-
tor (TEG) applications. Using QLoRA (Quantized Low-Rank Adaptation), we eciently ne-
tuned two open-source modelsJanV1-expert-TEG and Qwen3-4B-thinking-2507-TEG on a
curated dataset of 202 question-answer pairs covering thermoelectric materials, device physics,
performance optimization, and engineering applications. The methodology enables special-
ization without full model retraining, signicantly reducing computational requirements while
maintaining technical accuracy. We introduce a novel evaluation framework combining human
expert review with LLM-as-a-Judge scoring using state-of-the-art models (GPT-4, Gemini 1.5
Pro). The resulting specialist models demonstrate enhanced performance on technical queries,
achieving higher relevance and accuracy scores compared to their base counterparts. All re-
sources, including trained adapters, merged models, training scripts, and evaluation datasets,
are provided for reproducibility and further research in domain-specic AI applications for
renewable energy technologies.

Files

202_questions_train.zip

Files (8.2 GB)

Name Size
md5:415a44f3b7a6d02c277f4af48192b013
25.4 kB Preview Download
md5:71b81b16116074d2ffe5f29c2b79a518
530.0 kB Preview Download
md5:d7e73e9a6e648004d67266c957f3c45b
229.4 kB Preview Download
md5:ada3868d0c1f47d21eb45d1e593498ca
633.5 kB Preview Download
md5:32faeb6bce48c9f5d4f7cbd0b6e11d88
4.1 GB Preview Download
md5:f132f6d9d44e88f36df3fb5dba8a533a
4.1 GB Preview Download
md5:28ab5884efe72ea637d2f1e01a9a6c79
471.2 kB Preview Download

Additional details

Software

Programming language
Python console