Genre Classification of Books Using Machine Learning Techniques
Authors/Creators
Description
This project, titled "Genre Classification of Books Using Machine Learning Techniques," by Shaon An Nafi and Peya Pandit from Daffodil International University, aims to automate the challenging and subjective process of book genre classification.
The research addressed the limitations of manual classification by applying machine learning and deep learning techniques. The methodology involved:
- Collecting a diverse dataset of approximately 600 book texts across six genres (Horror, Mystery, Thriller, Comedy, Romance, and Fiction).
- Utilizing OCR (Optical Character Recognition) for digitized physical books and extracting text from online sources.
- Extensive preprocessing, including text cleaning, tokenization, and TF-IDF vectorization.
- Training and evaluating various machine learning and deep learning models, including SVM, Random Forest, Gradient Boosting Machines, RNN, and BERT.
The key finding was that the transformer-based BERT model performed the best, achieving a 75% accuracy rate, closely followed by SVM with 73% accuracy. The project culminated in a Flask-based demo web application that can take text or PDF input to predict the book's genre. This system is designed to enhance book recommendation systems, automate library management, and contribute to the preservation of cultural heritage by making literary content more discoverable and organized.
Files
REPORTFINALMAIL.pdf
Additional details
Software
- Repository URL
- https://github.com/Nafisarkar/ThesisCode
- Programming language
- Python , Jupyter Notebook
- Development Status
- Concept
References
- V. Thakur and A. C. Patel, "An Improved Dictionary Based Genre Classification Based on Title and Abstract of E-book Using Machine Learning Algorithms," Lecture Notes in Networks and Systems, pp. 323–337, 2021, doi: https://doi.org/10.1007/978-981-16-0733-2_23.
- E. Ozsarfati, E. Sahin, C. J. Saul, and A. Yilmaz, "Book Genre Classification Based on Titles with Comparative Machine Learning Algorithms," 2019 IEEE 4th International Conference on Computer and Communication Systems (ICCCS), Feb. 2019, doi: https://doi.org/10.1109/ccoms.2019.8821643.
- P. Shiroya, "Book Genre Categorization Using Machine Learning Algorithms (K-Nearest Neighbor, Support Vector Machine and Logistic Regression) using Customized Dataset," International Journal of Computer Science and Mobile Computing, vol. 10, no. 3, pp. 14–25, Mar. 2021, doi: https://doi.org/10.47760/ijcsmc.2021.v10i03.002.
- D. Ray, "BOOK GENRE CLASSIFICATION --- DEBMALYA RAY," vol. 13, no. 3, pp. 45–76, Aug. 2023, doi: https://doi.org/10.13140/RG.2.2.13778.98247.
- A. Bhatia, "Book Genre Classification," GitHub, Aug. 30, 2022. Available: https://github.com/akshaybhatia10/Book-Genre-Classification
- S. Gupta, M. Agarwal, and S. Jain, "Automated Genre Classification of Books Using Machine Learning and Natural Language Processing," 2019 9th International Conference on Cloud Computing, Data Science & Engineering (Confluence), Jan. 2019, doi: https://doi.org/10.1109/confluence.2019.8776935.
- Dr. M. Narendra, "A Survey on Book Genre Classification System using Machine Learning," vol. 1, Feb. 2000.
- R. J. Mooney and L. Roy, "Content-based book recommending using learning for text categorization," Proceedings of the Fifth ACM Conference on Digital Libraries, 2000, doi: https://doi.org/10.1145/336597.336662.
- H. Chiang, Y. Ge, and C. Wu, "Classification of Book Genres By Cover and Title." Available: https://cs229.stanford.edu/proj2015/127_report.pdf