Published November 9, 2022 | Version v2
Journal article Open

The Mass Insertion of SQL Server Records Algorithm

  • 1. University Of South Africa

Description

This paper presents a new algorithm for the mass insertion of records into a SQL Server database and it can handle any file extension which pandas supports. There is a problem with the current method of inserting records into a SQL Server database. We are only limited to .csv, .txt files in the SQL Server Management Studio Import Flat File Wizard. The algorithm is written in Python and it can handle any file extension which pandas supports. It is proven that the SQL Server Management Studio Import Flat File Wizard is 2.18 times faster than the algorithm but that is only for one file. When having n number of files and automation is required then my algorithm is the way to go. I own the sqlserver module on PyPI. It simplifies PyODBC module and it is a wrapper around the PyODBC module. In this paper I will show how to use the sqlserver module to insert records into a SQL Server database and also explain the algorithm to commit the records into the database.

Files

TheMassInsertionOfSQLServerRecordsAlgorithm.pdf

Files (196.2 kB)

Name Size Download all
md5:cbfd76df25aff35daf795f03cba5df18
196.2 kB Preview Download