VB icon

Asp delete duplicates in Database

Submitted on: 1/5/2015 1:08:00 PM
By: Pierre Morissette (from psc cd)  
Level: Beginner
User Rating: By 3 Users
Compatibility: ASP (Active Server Pages)
Views: 1763
     This code delete duplicate records in MSAcces database.
Can't Copy and Paste this?
Click here for a copy-and-paste friendly version of this code!
' for :Asp delete duplicates in Database
Feel free to use the code as long as you leave the author name and email adress.
Can't Copy and Paste this?
Click here for a copy-and-paste friendly version of this code!
' Name: Asp delete duplicates in Database
' Description:This code delete duplicate records in MSAcces database.
' By: Pierre Morissette (from psc cd)
' Inputs:The user must define 4 variables (lines 29 to 32) in order to configure the code for his/her personnal use.
' Returns:This code returns the number of record in the database and the number of deleted duplicate records.
' Assumes:The author is not responsible for any lost of your data.
Read the code comments before using it.
Works only with dsn-less connexion.
' Side Effects:The author suggest you to use the code first on a copy of your database to prevent unwanted deletion.

<%@ LANGUAGE = "VBScript" %>
<% option explicit %>
<!-- IMPORTANT....set server,scripttimeout to any value in seconds
If your database is very large, it will take a long time to execute -->
Use this script at your own risk.
The author is not responsible for any lost data.
Try this script on a backup database first to see the results.
This script finds and eliminate duplicate records (duplicate of "url" field content) in table "mes_sites" of database "../../db/signets.mdb"
It finds the value of the field named "ID" (primary key field) and use this value to delete duplicate records.
If you want to use this script, you will have to change those value in this page : 
the name of the field to look for duplicate value (dim myfield)
the name of the database (dim mydatabase)
This code uses a dsn-less connection to the database
the name of the table (dim mytable)
the name of your primary key field (dim myprimarykey)
It is probably not the best way to to the job, but it works.
If you know a better way, please contact me.
Author : Pierre Morissette
mail: pierre@hawk.igs.net
'IMPORTANT user must define those variables CAREFULLY
Dim mydatabase,mytable,myprimarykey,myfield
dim SQL,conn,rs,nb,i,nbtot,valurl,nbdup,nbdup2,valret,validdup,arr,nbarr
Set Conn = Server.CreateObject("ADODB.Connection")
Set rs = Server.CreateObject("ADODB.Recordset")
Conn.Open "DBQ=" & Server.Mappath(mydatabase) & ";Driver={Microsoft Access Driver (*.mdb)};"
sql="select count(*) as nb from " 
sql=sql & mytable
Set RS = conn.Execute(SQL)
'calcul du nombre de fiches, count the number of records in table
response.write nbtot
response.write " fiches / files"
response.write "<hr>"
sql="select "
sql = sql & myfield
sql=sql & ","
sql=sql & myprimarykey
sql=sql & " from "
sql=sql & mytable
sql=sql & " order by "
sql=sql & myfield
set rs=conn.execute(sql) 
'selectionner la valeur de myfield(i), select the value of field myfield # i
for i=0 to (nbtot- 1)
valurl= rs.fields(myfield)
' vérifier si valeur dupliquée, check if the value of the field is a duplicate value
if valurl=valret then
validdup= rs.fields(myprimarykey)
' ajouter l'id de la fiche à la liste des duplicats, add id value to the array if duplicate value
arr= arr & validdup
arr = arr & ","
end if
'remind the last value to compare to next one
valret = valurl
set rs=nothing
'écrire la liste des duplicats, writes the list of all id value that contains duplicates
response.write "Records that contains duplicate data in field myfield"
response.write "<br>"
'now use the array created to delete records
'create array
if arr = "" then
response.write "There is no duplicate record."
response.write arr
nbarr = ubound(arr) 
nbarr=nbarr + 1
response.write "<br>"
response.write "Number of duplicate records :"
response.write nbarr
response.write "<br>"
'number of records to duplicate 
for i=0 to nbarr-1
SQL = "delete from "
sql=sql & mytable
sql=sql & myprimarykey 
sql = sql & " =" 
sql=sql & arr(i)
Set RS = conn.Execute(SQL)
Response.write "All the duplicate records are now deleted."
end if
set rs=nothing
set conn = nothing

Other 1 submission(s) by this author


Report Bad Submission
Use this form to tell us if this entry should be deleted (i.e contains no code, is a virus, etc.).
This submission should be removed because:

Your Vote

What do you think of this code (in the Beginner category)?
(The code with your highest vote will win this month's coding contest!)
Excellent  Good  Average  Below Average  Poor (See voting log ...)

Other User Comments

 There are no comments on this submission.

Add Your Feedback
Your feedback will be posted below and an email sent to the author. Please remember that the author was kind enough to share this with you, so any criticisms must be stated politely, or they will be deleted. (For feedback not related to this particular code, please click here instead.)

To post feedback, first please login.