In this tutorials, we will see how to remove duplicate elements from a python list.
Remove duplicate elements from List :
We can accomplish this using different ways, let’s see all the ways.
The list of elements is reading from user input.
Example 1 :
Removing duplicates using membership operators in python.
elem = eval(input("Enter List of values : "))
list1=[]
for x in elem:
if x not in list1:
list1.append(x)
print("After Removing duplicate elements ",list1)
Output:
Enter List of values : [10,20,30,40,10,20,50,60]
After Removing duplicate elements [10, 20, 30, 40, 50, 60]
Example 2:
Removing duplicate elements using Python’s list comprehension.
list1=[10,20,30,10,50,20,10,60,80,50,40,10]
newlist=[ele for n,ele in enumerate(list1) if ele not in list1[:n]]
print("New List : ",newlist)
Output:
New List : [10, 20, 30, 50, 60, 80, 40]
Example 3:
Removing duplicates usind sorted() function.
list1 = ['a','c','a','d','e','a','f','b']
list2 = sorted(set(list1),key=list1.index)
print(list2)
Output:
['a', 'c', 'd', 'e', 'f', 'b']
Example 4:
If you are concerning about insertion order, you can also remove duplicate elements using python set data structure.
elem = eval(input("Enter List of values : "))
set1 = set(elem)
print("After Removing duplicate elements ",set1)
Output:
Enter List of values : [1,2,3,4,5,1,2,6,4]
After Removing duplicate elements {1, 2, 3, 4, 5, 6}
Example 5:
Let’s consider, our list containing string elements. We can remove the duplicates from below set functions.
list1 = ["abc", "xyz", "pqr"]
list2 = ["aei", "oup", "xyz","abc"]
newSet= set(list1).symmetric_difference(list2).union(set(list1).intersection(list2))
print(newSet)
Output:
You can find more explanation about the output, from our earlier example of the set data structure.
{'pqr', 'aei', 'abc', 'xyz', 'oup'}
Reference:
Happy Learning 🙂