Sometimes, we want to remove pandas rows with duplicate indices with Python.
In this article, we’ll look at how to remove pandas rows with duplicate indices with Python.
How to remove pandas rows with duplicate indices with Python?
To remove pandas rows with duplicate indices with Python, we can use the index.duplicated method.
For instance, we write
df = df[~df.index.duplicated(keep='first')]
to call df.index.duplicated where df is a Pandas data frame.
We call it with the keep argument set to 'first' and add ~ to keep the first instance of the item and remove the duplicates.
And then we put that in the square brackets to get a data frame without the entries with duplicate indices and assign that to df.
Conclusion
To remove pandas rows with duplicate indices with Python, we can use the index.duplicated method.
