How to Convert Pandas DataFrame into a List?

Converting a Pandas DataFrame into a list is a common task in data analysis and manipulation using Python. The Pandas library provides powerful data structures and functionalities for handling tabular data, but there are situations where it becomes necessary to transform the DataFrame into a list format. By converting a DataFrame into a list, we gain flexibility in performing various operations or working with other Python data structures.

In this article, we will explore different methods to convert a Pandas DataFrame into a list. We will discuss approaches like using the values attribute, the to_dict() method, and list comprehension. By providing detailed steps and examples, this article will equip you with the knowledge to convert a DataFrame into a list.

Using the values Attribute

One of the most straightforward approaches to converting a Pandas DataFrame into a list involves utilizing the values attribute. By accessing the values attribute, we retrieve the underlying NumPy array representation of the DataFrame. Subsequently, we can transform this array into a list using the tolist() method.

import pandas as pd

# Create a DataFrame
df = pd.DataFrame({'Column1': [1, 2, 3], 'Column2': ['A', 'B', 'C']})
print("Original DataFrame:")
print(df)

# Convert DataFrame to a list using the 'values' attribute
df_list = df.values.tolist()
print("\nConverted to list:")
print(df_list)

Original DataFrame:
   Column1 Column2
0        1       A
1        2       B
2        3       C

Converted to list:
[[1, 'A'], [2, 'B'], [3, 'C']]

Using the to_dict() Method

Pandas offers the to_dict() method that allows us to convert a DataFrame into a dictionary. By default, this method transforms the DataFrame into a dictionary where the column names serve as keys. To obtain a list representation, we can use different orientations with the orient parameter.

import pandas as pd

# Create a DataFrame
df = pd.DataFrame({'Column1': [1, 2, 3], 'Column2': ['A', 'B', 'C']})

# Convert DataFrame to a dictionary with 'records' orientation
df_list = df.to_dict('records')
print("Using to_dict('records'):")
print(df_list)

# Convert to list of column values
df_dict = df.to_dict('list')
df_values_list = list(df_dict.values())
print("\nUsing to_dict('list'):")
print(df_values_list)

Using to_dict('records'):
[{'Column1': 1, 'Column2': 'A'}, {'Column1': 2, 'Column2': 'B'}, {'Column1': 3, 'Column2': 'C'}]

Using to_dict('list'):
[[1, 2, 3], ['A', 'B', 'C']]

Using List Comprehension

List comprehension provides a concise approach for converting a Pandas DataFrame into a list. It allows us to iterate over the rows of the DataFrame and create a list representation with customized formatting.

import pandas as pd

# Create a DataFrame
df = pd.DataFrame({'Column1': [1, 2, 3], 'Column2': ['A', 'B', 'C']})

# Convert DataFrame to a list using list comprehension (by rows)
df_list = [list(row) for row in df.values]
print("Row-wise conversion:")
print(df_list)

# Convert specific columns using list comprehension
column_list = [df[col].tolist() for col in df.columns]
print("\nColumn-wise conversion:")
print(column_list)

Row-wise conversion:
[[1, 'A'], [2, 'B'], [3, 'C']]

Column-wise conversion:
[[1, 2, 3], ['A', 'B', 'C']]

Comparison

Conclusion

Converting a Pandas DataFrame into a list enhances your data analysis capabilities in Python. Use values.tolist() for simple row-wise conversion, to_dict('records') to preserve column information, or list comprehension for custom transformations. Choose the method that best fits your specific data processing needs.