Pandas DataFrame select_dtypes() – Explained with Examples

by

When working with data in Pandas, you often need to select columns based on their data types. This is where the select_dtypes() method comes in handy. It allows you to filter columns in a DataFrame by their data types, making it easier to work with subsets of data. In this blog, we’ll explore the select_dtypes() method in detail, with clear explanations and practical examples.

What is select_dtypes()

The select_dtypes() method in Pandas is used to select columns based on their data types. This method is particularly useful when dealing with large datasets containing multiple data types. By using select_dtypes(), you can easily isolate columns of interest and perform operations specific to those data types.

Syntax of select_dtypes()

The syntax for select_dtypes() is straightforward:

Python
DataFrame.select_dtypes(include=None, exclude=None)
  • include: A scalar or list-like, defaulting to None. The data types to be included in the selection.
  • exclude: A scalar or list-like, defaulting to None. The data types to be excluded from the selection.
Selecting Columns by Data Type

To select columns of a specific data type, you can use the include parameter. For example, to select all columns of integer data type:

Python
import pandas as pd

# Sample DataFrame
df = pd.DataFrame({
    'A': [1, 2, 3],
    'B': [4.5, 5.5, 6.5],
    'C': ['foo', 'bar', 'baz']
})

# Select columns of integer data type
int_columns = df.select_dtypes(include='int')
print(int_columns)

Output:

Markdown
   A
0  1
1  2
2  3
Excluding Columns by Data Type

To exclude columns of a specific data type, you can use the exclude parameter. For example, to exclude all columns of float data type:

Python
# Exclude columns of float data type
non_float_columns = df.select_dtypes(exclude='float')
print(non_float_columns)

Output:

Markdown
   A    C
0  1  foo
1  2  bar
2  3  baz
5. Selecting Multiple Data Types

You can select multiple data types by passing a list to the include parameter. For example, to select both integer and float columns:

Python
# Select columns of integer and float data types
num_columns = df.select_dtypes(include=['int', 'float'])
print(num_columns)

Output:

Markdown
   A    B
0  1  4.5
1  2  5.5
2  3  6.5

Similarly, you can exclude multiple data types by passing a list to the exclude parameter.

Practical Examples

Example 1: Selecting String Columns

Suppose you have a DataFrame with mixed data types and you want to select only the string columns:

Python
# Select columns of string data type
string_columns = df.select_dtypes(include='object')
print(string_columns)

Output:

Markdown
     C
0  foo
1  bar
2  baz

In this example, we demonstrate how to select only the string columns from a DataFrame containing mixed data types. By using the include='object' parameter in the select_dtypes() method, we efficiently filter out the string columns, making it easy to isolate and work with textual data within a larger dataset.

In Pandas, string data is treated as an “object” data type. This design choice is rooted in the flexibility and efficiency that come with treating text as generic objects.

Example 2: Excluding Numeric Columns

If you want to exclude all numeric columns (both integers and floats), you can use the following code:

Python
# Exclude columns of numeric data types
non_numeric_columns = df.select_dtypes(exclude=['number'])
print(non_numeric_columns)

Output:

Markdown
     C
0  foo
1  bar
2  baz

Here, we show how to exclude all numeric columns (both integers and floats) from a DataFrame. By using the exclude=['number'] parameter, the select_dtypes() method allows us to remove all numeric data types, leaving only the non-numeric columns. This is particularly useful when you need to focus on categorical or textual data, ignoring the numerical values.

Conclusion

The select_dtypes() method in Pandas is a powerful tool for selecting columns based on their data types. Whether you need to include or exclude certain types, this method simplifies the process and makes your data manipulation tasks more efficient.

In this blog, we’ve covered the basics of select_dtypes(), including its syntax, how to select and exclude columns by data type, and practical examples to illustrate its use. With these insights, you can now confidently apply select_dtypes() to your own data analysis projects.

Feel free to leave comments if you have any questions or need further clarification on using select_dtypes() in Pandas!

Also Explore:

Leave a Comment