🕷️ Crawler Inspector

[](https://www.altcademy.com/?ref=blog) - [Blog Home](https://www.altcademy.com/blog/) - [Featured](https://www.altcademy.com/blog/tag/featured/) - [Career](https://www.altcademy.com/blog/tag/career/) - [How-To](https://www.altcademy.com/blog/tag/how-to/) - [Glossary](https://www.altcademy.com/blog/tag/programming-glossary/) - [Enroll Now](https://www.altcademy.com/programs?ref=blog) #### [Altcademy](https://www.altcademy.com/?ref=blog) - a [ Best Coding Bootcamp 2023](https://www.forbes.com/advisor/education/best-coding-bootcamps/?award=best-coding-bootcamps-2023-altcademy) [How To](https://www.altcademy.com/blog/tag/how-to/) # How to drop nan values in Pandas  #### [Altcademy Team](https://www.altcademy.com/blog/author/altcademy/) Jan 11, 2024 4 min ## Understanding NaN Values in Pandas When you're working with data in Python, using the Pandas library is like having a Swiss Army knife for data manipulation. However, sometimes your data isn't perfect. It might contain gaps or "holes", known as missing values. In Pandas, these missing pieces are often represented as `NaN`, which stands for "Not a Number". It's a special floating-point value recognized by all systems that use the standard IEEE floating-point representation. Think of `NaN` like a placeholder for something that is supposed to be a number but isn't there. Imagine you have a basket of fruits with labels on each fruit, but some labels have fallen off. Those fruits without labels could be thought of as `NaN` because, like the missing information, we know there's supposed to be something there, but it's just not. ## Why Drop NaN Values? Before we dive into how to drop `NaN` values, let's discuss why you might want to do this. `NaN` values can be problematic because they can distort statistical calculations and cause errors in machine learning models. It's like trying to make a fruit salad with some fruits missing; your salad won't be complete, and it won't taste as expected. Sometimes, you can fill in these missing values with estimates or other data, but other times it's better to just remove them. Removing `NaN` values simplifies the dataset and can make your analysis more straightforward. ## Dropping NaN Values with `dropna()` Pandas provides a powerful method called `dropna()` to deal with missing values. This method scans through your DataFrame (a kind of data table in Pandas), finds the `NaN` values, and drops the rows or columns that contain them. Here's a basic example: ``` import pandas as pd # Creating a DataFrame with NaN values data = {'Name': ['Anna', 'Bob', 'Charles', None], 'Age': [28, None, 30, 22], 'Gender': ['F', 'M', None, 'M']} df = pd.DataFrame(data) # Dropping rows with any NaN values cleaned_df = df.dropna() print(cleaned_df) ``` This code will output a DataFrame without any rows that had `NaN` values: ``` Name Age Gender 0 Anna 28.0 F 2 Charles 30.0 None ``` Notice that Charles's gender is still `None`. That's because `dropna()` by default drops entire rows where any `NaN` is present. If we want to be more specific, we can use parameters. ## Parameters of `dropna()` The `dropna()` method can be fine-tuned with parameters. Two commonly used parameters are `axis` and `how`. - `axis`: Determines whether to drop rows or columns. - `axis=0` or `axis='index'` (default): Drop rows with `NaN`. `axis=1` or `axis='columns'`: Drop columns with `NaN`. `how`: Determines if a row or column should be dropped when it has at least one `NaN` or only if all values are `NaN`. - `how='any'` (default): Drop if any `NaN` values are present. - `how='all'`: Drop if all values are `NaN`. Let's see `axis` and `how` in action: ``` # Dropping columns with any NaN values cleaned_df_columns = df.dropna(axis='columns') print(cleaned_df_columns) # Dropping rows where all values are NaN cleaned_df_all = df.dropna(how='all') print(cleaned_df_all) ``` The first print statement will give you a DataFrame without the 'Age' column since it's the only one with `NaN` values. The second print statement won't change anything in our example because there's no row where all values are `NaN`. ## Handling NaN Values in a Series A Series is like a single column in your DataFrame, a list of data with an index. Dropping `NaN` values from a Series is similar to dropping them from a DataFrame: ``` # Creating a Series with NaN values series = pd.Series([1, 2, None, 4, None]) # Dropping NaN values cleaned_series = series.dropna() print(cleaned_series) ``` This will output a Series without the `None` values: ``` 0 1.0 1 2.0 3 4.0 dtype: float64 ``` ## Filling NaN Values Instead of Dropping Sometimes, instead of dropping `NaN` values, you might want to replace them with a specific value. This is known as imputation. Pandas provides the `fillna()` method to do this. For example, you might want to replace all `NaN` values with the average of the non-missing values: ``` # Replace NaN with the mean of the 'Age' column df['Age'].fillna(df['Age'].mean(), inplace=True) print(df) ``` This will fill the `NaN` value in the 'Age' column with the average age of Anna and Charles. ## A Real-World Example Let's consider a more realistic scenario where you have a dataset of survey responses, and not all questions were answered by every respondent. You might want to drop rows where crucial information is missing, like the respondent's age or gender, but keep rows where less important information is missing. ``` # A more complex DataFrame survey_data = { 'Age': [25, None, 37, 22], 'Gender': ['F', 'M', 'F', None], 'Income': [50000, None, 80000, 75000], 'Satisfaction': [4, 3, None, 5] } survey_df = pd.DataFrame(survey_data) # Dropping rows where 'Age' or 'Gender' is NaN important_info_df = survey_df.dropna(subset=['Age', 'Gender']) print(important_info_df) ``` This will keep rows where 'Income' or 'Satisfaction' might be `NaN`, but drop rows where 'Age' or 'Gender' is `NaN`. ## Conclusion: Keeping Your Data Clean Dropping `NaN` values in Pandas is like weeding a garden. You remove the unwanted elements to allow the rest of your data to flourish without interference. By using the `dropna()` method, you can ensure that your analyses are performed on complete cases, leading to more reliable results. Remember, though, that dropping data should not be done carelessly. Always consider the context of your data and whether dropping or imputing makes more sense for your specific situation. With the tools Pandas provides, you have the flexibility to handle missing data in a way that best suits your garden of information, helping it grow into a bountiful harvest of insights. #### Read next [How to style two classes in ReactJS as under each other Getting Started Welcome to another tutorial, dear reader! Today, we'll be diving into the world of ReactJS, a popular library used for building interactive user interfaces. Specifically, we're going to explore how to style two classes in ReactJS as under each other. Now, you might be wondering, "What does it By Altcademy Team Nov 12, 2023](https://www.altcademy.com/blog/how-to-style-two-classes-in-reactjs-as-under-each-other/) [How to set options as values from a json object in ReactJS Understanding JSON and its Role in ReactJS Before diving into the main topic, let's quickly understand what JSON is. JSON, an acronym for JavaScript Object Notation, is a lightweight format for storing and transferring data. It's often used when data is sent from a server to a web page. It's By Altcademy Team Nov 12, 2023](https://www.altcademy.com/blog/how-to-set-options-as-values-from-a-json-object-in-reactjs/) [How to use ReactJS in atom Getting Started with ReactJS in Atom First and foremost, we need to understand what ReactJS and Atom are. ReactJS is a JavaScript library that helps us to build user interfaces (the parts of a website you interact with). Atom, on the other hand, is a text editor where we write By Altcademy Team Nov 12, 2023](https://www.altcademy.com/blog/how-to-use-reactjs-in-atom/) ## Learn to code in our 100% online programs Altcademy coding bootcamp offers **beginner-friendly, online programs** designed by **industry experts** to help you become a coder. **85%+** of [Altcademy alumni](https://www.altcademy.com/alumni?ref=blog) are hired within 6 months after graduation. See [how we teach](https://www.altcademy.com/how?ref=blog), or click on one of the following programs to find out more. [Most Popular Most Popular7 Courses FSWD Front-end Back-end Full-stack Web Development Learn full-stack development with HTML, CSS, JavaScript, React, Ruby and Rails, Computer science fundamentals & programming skills. **VIEW DETAILS**](https://www.altcademy.com/programs/fswd?ref=blog) [**Upgrade** FSWD to include Python, Data Science, AI Application, TypeScript and more.](https://www.altcademy.com/programs/fsdsai?ref=blog) [3 Courses FEWD HTML CSS JavaScript Front-end Web Development Learn front-end development with HTML, CSS, JavaScript, and jQuery. Computer science fundamentals & programming skills. **VIEW DETAILS**](https://www.altcademy.com/programs/fewd?ref=blog) [2 Courses BEWD Database API Testing Back-end Web Development Learn back-end development with Ruby and Rails, M-V-C. Computer science fundamentals with practical programming skills. **VIEW DETAILS**](https://www.altcademy.com/programs/bewd?ref=blog) ## Join the upcoming Cohort and learn web development online\! #### Altcademy Online Coding Bootcamp - Become a professional coder [Enroll now](https://www.altcademy.com/enroll?ref=blog) - [Back to Altcademy.com](https://www.altcademy.com/?ref=blog) - [Featured](https://www.altcademy.com/blog/tag/featured/) - [Career](https://www.altcademy.com/blog/tag/career/) - [Glossary](https://www.altcademy.com/blog/tag/programming-glossary/) - [JavaScript](https://www.altcademy.com/blog/tag/javascript/) - [React](https://www.altcademy.com/blog/tag/react/) - [Python](https://www.altcademy.com/blog/tag/python/) - [TypeScript](https://www.altcademy.com/blog/tag/typescript/) - [Enroll in Altcademy](https://www.altcademy.com/programs?ref=blog) Altcademy Blog © 2026. Powered by [Ghost](https://ghost.org/)

## Understanding NaN Values in Pandas When you're working with data in Python, using the Pandas library is like having a Swiss Army knife for data manipulation. However, sometimes your data isn't perfect. It might contain gaps or "holes", known as missing values. In Pandas, these missing pieces are often represented as `NaN`, which stands for "Not a Number". It's a special floating-point value recognized by all systems that use the standard IEEE floating-point representation. Think of `NaN` like a placeholder for something that is supposed to be a number but isn't there. Imagine you have a basket of fruits with labels on each fruit, but some labels have fallen off. Those fruits without labels could be thought of as `NaN` because, like the missing information, we know there's supposed to be something there, but it's just not. ## Why Drop NaN Values? Before we dive into how to drop `NaN` values, let's discuss why you might want to do this. `NaN` values can be problematic because they can distort statistical calculations and cause errors in machine learning models. It's like trying to make a fruit salad with some fruits missing; your salad won't be complete, and it won't taste as expected. Sometimes, you can fill in these missing values with estimates or other data, but other times it's better to just remove them. Removing `NaN` values simplifies the dataset and can make your analysis more straightforward. ## Dropping NaN Values with `dropna()` Pandas provides a powerful method called `dropna()` to deal with missing values. This method scans through your DataFrame (a kind of data table in Pandas), finds the `NaN` values, and drops the rows or columns that contain them. Here's a basic example: ``` import pandas as pd # Creating a DataFrame with NaN values data = {'Name': ['Anna', 'Bob', 'Charles', None], 'Age': [28, None, 30, 22], 'Gender': ['F', 'M', None, 'M']} df = pd.DataFrame(data) # Dropping rows with any NaN values cleaned_df = df.dropna() print(cleaned_df) ``` This code will output a DataFrame without any rows that had `NaN` values: ``` Name Age Gender 0 Anna 28.0 F 2 Charles 30.0 None ``` Notice that Charles's gender is still `None`. That's because `dropna()` by default drops entire rows where any `NaN` is present. If we want to be more specific, we can use parameters. ## Parameters of `dropna()` The `dropna()` method can be fine-tuned with parameters. Two commonly used parameters are `axis` and `how`. - `axis`: Determines whether to drop rows or columns. - `axis=0` or `axis='index'` (default): Drop rows with `NaN`. `axis=1` or `axis='columns'`: Drop columns with `NaN`. `how`: Determines if a row or column should be dropped when it has at least one `NaN` or only if all values are `NaN`. - `how='any'` (default): Drop if any `NaN` values are present. - `how='all'`: Drop if all values are `NaN`. Let's see `axis` and `how` in action: ``` # Dropping columns with any NaN values cleaned_df_columns = df.dropna(axis='columns') print(cleaned_df_columns) # Dropping rows where all values are NaN cleaned_df_all = df.dropna(how='all') print(cleaned_df_all) ``` The first print statement will give you a DataFrame without the 'Age' column since it's the only one with `NaN` values. The second print statement won't change anything in our example because there's no row where all values are `NaN`. ## Handling NaN Values in a Series A Series is like a single column in your DataFrame, a list of data with an index. Dropping `NaN` values from a Series is similar to dropping them from a DataFrame: ``` # Creating a Series with NaN values series = pd.Series([1, 2, None, 4, None]) # Dropping NaN values cleaned_series = series.dropna() print(cleaned_series) ``` This will output a Series without the `None` values: ``` 0 1.0 1 2.0 3 4.0 dtype: float64 ``` ## Filling NaN Values Instead of Dropping Sometimes, instead of dropping `NaN` values, you might want to replace them with a specific value. This is known as imputation. Pandas provides the `fillna()` method to do this. For example, you might want to replace all `NaN` values with the average of the non-missing values: ``` # Replace NaN with the mean of the 'Age' column df['Age'].fillna(df['Age'].mean(), inplace=True) print(df) ``` This will fill the `NaN` value in the 'Age' column with the average age of Anna and Charles. ## A Real-World Example Let's consider a more realistic scenario where you have a dataset of survey responses, and not all questions were answered by every respondent. You might want to drop rows where crucial information is missing, like the respondent's age or gender, but keep rows where less important information is missing. ``` # A more complex DataFrame survey_data = { 'Age': [25, None, 37, 22], 'Gender': ['F', 'M', 'F', None], 'Income': [50000, None, 80000, 75000], 'Satisfaction': [4, 3, None, 5] } survey_df = pd.DataFrame(survey_data) # Dropping rows where 'Age' or 'Gender' is NaN important_info_df = survey_df.dropna(subset=['Age', 'Gender']) print(important_info_df) ``` This will keep rows where 'Income' or 'Satisfaction' might be `NaN`, but drop rows where 'Age' or 'Gender' is `NaN`. ## Conclusion: Keeping Your Data Clean Dropping `NaN` values in Pandas is like weeding a garden. You remove the unwanted elements to allow the rest of your data to flourish without interference. By using the `dropna()` method, you can ensure that your analyses are performed on complete cases, leading to more reliable results. Remember, though, that dropping data should not be done carelessly. Always consider the context of your data and whether dropping or imputing makes more sense for your specific situation. With the tools Pandas provides, you have the flexibility to handle missing data in a way that best suits your garden of information, helping it grow into a bountiful harvest of insights.