Blog > Big Data > Post

American Dream is Losing Affordability in Housing.

Friday, May 17, 2019


Since the burst of the housing bubble in 2008, we entered the recession and hit the rock bottom in 2012. The housing market has been rising again and the price has surpassed the 2008’s peak. For years, Seattle’s housing market has been ranked top 3 fastest growing cities, by 85% year-to-year growth rate.


As the housing price is pushing to another new peak. I am sympathetic about affordability because I moved 10 times in the past 9 years in Seattle since the housing price directly impacts the rental market as well. Everyone wants to live in a comfortable place, especially for families with children. However, once you buy a house, you have another problem to worry about.


Owning a house probably becomes your largest asset when the mortgage loan is paid off. When the price of a house fluctuates, as a house is an investment like stocks and bonds, it scares people because the house value could dip below the mortgage balance. In a perform storm scenario where you lost your job and became delinquent in monthly payments, you could both lose the house and owe the bank. (They auction your house below the mortgage balance. The money you own = mortgage balance - sold price.) As passive and vulnerable as a house owner seems, how could you become aware of the next storm? I am going to analyze some home sales records for the past two years and tell you what is going on in the housing market.


Can you afford a house?

Using Octoparse, I scraped around 6,000 sold homes in 2018 and 2019, with data including the number of bedrooms, sold price and zip codes. Here are the steps:


  • Scrape the data

    Step 1: Scrape list of URLs from Trilia.com

    Step 2: Load the List into Octoparse

    Step 3: Select extracted data fields from Octoparse

    Step 4: Save and Run extraction.

    Step 5: Export the file to CSV



  • Then I Use Python to analyze:

What does the household income look like in these areas



In 2018 and 2019 (up to date), there were around 6,000 sold homes in Seattle. When the data is visualized by zip codes, we can see 98118 has the most sold homes. How does it relate to household income in that area? Comparing to the GIF below, it clearly shows the average household income in 98118 is lower than other zip codes.




What do the sold homes implicate?

I use Python to calculate the numbers of bedrooms and sold price so as to observe any relationship between the number and price. I came up with four numbers for the sold price: mean, median, minimum and maximum. The graph below shows sold prices with different numbers of bedrooms.




3-bedroom homes are the most popular among sales, with 1,936 sold. While 3-bedroom homes have a median price of $734,000, the mean is slightly higher than the median, which says more 3-bedroom homes are sold at a higher price (implies they are less affordable.) The second most popular home type is 2-bedroom homes with 1,577 sold at a median price of $600,000. Next comes the 4-bedroom homes with 892 sold at a median price of $823,000.


What does it mean to own a 3-bedroom home priced at the median?

Let’s break down the numbers. There are 36% of the sold homes in the $734k median category. It implies most homeowners can afford at this median price of $734k in 2018 and 2019. I calculate the mortgage to see how much you actually need to make in order to afford that median-priced home. It comes as below:

Though with monthly debts, you want to live joyfully at a debt-to-income ratio of 36%, your family needs to make $190,000/year in order to afford a 3-bedroom home sold at $734k. How many people do you beat out with a $190k income? According to Pew Research, you are in top 25% which places you in the upper-income tier in the Greater Seattle area. The report also says the income held by the bottom 90% shrank by 12.8% whereas the top 10% makers held 50% of all America’s income.



It is not surprising that the middle class starts to lose its ground in the metropolitan areas. The growth in the income couldn’t keep up with the rise in house price. I don’t see the booming prosperity, but an increasing gap between the rich and the rest. We have been putting so much effort to equalize and civilize society. Yet from Wars on Drugs by Nixon, War on Crimes by Johnson, to Wars on Immigrants by Trump, I still don’t see the freedom and greater good of the American Dream. In opposite, I only see people lose their jobs and homes throughout the years.


Author: Ashley

Ashley is a data enthusiast and passionate blogger with hands-on experience in web scraping. She focuses on capturing web data and analyzing in a way that empowers companies and businesses with actionable insights. Read her blog here to discover practical tips and applications on web data extraction

Si desea ver el contenido en español, por favor haga clic en:  5 Razones por El Web Scraping Puede Beneficiar a Su Negocio





Laden Sie Octoparse herunter, um mit Web-Scraping zu beginnen, oder kontaktieren Sie uns
für die Fragen über Web Scraping!

Kontaktieren Sie uns Herunterladen
Diese Website verwendet Cookies um Ihnen ein besseres Internet-Erlebnis zu ermöglichen. Lesen Sie wie wir Cookies verwenden und Sie können sie kontrollieren, indem Sie auf Cookie-Einstellungen klicken. Wenn Sie die Website weiter nutzen, akzeptieren Sie unsere Verwendung von Cookies.
Akzeptieren Ablehnen