Skip to the content.

Understanding Computer Bias

What is computer Bias?

It’s unfair preferences built into a computer system. Often, the bias isn’t deliberate, but a result from designing, testing, and using.

EX:

  • Data Issues: a system may perform poorly for a certain demographic that it doesn’t have enough data on
  • Design Choices: designers may assume that users will use their system in similar ways without considering other uses
  • Testing Gaps: in testing phases, there may be limited research so that only a small fraction of the entire population is assessed

Popcorn Hack #1

An example of a TV show that demonstrates bias is Law and Order: SVU, which can be seen as a TV show in favor of the police force since it portrays their everyday lives as interesting and just (aka copaganda).

Everyday Exammples of Bias

  • Netflix Rec.: suggests movies/shows
  • Virtual Assistants with Female Voices: most AI voices are female
  • Social Media Age Gaps: TikTok vs. Facebook

Popcorn Hack #2

I downloaded an app called Foodvisor with the intention in trying to start a habit of calorie tracking for my diet. It was initially helpful and helped me realize that my diet wasn’t healthy, but it had a very limited database of food. Since I’m Korean and mostly eat Korean food, I struggled to find a lot of the foods that I ate in their database, and often had to insert them myself or use an unofficial item that another user had added. This frustrated me and made me wonder if all other calorie tracking apps would be like this and whether there was a bias towards non-Asian demographics within the database.

The HP Camera Incident

The HP camera was able to follow light-skinned faces with ease, but struggled with dark-skinned faces. It was unintetional, but people accused it of being racist.

Avoiding Bias in Tech

  • Expand your data
  • Encourage diverse teams
  • Test, test, test
  • Dcoumument your assumptions

Popcorn Hack #3

While designing a fitness tracking app, there may be a bias in evaluating performances based on age. Since more young people perform fitness better than old people, the app may evaluate an old person’s workout as poor depending on the mass assumption of higher expectations from young people. To help with this, the app should have specific parameters that evaluate the person’s workout considering their age and what’s average for their age as well.

Why It All Matters

  • Exclude people
  • Reinforce negative stereotypes
  • Limit choices

Homework Hack #1

  1. TikTok
  2. Identifying Potential Bias: When users choose to post, often, the TikTok algorithm will recommend some posts over others (e.g. a person in need bring awareness will most likely be less recommended than a popular influencer).
  3. Analyze the Cause: The TikTok algorithm (the For You page) analyzes a user’s interactions/frequent watches and assesses what to recommend and whether or not to include new recommendations. Due to this, if a user were disinterested/unaware of a person trying to ask for help online, the chances that the algorithm will bring that video towards them is slimmer than bringing an influencer that is related to the user’s interests.
  4. Propose a Solution: To fix this, the algorithm can be designed to add a specific page such as the For You page that is dedicated to global issues, so that user interactions are less considered and dire situations are brought to light.