Midjourney is incredible. But you can see there are definite existing biases in its dataset.

Michael Senkow
UX Collective
Published in
4 min readJul 30, 2022

--

I’ve been playing with Midjourney and I think it is incredible.

The TLDR of that: We have sites now where you can type in a phrase and AI generates images for you based on concepts. Problem is: every dataset is biased and comes with issues. The images probably aren’t and …will always be grade-B versions of actual art.

But they’re great tools. Need to have an illustration of… an engineer, sitting at their desk, while the clock ticks over their head?

Now I have a basis…that honestly i could use, or I could sketch over and make a final image.

There is of course some bias in its results (why was that engineer male and slightly bald) but you can generally fix a ton of that by adding keywords. The main thing is to be aware the bias exists (and will probably improve and change). But as a sampling, here are a number of base word searches, as of July 29th 2022. I believe they’re on V3, and I tried not to change the parameters beyond the baseline.

For each of the keywords in the images I ran the concept 5 times at the relaxed speed and just took a copy of the first results.

The images are worth perusing first.

As a baseline, I tried various forms of the most neutral word, and generally yes. All the images look human. [There is a conspicuous lacking of melanin. Just saying.]

Now, let's compare men.

Pics of guys!
he’s a man. with two eyes. and hair.

And women!

I generally feel the women images feel more similar. I generally feel she looks mad at me?

Ok, now let's add some basic cultural concepts to see how that changes things.

I guess American men all kinda look like John Krasinski.

Ok, let's try broaching race and see what happens there…taking the base words from the census, what happens with Midjourney?

Some words clearly come with more meaning and weight in them towards a person than others. I find it interesting that these seem to lean towards displaying women… but surprised that not a single person for black wasn’t…not only a white person but a kinda goth white person….

Some of this, though, is a part of what Midjourney is. Without the nouns, the adjectives/descriptors are useless. So we clearly can see that with the right adjectives, you can easily get people across cultures and races.

If the system has to specifically call out race for race to show up, the system isn’t working right.

What happens when we add in adjectives/concepts? Does any bias exist there?

Clearly dogs are the only actually good things :D.

Again nothing terrible. Just a general lack of melanin in the pictures.

For most of these so far, the bias feels…underwhelming. It exists but isn’t harming things. As long as you’re aware, you can add some adjectives and concepts and get the specificity you want.

But let’s step into careers.

I guess teachers are all women, professors are all men, scientists are old men or else they have big glasses and hair…most celebrities are women….and designers are all cool looking women looking off into the distance.

What if we try the sorta, classic psychological archetypes.

Good or bad, the fact that every love, sage, caregiver seems to be a woman….and even that is a bias. Feminine presenting but not necessarily a woman. But either way, again, you see there are biases.

This is about where I petered out and started looking at more physical descriptors. But I think that could wait until the next article?

I’m half doing this just for my own purposes and thinking through the results the system gives me, so that when I’m making other images, they can think of that innate bias. But I think this is something the application creators need to consider too. These are the first quick 5 pictures of leaders.

And these are designers.

I’m not 100% what the fix is. Pictures aren’t always representing society. Now we’re making art based on pictures that didn’t represent society. Do we make the art lie? Do we skew the existing data for a society we want? Or do we just get creative in the meantime, until… everyone can be anything?

A thick black woman in a wheel chair, who is being inaugerated into the United States presidency. (I feel like thick isn’t right but I can’t find….a word for just norma body weight.)

--

--