Scientists on Reddit

Ian Goodfellow

AI researcher who invented GANs

u/goodfellow_ian ↗Personal account

We retrieved 2 comments from u/goodfellow_ian, all from 2016, most often in r/MachineLearning.

Best moment

A redditor posted in r/MachineLearning

Generative Adversarial Networks for Text

What are some papers where Generative Adversarial Networks have been applied to NLP models? I see plenty for images.

u/goodfellow_ian replied

Hi there, this is Ian Goodfellow, inventor of GANs (verification: http://imgur.com/WDnukgP). GANs have not been applied to NLP because GANs are only defined for real-valued data. GANs work by training a generator network that outputs synthetic data, then running a…

Read all of itShow less

Hi there, this is Ian Goodfellow, inventor of GANs (verification: http://imgur.com/WDnukgP).

GANs have not been applied to NLP because GANs are only defined for real-valued data.

GANs work by training a generator network that outputs synthetic data, then running a discriminator network on the synthetic data. The gradient of the output of the discriminator network with respect to the synthetic data tells you how to slightly change the synthetic data to make it more realistic.

You can make slight changes to the synthetic data only if it is based on continuous numbers. If it is based on discrete numbers, there is no way to make a slight change.

For example, if you output an image with a pixel value of 1.0, you can change that pixel value to 1.0001 on the next step.

If you output the word "penguin", you can't change that to "penguin + .001" on the next step, because there is no such word as "penguin + .001". You have to go all the way from "penguin" to "ostrich".

Excerpt
Behind the scenesAsked about their own famous workr/MachineLearning · 24 points as of Nov 2026Full thread ↗