This is great! Now that the model can be used in PyTorch, I've starting playing with @AydaoAI's anime StyleGAN directly guided by CLIP. Starting slow by searching for Asuka by name in the latent space.

Jan 24, 2021 · 9:24 PM UTC

6
5
2
41
Doesn't get the face right, but it's going somewhere. 😄
1
2
Replying to @advadnoun @AydaoAI
oh wooow
1
Can it generate "a dog"? Not yet, at least.
1
6
Replying to @advadnoun @AydaoAI
got this for Kermit the Frog
1
10
Replying to @advadnoun @AydaoAI
hatsune miku
4
Replying to @advadnoun @AydaoAI
Are you doing some form of gradient descent? Didn’t think that’d work too well, sweet if it does
1
2
Yeah, this is maximizing CLIP's text & image encodings cosine similarity by learning the latent vector given to the StyleGAN network.
1
3