What a good artist understands is that nothing comes from nowhere. All creative work builds on what came before. Nothing is completely original.
from Steal Like an Artist: 10 Things Nobody Told You About Being Creative.

Stable Diffusion – what is it?
Stable Diffusion is a model that can create digital images from text or use text prompts to guide image-to-image translations. It will be released on August 22, 2022.Looking at the research paper you will notice that some names you might have come across in former publications on GANs will show up again, so all people being mentioned in the research paper of VQGAN are mentioned: Patrick Esser, Dominik Lorenz and Robin Rombach.
Understanding the heritage can help comprehend the rapid development of VQGAN in just one year. The progress has been extraordinary.
Currently, all main competitors (DALL·E 2, midjourney and Stable diffusion) rely on the principle of diffusion to create their images, so-called latent diffusion models. If you want to get a deeper understanding, I recommend a good written article from Louis Bouchard or watch his video:
Screenshot from "What is Stable Diffusion?" by Louis Bouchard from YouTube.
Looking at results with VQGAN and Clip, see my older article and results from one year later, give you an idea about the speed of development. We face many competitors and an impressive research speed. I assume the next challenge is render speed while generating the images and optimizing the diffusion models. In the meantime, the world is allowed to unleash its full potential by connecting more libraries together to Stable Diffusion.
I really recommend trying some of the text-prompts yourself. Generating images on your computer can be difficult. The process involves using language prompts and the speed of image generation tells you how complex it is. On my MacBook (with m1) it’s running ok, but I am not sure on which PC builds you could run it.
Playing with the software, you'll observe cases the current implementations struggle with - one of the harder ones is stigmatizing the world around us. No wonder if the models are trained by common images of the web. The most common pictures on the web are pictures more beautiful than reality.
Watch "Stable Diffusion - What, Why, How?" by Edan Meyer, a one-hour instructional video on creating diffusion videos. It's presented greatly and a great resource to get started with Stable Diffusion.
Screenshot from Edan Meyer "Stabe-Diffusion – What, Why, How?" from YouTube
If you want a shorter version of Stable Diffusion, look at the 2-minute paper.
Stable Diffusion – Quickstart via dreamstudio, collab, huggingface
If you had a look at midjourney or DALL·E 2 before, you experienced simple text-to-image prompts to create your artworks. Being Open Source opens a variety of inputs for Stable Diffusion. I try to give you an overview (with a raise in complexity and flexibility).
Dreamstudio.ai
Dreamstudio is the easy access to Stable Diffusion and the answer to popular midjourney or DALL·E 2. To get started, you need to login. Also, the prompt guide is only available when logged in.
The main difference to midjourney (using discord) and DALL·E 2 (basically relying on the text prompt) is the interface you get provided. Besides a text prompt you also get some rulers to modify the settings. Though the wording being used is still geeky, it is progress to the simple text inputs from the other main rivals. By the way, there also used to be an official discord bot, but they shut it down.
Dreamstudio.ai GUI screenshot – taken from my computer
The payment model for dreamstudio feels more complicated than for midjourney or DALL·E 2. You also get free credits to get started but the amount of cost varies with your settings; here’s their explanation:
At default settings, it’s one credit per image. Depending on the image resolution & step count you choose, this can go as low as 0.2 credits per image or as high as 28.2 credits per image. Here is a detailed chart for explanation:
Steps512x512512x768512x1024768x768768x10241024x1024100.20.50.80.91.31.9250.51.21.92.33.34.7501.02.43.84.66.69.4751.53.65.76.99.914.11002.04.87.69.213.218.81503.07.211.413.819.828.2Pricing table from dreamstudio.ai FAQs (as of September 2022)
If you need some extra guidance on the photo editor, watch the video from their FAQs: Getting Started With DreamStudio Website Beta, Part Five: Inpainting/Outpainting.
In the FAQs you will find a lot of other helpful sources to get started.
All in all, it’s cool to have a maintained/managed tool showing the potential of Stable Diffusion and easily experiment. If you like what you see, you could continue to pay or switch to Open Source.
As you have seen, the tool also has some limitations at the moment: the size of the images is limited to 1024x1024 (midjourney allows 2048x2048). The size is directly connected to the render speed.
But no worries about the size: one of the biggest sins in photo editing is also a relic of the past. Upscaling pictures is now possible with the help of other AI image upscaling tools. There are so many tools nowadays, maybe you find some inspiration in my other article “How AI Assistants Can Help You with Text and Art”.
You can also look for GIT repositories to size the images. One I could recommend is this txt2imghd. There's also a version on replicate.com.
Stable Diffusion on Huggingface.co
You must have come across hugging face if you got into text to image before. I shared some stuff from hugging face before, such as Dalle-mini, a free Dalle alternative from earlier this year. I really recommend anyone being interested in the topic of AI and machine learning, to visit hugging face every now and then. Under “spaces” you will find apps you could directly test as web-apps. And you notice (sorted by likes) that there’s also an app for Stable Diffusion.
Hugging Face Spaces – Apps to test online
In fact, there are more apps using Stable Diffusion to transform images. The one on the left is the simple text to image prompt and the right one could be used for modifying pictures as well. Feel free to try one of the two here:

Hugging Face Stable Diffusion Demo Shot
Hugging Face Stable Diffusion – Diffuse the rest – Shot

Here are some of the outputs being generated in the tool:

And the fun part: It’s for free! There’s no limitation in terms of credits and it’s a perfect playground to get used to how text-to-image prompts work in general. As mentioned before when explaining midjourney or Dalle-2, I recommend reading through some text prompts… or as the magic of open source already unfolds, use sites like lexica.art and look at the eye candy and copy prompts.
Screenshot from Lexica-art
As an alternative to lexica.art, you could also try arthub.ai.
Now I almost forgot to quickly explain what diffuse the rest could do for you… it’s kind of the beautifier of your paintings. Draw like in MS Paint and add a text prompt, about what your line drawing might be. In my case presented with an owl (owl got very popular in all this process of text-to-image generation) – the transformation of kid paintings is also quite fun 😉
Example for diffuse the rest: Simple line drawing on left gets transformed to a result written in the text prompt.
Stable Diffusion on Google Colab
Google Colab is another resource you need to know when it comes to working with Python in the context of machine learning. Google Colab makes data science, deep learning, neural networks, and machine learning accessible to individual researchers who cannot afford expensive computing infrastructure.
Screenshot from Stable Diffusion notebook on Google Colab
Edan Meyer explains how to use google colab with his own modified colab notebook in his great video “Stable Diffusion – What, Why, How?”. He is explaining the whole process to create images, similar images or even videos. A deeper understanding of how using the code works help to unleash the full creative potential.
In very simple words, you open a colab notebook and follow from top to bottom. On the left you find some little play icons to execute. After executing one after another, there might be some text prompts or variable to modify to lead you to your result.
Local Apps and other Web GUIs for Stable Diffusion
Since we have the first open-source release, it feels the market is exploding. I saw downloadable apps to come and go within 2 weeks, so it’s hard to give you a list of all the options there are. Also, there's no guarantee they are still working. Many people are fascinated by these tools. Some want to make money quickly, others want to share, and everyone wants to keep improving the technology.
So, I start with another Web GUI for Stable Diffusion called peacasso:
Screenshot Pecasse, Web GUI to execute Stable Diffusion prompts
And here’s a desktop app to run Stable Diffusion for the mac (m1,m2) called DiffusionBee:
Screenshot DiffusionBee – Desktop app for Mac M1
Feel free to share more cool apps, sources in the comments. As of Mid September 2022 there were so many tools, it is hard to keep an overview.
Replicate is another interesting cloud API I wanted to give a try. If you use the tools you will notice, rendering takes time. Using a cloud API for rendering can improve energy efficiency and reduce your carbon footprint, while also decreasing rendering times.
Explore the offerings of recplicate.com, there’s a clean Stable Diffusion install as well as other interesting tools to help you to optimize your images or get a desired effect.
Screenshot from replicate.com – Cloud API based machine learning tools

Stable Diffusion spreadsheet UI on rowy.io
Stable Diffusion – local installation on MAC M1
Finally, some thoughts and links on installing Stable Diffusion locally on your computer. I personally only installed it on an M1 Macbook. With the advantage of the RAM being able to be shared.
There's a tutorial on options to work with Stable Diffusion locally I discovered while finishing the article, but it seems to be the official one (I didn't test it though as I didn't want to break my running version); the tutorial is from AssemblyAI itself: "How to run stable diffusion locally to generate images".
When I tested my local install, I basically followed along with another introduction from replicate.com: "Run Stable Diffusion on your M1 Mac's GPU".
In addition to the instructions, some extra tips, as I also had some trouble while installing. First, check for the correct Python version. You need 3.10, which could be downloaded and installed from python.org.
If you have trouble to switch the python version, there could be many reasons (I couldn't probably name). I used a version control, as options there were ASDF and pyenv. I decided on pyenv and followed the instructions and had no further issues to switch the version.
Another hint I could share with you... watch your folders. Always execute the prompts from the correct folder and be prepared to wait a little for your prompts to be executed.
Here are some renderings on sculptures from my local tests:

Stable Diffusion – local installation on PC
It took me a little while to test the PC installation, but I guess this guide here is quite good and straightforward:
AUTOMATIC1111's SD-WebUI (Windows)
Following the guide you have similar steps as on mac, but it is simpler in the execution as there are more installers to run. Finally you have a webGUI to get going.
Please note, that you need a GPU with at least 6 GB of VRAM. 10 GB or more on a NVIDIA GPU with CUDA is highly recommended to allow larger image sizes. A business card, such as the RTX A series is preferred as the energy consumption compared to the value is much better. Maybe the upcoming NVIDIA generation will bring even more value.
On the tutorial site you also get some other guides (I didn't test):

Stable Diffusion Installation guides
Stable Diffusion – other installs

Stable Diffusion in TensorFlow / Keras

Creativity unleashed with Stable Diffusion
To get an idea about the full potential I collected some random examples from the past month. There are so many exciting opportunities. People create comics, movies or just play around.
Kali Yuga models
Kali Yuga provides some cool custom-trained models for Stable Diffusion. Here are some shots taken from Twitter:
KaliYuga on github

from Orobic Oak / twitter
from Digital Jawns / twitter

You might have guessed it, there are also notebooks on google colab around to work with them. An alternative would be jupyter notebooks, but to keep it simpler, we stay with google colab.

Notebook for #textilediffusion.
Notebook for #Pulp-Sci-Fi-Diffusion
Notebook for #lithography-diffusion
Notebook for #watercolor-diffusion
Notebook for #pixel-art-diffusion

Those notebooks are quite easy to handle. I used the #textilediffusion, to generate this sample piece here:

Stable Diffusion and #textilediffusion example from the author
Click the images to jump to the examples. Due to data policy, I don't embed external sources.
Stable Diffusion and Music:

from TomLikes Robots / Twitter
Stable Diffusion and 3D

from CoffeeVectors / twitter
from Infinite Vibes / twitter

from merlino_games / twitter
Here's the GitHub Source for the Stable Diffusion blender texture generator.
Another link, that is connected to Unreal and midjourney is the generation of textures.
Stable Diffusion and Image Tools
Stable Diffusion Photoshop Plugin

Screenshot from Website from Christian Cantrell
There are also options for text-to-image in Canva and GIMP already and Nightcafé and artbreeder seem to have changed their models towards stable diffusion as well (you might remember that earlier this year they both used some GAN+CLIP solution, as mentioned in my article).

Stable Diffusion to generate color palettes from text descriptions

from Matt DesLauriers / Twitter
Other sources to mix with Stable Diffusion or to watch in general:

Get3D: A Generative Model of High Quality 3D Textured Shapes Learned from Images
OpenAI Whisper
Google DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generation (GitHub implementation for Stable Diffusion and Google DreamBooth and another Stable Diffusion Implementation with DreamBooth)

Stable Diffusion and DreamBooth – great video to watch

Final thoughts on Stable Diffusion AI – image jockeys on random turntables.
I love it. Going for the open-source path is so great to unleash new instruments of inspiration and with lucky punches, even to create art. Art is expressive and the artworks being created might get expressive. For me it's an enhancement of our daily practices being creative. I also don't think anyone must be afraid of losing jobs. For precise tasks it is still tricky to work with the tools.
The models are only as good as the inputs; handling the inputs is not the easiest practice and as generating the images takes some time… in terms of client work, the way using any generator might not be the fastest option to choose. As always, I assume clients want to negotiate cost as they think everything is going easier now. But currently the image generation at a professional level is still not precise enough. But the tools are already there to help. Google Dreambooth for example could help a lot to bring consistency into image series.
Looking at the development speed I assume the topic about precision will be a matter of the next years, as well as the topic about speed and custom training sets. I am also worried a bit about the footprint being generated from all the image generations (including all the learning upfront). In hugging face there's a note on the Stable Diffusion model card itself: 11250 kg CO2 eq for the learning (calculated with the machine learning emissions calculator).
The development in text-to-image is far from its boarders yet. But it's so impressive to see the speed of the community to adopt these technologies.
Currently the tools help to discover creativity to finally create a mix of outputs we have seen before. In the future I am sure we can use the techniques to do whole mood boards for clients and in some cases even final graphics or artworks for them.

The only art I’ll ever study is stuff that I can steal from.
David Bowie

Like the evolution of web bandwidth, I think we need some more speed in terms of image generation to open new options and create beautiful human-centered-artworks as one day maybe images could be generated in real time based on likings of visitors. I also assume, at the moment we reached a certain grade of automated artworks, more and more people will enjoy discovering real artworks with their hands again and value of the real original artworks will raise.
In general we shouldn't trust media without a critical perspective, especially when we see images. History showed us that people will abuse technology. So I hope for people to find value in real in-person events after Covid pandemic again. Digital could and will be a lot of fake.
The use of some kind of style transfers on Smartphones is very likely by next year. Dynamic Video generation is also on its way (see make-a-video from meta ai), so we have text-to-video generation and music, VR worlds and games are also around the corner, as Midjourney founder David Holz said. Due to open-source development, I won't say it takes 10 years. And also Google Colab and other services to run the software will change their business models to profit from this boom.
Advertising or Branding will also be affected. It will be an exciting journey in the next two or three years. Osmosis pretends to have some of the features that could be interesting for an early stage. Just imagine adding a target group to the prompt, an industry or a segment. For Learning there are many galleries out there, such as dribble, FWA and many more 🙂 it will be fun to see where this journey goes! (Saying this not being in an international network agency anymore).
As mentioned many times, the development speed is incredible. The current hot tool is google dreambooth (connected to Stable diffusion). Every month there might be another unexpected cool tool to pop up. Maybe even photoshop integrated the tools for their next release.
For me, design turned more into managing design over the years but still design is functional, and art is expressive. Currently it feels easier to create automated expressiveness in fantasy worlds, but nonetheless I also use AI tools during the creative process. The results of machine learning give you a condensed view of common thoughts. So, I often used the prompts to check for color ranges of certain clients, compared it, what google says and easily created something one could call the "wisdom of the net" result.
Our traces on the net and our databases of artists created the look we could mix now. We are the image jockeys of generations that are already there. Unfortunately there's still a lot of randomness in the result to utilize it more professionally.

My "wisdom of the net" results from huggingface
My "wisdom of the net" results from huggingface

So long, enjoy and go out and play to discover the fun playing with those great tools!

Recommended readings

Understand latent diffusion models
Get a full introduction to Stable Diffusion

Midjourney and DALL-E 2 – first hands on impressionsMaybe you remember my article speaking computer language – welcome AI art, speaking about the new role of t
Generative Art – how to get started with AI ArtThe world of art is a diverse and beautiful place. The more we explore new forms of art, the more we are
How AI Assistants Can Help You with Text and ArtHave you ever wished you had a personal assistant to help you with your writing or with your artworks?
AI
Stable DiffusionStable Diffusion is a machine learning, text-to-image model to generate digital images from natural language descriptions. The underlying approach was

Parti Website Screenshot
In this article I want to share my first hands on experience with Midjourney and DALL-E 2 with you. With midjourney moving to open beta and starting their v3 image generation algorithm on the 25th of July, another player pushed to the market… and I guess one or two days later, finally my invite for DALL-E 2 arrived.
At that day I was happy at first, but when I noticed another day later, that another E-Mail I used for signing for DALL-E 2 only a few months ago, despite the first one, being used for application far more than half a year ago, I was a bit disappointed. I thought it’s all connected to their new pricing model and the beta start of midjourney and I got disappointed a bit. The exclusiveness was gone and “mass-market” arrived.
In general the market on AI Art bots seems to push a lot. So for example DALL-E mini, the free tool I mentioned in my other article, is now called craiyon. There are also other tools Worth being mentioned in the context of AI art tools, such as Latitude Voyage (of course in beta) or Apples GAUDI, a prompt tool for indoor 3D scenes.
Luckily I heard the U.S. Copyright office said A.I. Art can't be copyrighted, so I hope no war will heat up this exiting market in the near future. So far I only know that there are patents on algorithms being used. Hopefully the market will show even more diversity in the future.

Midjourney Screenshot Website
Midjourney beta – first impressions
Let us first look at our new player. Midjourney. The first impression of midjourney is being geekier and less serious than DALL-E 2. It’s a more playful entrance to a world everyone could test right away. After joining the beta, you will be redirected to Discord, no waiting list, no exclusive clubbing.
Before we investigate discord, a quick explanation of who Midjourney is. Midjourney is an independent research lab exploring new mediums of thought and expanding the imaginative powers of the human species.

IN 10 YEARS, YOU’LL BE ABLE TO BUY AN XBOX WITH A GIANT AI PROCESSOR, AND ALL THE GAMES ARE DREAMS.
David Holz in an Interview with the verge

David Holz, the founder of midjourney, did some other geeky, funny things in the past. He used to be co-founder of leap motion, a great exploration of the power of gestures. Midjourney is a small company right now with around 10 people working there.
Exploring the background of midjourney and all their way, how they speak to their audience, in other words their tonality feels great to me. It has the explorative spirit and playfulness I always try to teach students to get started in digital.
Signing up for a free account, you get 25 credits, these can be used to generate images within the discord channel. For anyone being interested, it is even possible to run midjourney on ones own discord server.
After that, you’ll have to pay — either $10 or $30 a month. The pricing is connected to the number of images you want and the privacy you expect. And if you are a huge company with more than 1 billion revenue a year, you get the corporate membership for 600 US dollar a year.
So how does it work?

Screenshot Discord Channel midjourney
If you never used discord before, see it as a chat tool, kind of a slack for the masses, with a non-business focus.
So, in the channel you will find all the information there are in general, on announcements, updates and so on. If feels like you as beta tester are part of the team, and even the boss is there, and you could influence the development process. After all, that’s what a beta program is about.
In terms of my professional perspective being more experienced with product and user testing, this is a great way for that kind of product, as the product itself is being used in the same environment.
So here are the steps to create images:

Look for a newbies Channel and enter it (in the picture you see newbies-29, newbies-59 and newbies-89)
If you have a picture in mind, about what you want to see, start typing “/imagine”, followed by whatever you want to see.
Within 60 seconds you should see 4 images.
With the 4 images being generated, you could upscale the image or create variations. Therefore, there are U1 to U4 (für upscaling) and V1 to V4 (for version) below the images being generated. Upscaling means that the images scale up to around 1664x1664 Pixels
Save the result, click on the generated image (to enlarge) and with the right mouse button being pressed, select save image to your local computer.
Finally, you could also ask the bot to send the results to your Direct messages, by reacting with the envelope emoji.

Prompt dialogue in discord (taken from quick start guide)
Example from discord stream with 4 generated images

Prompt dialogue to use envelope (taken from quick start guide)

This is enough to create visual beauty.
If you need inspiration, look in midjourney ressource list, there are great links:

The artist visual style encyclopedia (as of Mai 2023: link not working anymore)
The artist visual style encyclopedia – if the style is part of your text prompt it will take effect – such as cyberpunk city, by Franz Marc:

My result on cyberpunk city, by Franz Marc on midjourney
My result on cyberpunk city, by Franz Marc on midjourney

There’s also a prompt builder to guide your inputs and see which variables are available:

Prompt guide
And a collection on “prompt styles and weights”.
All in all, the learning curve, if you are used to discord and used a text prompt before is very flat. Only if you are new to discord and text prompts, you need more orientation.
After all I could say, I loved it. I love the playfulness of the whole app, the results and all the “social” aspects, seeing what all others are building, getting notifications about own results and the whole way it is being setup. It is great fun to try and the documentation is very helpful.

DALL-E 2 Intro screen
DALL-E 2 beta – first impressions
With the magic of the new and little frustration about the almost open invites, I waited to test my DALL-E 2 invites after I tested midjourney.
As mentioned, entering DALL-E app is a completely different experience. It is you and the text prompt, not the hectic news stream and the dynamics you experience in midjourney. Based on the interface/overall app decision, one could say, that DALL-E 2 wants you to reflect about what you type, while midjourney is a competing social feed, about who creates the coolest results.
The cost system at DALL-E 2 is based on credits. You get 50 credits for the first month for free and 15 credits every month after. With only 15$ you could buy additional credit packs worth 115 credits, which equals around 460 images. OpenAI allows commercial use of DALL-E images. Compared to the image stock market, the costs of the images will be fairly low, but one must be award that you have to get used to the text prompts and the corresponding structure of the input.
That being said let’s try to get a result for our cyberpunk city, by Franz Marc.
In the case of DALL-E, I couldn’t find a quick hands on, official documentation; so, I tried the sentence as following: A cyberpunk city in the style of Franz Marc, as the example being shown by DALL-E on their homepage also used the "in the style of" syntax.
My result on that one was quite… disappointing. I don’t know why DALL-E missed the style of Franz Marc that much:

DALL-E 2 result on a cyberpunk city in the style of Franz Marc
To investigate further, I needed a prompt guide for DALL-E 2. Googling for some help, you find

The DALL-E 2 prompt book – my recommended choice
OpenAI DALL-E 2 prompt guide

Going through the prompt options, you notice, that there are more parameters than on midjourney. Lightning, Camera position/angles, genres, usage contexts and many more.
So, I gave it another try, changing the prompt a bit leading to a much better result in terms of the style:

DALL-E 2 result on a painting from Franz Marc showing a cyberpunk city
Unfortunately, my tries with real artists didn’t work out so good with DALL-E 2 at the start, so I had another try…
My result from midjourney:

Midjourney result
And the same prompt from DALL-E 2:

First result on DALL-E 2
Getting used to the prompt dialogue on DALL-E increases the results a lot:

Adjusted text prompt
Using the right prompts is the essential part to get the best results. If your prompt is done right, it seems DALL-E is more precise, though midjourney is so much fun to use.
For DALL-E there's even a paid service being launched called promptbase to help you with using the right prompts:
Screenshot from promptbase.
If you want to discover more, I recommend searching the web yourself. On twitter I found some comparisons, having a similar impression I do:

From twitter
Resume
Is it possible to do a final resume on the tools? I guess no. On the one hand I am not experienced enough with both tools, on the other hand I think both tools are great and give us a glimpse into the future. The documentation on midjourney and the entry barrier is lower, so to get started, I would recommend midjourney in any case. The more you are aiming for precise results (as an alternative to stock images), the more it feels DALL-E 2 is the way to go.
Will be exiting what the next two month offer in terms of AI generation tools. 2022 is very exiting so far in terms of AI art generators and it will be exiting to see what's next.
What's next? Update mid August – dreamstudio arrived
As mentioned, the speed new, similar offerings are popping up on the market is impressive. It seems, AI in combination with images is going mainstream. Another tool to check out is dreamstudio. Access is quite easy as well and the results are also impressive. Also the editor looks promising, see my screenshot below. After my family holiday I might try a daily use check of all those great tools.
Screenshot dreamstudio and results on "A dream of a distant galaxy, by Hiroshige Utagawa, matte painting trending on artstation HQ."
Recommended readings

The AI that creates any picture you want, explained – The process behind DALL-E 2 (and others) explained
What AI means for human artists – great collection about views from the artists/designer perspective
Making AI Art with Midjourney – great article with examples and explanations
The Creativity of Text-based Generative Art – paper on text-based generative art
The trouble with DALL-E – Five thoughts on the use of artificial intelligence to accelerate the digital art market
My follow up article on Stable Diffusion: Stable Diffusion celebrates new forms of creativity

Generative Art – how to get started with AI ArtThe world of art is a diverse and beautiful place. The more we explore new forms of art, the more we are
How AI Assistants Can Help You with Text and ArtHave you ever wished you had a personal assistant to help you with your writing or with your artworks?
AI
Speaking computer language – welcome AI ArtThe command prompt: A black, empty screen and a blinking line, waiting for my input. Could you imagine

Contentforge dialogues
Ryte dialogues

Just like any tools, it has its limits. But if we use it in the right way, and with common sense, AI writers could be great writing assistants that help us to get over the writer’s block or come up with ideas at scale.
To give you an idea, about my used tools in this article: I used contentforge as the holder of my article, then I used rytr to write the blog section, mentioned above. In contentforge I used the "generate content" button from time to time, to see what happens.
Some of the generated text is great, and I can see myself using this type of tool in the future for smaller tasks or ideas generation. For longer articles or books, I absolutely believe that a human writer is needed to create a compelling story.
(so, this paragraph before was added "generatively" as an add on to the article I just wrote 🙂 quite funny)

But yes, these tools could be a great support. I am more worried about all the people using them for just pushing their SEO stuff instead of writing contents reflecting their believes, experiences or research.
When it comes to research and real articles, they don't help you to create the real content. But they could be handy to assist some SEO parts, such as a summary, some headlines in between and so on. To do a deep review, I miss the experience.
It is likely that all these tools make use of deep learning and GPT-3, a generative pre-trained transformer. So in my special case, not being a native speaker, tools (also grammarly, jasper or others) could help to improve my writing in terms of grammar or the words being used in general. The other bigger help I see in the area of SEO, if you want your content to be fully optimized for SEO. So it's kind of a polisher for your contents and an ideation source as well.
If you wonder, why I don't speak about chatbots in the context of text,... cause I think they are an own category, there are also many tools around, most act in a conversational way and are trained by machine learning principles. Here's a good entry/overview.
AI assistants in graphic design
I already mentioned some tools to create so called "AI art" in my article "Speaking computer language – welcome AI Art". I guess I also mentioned some logo generators out there already, maybe I also shared a link to Nikolay Ironov, a designer and neural network.
To wrap it up, I clustered some of the tools in some categories here:
AI generated images
For generating images at a general scale, we could include all the tools being mentioned in my other article on AI art before. DALL-E (1,2, mini) or Imagen and all the Ganbreeders such as artbreeder, nightcafe, wombo.art are some of the AI assistants for graphic design, to name a few.
But there are also tools to create people that operate with AI, like the incredible Metahuman builder from the new unreal 5 engine, there are AI driven ways to create people images. Generated photos is such as platform. There’s also a face generator available to create an image. Of course, you could get quick results, that look like fake quickly, but there are also images, that look quite promising;

Image from generated photos
Similar to generated photos, you could create AI actors with notaperson.ai. In my point of view the characters sill fell a bit static, but the powers of creating random people is there. If you don’t believe, watch the random results on thispersondoesnotexist.com. With the help of StyleGAN2 a lot of images are generated in a GAN way. The world of fakes is real, and besides images, also speech could get modified easily.
If you don’t like real pictures, look at thiswaifudoesnotexist.net. (A waifu is a fictive female Japanese manga/anime character).

Generated Waifu Image
AI generated logos
There are also a bunch of logo generators out there. Nikolay Ironov offers one and on logoai.com, you could quickly generate your own logos with some guided dialogue. A similar builder could be experienced here as a service from shopify or at logomaster.ai.
You might think, how scarry this is? No, it’s not. Honestly, I included AI tools in my exploration on the branding of a client already. Of course, branding is more than a logo, as it’s about the identity of the brand. Each personality has different characteristics that need application to the branding guidelines.
But now let’s assume you type in a DALLE Mini interface the attributes of a brand or a short description and look at the result; now compare it to some other text-input based generator. Won’t you think you get some kind of color scheme on that?
At least for my last branding project, I included AI Tools in my research. I got some straightforward color schemes I could extract and that were helpful. I didn’t use one of the mentioned logo generators though, but they could also be helpful in the exploration process as they help to narrow down the chosen path we want to follow.
In my case the brand itself was connected to AI and Edge Computing, so there was a brand fit with the tools being used. At that moment it felt right to ask the question, how an AI might see the company, reminding me of a nice piece of art by Christian Mio Loclair called Narciss, a a robot, built to analyze its own physical embodiment. Looking at itself and reflecting, what it sees; so why not use such tools, if they match to the brand?
AI drawing
I am not too experienced with AI drawing tools and so I only share the one I discovered some years ago. Autodraw. A Tool to help you create icons. It gives you proposals based on the shape you were drawing. So, in my case it recognized my fish shape and gives me proposals about other fish related shapes at the top.
Form recognition from autodraw
Another fun application in a similar direction is https://quickdraw.withgoogle.com/. Challenge your Mouse drawing skills with form recognition.
Other AI tools for images
Finally, another tool you could give a test is an deep learning based image upscaler.
Screenshot from imageupscaler.com
Resume
Is there a final wrap-up on my mentioned AI tools at all? Yes, there is... we are getting more and more tools that could distract and being applied wrong lead to bad results. Whether it be a world full of fakes (in terms of visual, text, voice) leading to less trust in digital environments or a tendency we often see when tools streamline processes. A lot of trash gets produced.
The danger of expecting magic with the tools is also there. These are tools that could assist, but they don’t define the plan, what you are aiming for. So, define the strategy upfront and evaluate afterwards. A sentence that sounds so true since 20 years and more being in digital for almost anything, whether it be creating websites, apps, designing things or any business objectives. Tools can’t replace goals and a strategy. AI assistants or tools are in this case not different from any other form of tools.
The perfect AI tool must integrate to your own process. In my case I see most potential in the exploration stage. As most creative processes are similar and alike, I refer to an easy system, such as human-centered design. We speak about inspiration, ideation, and Implementation. During these stages of the creative process,
AI could help you exploring your thoughts, flipping the problem and many more things that help you to get going. All the mentioned “methods” would be placed within the stage of inspiration. Also, in terms of a reframing of the topic, AI could help, as it is another perspective on the problem – often from a “wisdom of the crowds” perspective, as the trained algorithms are trained by the masses.
During the Implementation I see AI as an add-on to evaluate own results, in terms of writing to check the grammar, in terms of design to check for uniqueness or testing.
So finally, I could say, I believe in a lot of the automations being possible with AI, but like UX-Design, that got streamlined over the years with bet applied patterns (and corresponding dark patterns), AI-tools will lead to the same effect, some rebound effects: Imagine a lot of sites being written by AI and google ranks being strongly influenced by AI. The overall quality of the content will drop, and a search won’t be user friendly anymore. Hopefully AI results will get recognized and filtered.
Or on the graphic side, customers think of using AI builders for logos and more website design from finished templates. This will lead to less identity, uniqueness on the web and meaningless branding as all look the same. Uniqueness will be the struggle of the future as it is the struggle for all streamlined processes.
I recommend anyone being interested, to have a look at the tools yourself. There are enough tools with a free version to play around. Have fun and use the tools for good!

Stable Diffusion celebrates new forms of creativity2022 is the year of text to image generators so far. With a crazy hunt for new tools starting in summer.
Speaking computer language – welcome AI ArtThe command prompt: A black, empty screen and a blinking line, waiting for my input. Could you imagine
Value, objectivity and the risk of being trapped by searchDear Google, could you please eliminate the stupid goldfish attention span myth?
I know the myth is a
Artificial intelligenceintelligence (AI) is intelligence demonstrated by machines, as opposed to the natural intelligence displayed by animals including humans. AI research has
Midjourney and DALL-E 2 – first hands on impressionsMaybe you remember my article speaking computer language – welcome AI art, speaking about the new role of t
Generative Art – how to get started with AI ArtThe world of art is a diverse and beautiful place. The more we explore new forms of art, the more we are

What if you were asked to create art like Refik Anadol? Or to produce some "AI art"?
In case you haven't heard of him, go directly to the vimeo channel of Refik Anadol and enjoy the moment of discovery!
When I first saw his pieces (only virtually so far), I was flashed. I really love that look of organic movement and abstract shapes. And one question that came to my mind was… how on earth was it done? As I did some research about him a little while ago, but recently rediscovered my love for his work, I wanted to share my findings about him and what could be called AI art.

For me, art reflects humanity’s capacity for imagination. And if I push my compass to the edge of imagination, I find myself well connected with the machines, with the archives, with knowledge, and the collective memories of humanity.
Refik Anadol in an interview with MoMA in 2021

To get an idea who Refik Anadol is and what AI in the context of art is, I recommend watching the ted talk with him.
Art in the age of machine intelligence, title picture from ted talk. Watch Talk.
Painting with data
Melting Memories or Machine hallucinations are examples of his stunning artworks collection. Many of his artworks take the perspective of the computer: what does it look like if a computer is dreaming?
In a world surrounded by data, Refik Anadol uses this data and presents it in a visually stunning representation. These data sets could include many terabytes.
To work with the data he uses machine learning (ML) to produce interactive AI projects. If you are up for Quantum AI by google, there’s also a project you could check out: Quantum memories. And here’s some insight from the data perspective on youtube.

In the past five years, we’ve trained more than 100 AI models, and used close to five petabytes of raw data.
Refik Anadol in an interview with MoMA from 2021

As I mentioned Refik Anadol works a lot with data. For the piece “Melting Memories”, he used EEG data to paint. In the description of the artwork you could find more details on how the masterpiece was realized. Refik describes the use of EEG data and some challenges converting it to vvvv. A live programming environment, everyone, who ever looked at interactive environments might have heard of. IIf you are searching for software that is native to mac, you could give touchdesigner a try. If you are more of a programmer, you could also look at openframeworks.
Besides data, it seems Refik Anadol likes giant canvasses for his art. So he also likes facades to transform architectural spaces. The illumination of Frank Gehry’s Walt Disney Concert Hall is an iconic example. Titled WDCH Dreams, he makes use of projection mapping to illuminate the building. Google Arts & Culture has an interesting page about Refik Anadol, explaining more facets of the piece.
WDCH at Youtube
To get the projection right, you could see that he had a model of the building in his office.

In my practice, I’m not just creating a bunch of shiny pixels. I’m doing my very best to bring depth to surface by understanding exactly why technology may be purposeful and impactful for my imagination. Not because it’s the hype, or because it’s new, or because it is popular.
Refik Anadol in an interview in Harpers Bazaar Arabia

What are the takeaways from AI Art?
It is truly fascinating to see how Refiks Anadols' work circles around our current digital, AI-driven and real landscape. Of course, the work does not address every aspect that is relevant at the moment. This includes environmental aspects, as I mentioned in my article Improving the world as a designer. However, his art makes future aspects of AI tangible in a visually appealing way. Everything I expect from art.
There’s an interesting discussion in MoMA magazine on “Modern Dream: How Refik Anadol Is Using Machine Learning and NFTs to Interpret MoMA’s Collection”. The article describes Refik's Journey to get into his machine hallucination series. It is an excellent source of inspiration, as well as an overview of the status quo of AI-art and its beautiful perspectives. In terms of the ever emerging NFT landscape maybe even an option to get into AI-art yourself. If your alarm signals are ringing, when i mention NFT, be assured, there are eco-friendly NFTs, too.
By the way, if you want to dive deeper into equipment, I guess one piece I forgot about is the projector he is using. And if you want to get a comprehensive overview of his most famous pieces and the money he earned, you can find more on artnsketch. Unfortunately I didn't find details on how he creates the depth in his works. However, I am pretty sure it's the combination of architecture and the illusion of the depth, that creates the magic you might know from playing with generative art.
If you want to dive into the world of generative art, I would recommend getting started with p5JS or processing, but also touchdesigner offers awesome tutorials to get started. Another way to learn is following Daniel Shiffman, aka the coding train on youtube. No matter if generative programming or getting started with Machine Learning (ML). Watching him is already a classic. There's also an impressive collection of AI artists, tools and resources at aiartists.org.
Those principles being applied within AI-artworks are, in my opinion, relevant to design disciplines as well. Interacting in 3D space and mapping visually engaging worlds in a metaverse or other VR experience is challenging and requires more thought, as the world of AI is already showing. Maybe Refik offers such a world for us in one of his latest projects: dataland.
For now my final summary is, thank you, Refik Anadol, for inspiring creative visual discoveries and an inspiring combination of contemporary technologies to provide beauty.
❤️ @refikanadol

Other articles and sources:

AI Artists
Some resources I collected in my article "Generative Art – how to get started with AI Art"
My other writings often focus on how AI is being used in Design, Art, and society in general and I often share some thoughts.
AI Art: How artists are using and confronting machine learning | HOW TO SEE LIKE A MACHINE – great video from MoMA with some more description of Refik's work

Recommended tutorials to get started:

Refik Anadol Particles in TouchDesigner, Part One - Tutorial
Refik Anadol Particles in TouchDesigner, Part Two - Tutorial
Some more links to tutorials and how to get started with AI Art you will find in my article Generative Art – how to get started with AI Art

Artificial intelligence artThere are many mechanisms for creating AI art, including procedural 'rule-based' generation of images using mathematical patterns, algorithms which simulate
Generative adversarial networkused to generate art; The Verge wrote in March 2019 that "The images created by GANs have become the defining look of contemporary AI art." GANs can also
Speaking computer language – welcome AI ArtThe command prompt: A black, empty screen and a blinking line, waiting for my input. Could you imagine