Petri Kajander

EssayTechnology and the media shift

AI disrupting creative and content industries

Can machines replace artistic expression? Do ML and AI mean disruption for many current jobs? What's happening next?

18 September 20225 min read

Who needs stock photos when you can create your own content with a few keywords when needed?

This is the level of disruption we’re experiencing now with DALL-E, Stable Diffusion and other machine learning models. Unlike OpenAI’s DALL-E, Stability.ai has released Stable Diffusion as an open source and it runs on regular computers without the need for heavy GPU units. You can test both with free online accounts.

XA post by @dergigitwitter.com

What happens to artists when everybody has the tools to create new visual content based on extensive machine learning models?

We are already starting to see a flood of visual content since it’s so easy to generate it automatically or by manual iteration. This has created new job titles and demand for specialised skills such as prompt specialists & curators, digital art miners & historians among others.

XA post by @dergigitwitter.com

It did not take long to figure out that you can generate tons of NFTs and jpeg monkeys with these models. But who’s going to buy all that freshly minted visual content? Check yourself to get an idea of what’s out there already.

It’s not just visual content. The same disruption is coming to audio and video content as well.

Play video

Audio and video generated by deep learning models

Who should be worried – creatives, artists, everybody or nobody?

There have always been new tools coming to market when the technology has improved. This is not a new phenomenon. Photographs replaced commissioned portraits when cameras and their processes became more affordable. The old ways were not entirely going away but became more specialised and required more creative input to stay relevant.

Digital cameras unlocked the picture taking that was held back by the cost of developing films and the time delay involved but the massive scale-up happened only when mobile phones started to have good enough cameras.

XA post by @benedictevanstwitter.com

Is the machine learning generated content creative or artistic?

This debate is ongoing and it’s fascinating to follow different points of view. Humans have always imitated, copied, modified, altered, improved and iterated anything and everything they have managed to get their hands on. Hip-Hop Evolution is a good case in point of how sampling became the core of the entire genre of music. Nobody creates anything in a vacuum. We stand on the shoulders of giants as the saying goes.

Machine learning models are giant toolboxes that help in this imitation and variation process. Are most of the outputs bad, tasteless and bulk? Absolutely. The same applies to your social media feed or any other content you’re consuming. We are given more choices. The content generation becomes cheaper in more formats than was available previously. Next in line will be video, audio, AR and VR.

@StableDiffusion Img2Img x #ebsynth x @koe_recast TEST #stablediffusion #AIart

Scott Lighthiser (@LighthiserScott) · September 7, 2022 · View on X

Make any idea real. Just write it. Text to video, coming soon to Runway. Sign up for early access: http://runwayml.com

Runway (@runwayml) · September 9, 2022 · View on X

Can machines replace artistic expression? No. Tools are just tools. AI does not understand the context. It can be deceivingly good at presenting different appearances of meaning but they are just hollow facades based on their models. Machines are good at specialised tasks. They cannot do something they are not built to do, unlike humans who can explain and solve novel situations and circumstances.

Humans are universal explainers, and machines are not. Meaning, context and creativity are different from their representation (language). @ToKTeacher does a good job of explaining this in his podcast and videos. @DavidDeutschOxf's books are a must read.

petri kajander (@petrikajander) · September 8, 2022 · View on X

Art has never been about the tools or media used but the meaning and the context (artists have their own and the audience make their own). That’s the sole territory of humans. We are universal explainers and capable of creativity that no machine can achieve.

@aniketvartak @ToKTeacher I expect and hope for many more AI/ML miracles. And I predict that none of them will bring us a millimetre closer to AGI.

David Deutsch (@DavidDeutschOxf) · April 10, 2022 · View on X

New tools enable new artistic expression. This can happen in the coding and machine learning phase or by using the tools. These methods allow more people to become artists where previously you needed countless hours of practice to hone your skills in creating images, music or other media. Now, you can focus more on the context and meaning if you choose to do so (with many others).

Does this change mean disruption for many current jobs? If you have been making stock photos or other content that can be generated with ML models it may be time to shift to new areas where your skills are more valuable such as AR and VR, or you need to step up your game to stick out of the crowd and become artisan creator with higher perceived value.

I have been experimenting with DALLE-E 2 and Stable Diffusion for a while. It’s an area that will provide insights into the next decades and how our world will change rapidly with visible differences.

How long till people confuse painting titles to image prompts or don't understand the concept of a title?

petri kajander (@petrikajander) · September 16, 2022 · View on X

Here are some examples from this explorative journey for your inspiration and encouragement to start yours.

gm An Estonian summer morning with Dali's The Persistence of Memory style #dalle

petri kajander (@petrikajander) · August 1, 2022 · View on X

Many of my #dalle2 experiments have been hit and miss. Which one of these you like the best? "Cartoonish dog with sunglasses skateboards downhill in a steep street in San Francisco"

petri kajander (@petrikajander) · August 11, 2022 · View on X

A few text strings and you can create these like I did yesterday. It's still mind blowing even though the models have been out for a while. https://thealgorithmicbridge.substack.com/p/stable-diffusion-is-the-most-important

petri kajander (@petrikajander) · September 16, 2022 · View on X

@xmjEE This gets out of hand easily but couldn't resist "Kandinsky talks to Picasso in a bar and Dali takes a photo of them"

petri kajander (@petrikajander) · September 16, 2022 · View on X

InstagramOpen on Instagraminstagram.com