Editing images with machine learning

Chinks in my armour of learned Photoshop helplessness

October 16, 2018 — November 2, 2021

computers are awful
generative art
making things
photon choreography

Assumed audience:

No-one, now. This is comically outdated.

Why are we doing anything manually any more? There is AI to do all the menial repetitive menial stuff for images, and manual repetitive image processing is the unambiguous great triumph of modern AI.

Figure 1

There is a brief efflorescence of quirky small ML companies producing these apps before they get bought up by Adobe.

Background removal is something I need in practice often. Clipping Magic is fun and removes backgrounds using AI plus also a nicely-designed user interface.

Figure 2

Competitor removebg does something similar, and slightly cheaper, although there is less user configurability.

croppola does content-aware cropping.

Kritik Soman’s GIMP-ML plugins bring some cute ML tricks to open source image editor GIMP. I love the idea, but it is quite unwieldy.

All the above ones are already from previous hype cycles. Below is a new crop of automatic image editing:

1 cleanup.picture

2 Letsenhance

Famously viral in recent times, Let’s Enhance uses AI super-resolution and colour enhancement to make images bigger and shinier. Might also salvage something usable from facebook’s savage compression and downsampling.

3 Vance

Vance AI Image SharpenerI Pricing Plan

4 Hotpot

Art Personalization ( API Test Tool)

5 Runway.ml

Runway.ml

a platform for creators of all kinds to use machine learning tools in intuitive ways without any coding experience. Find resources here to start creating with RunwayML quickly.

In particular it plugs into Blender and Photoshop and allows you to use those programs as a UI for ML-backed algorithms. Nice.

6 References

Soman. 2020. GIMP-ML: Python Plugins for Using Computer Vision Models in GIMP.” arXiv:2004.13060 [Cs].