Adobe’s Promising Generative AI Tools Have Room to Grow for Photographers

2 weeks ago 10

A happy dog with a long snout and floppy ears sits at the beach, framed by a pink circular object. In the background, people are enjoying the sea and sand on a sunny day.

When Adobe debuted the Firefly-powered Generative Remove tool in Adobe Lightroom and Adobe Camera Raw in May as a beta feature, it worked well much of the time. However, Generative Remove, now officially out of its beta period, has confusingly gotten worse in some situations.

For photographers not opposed to generative AI in their photo editing workflows, Generative Remove and other generative AI tools like Generative Fill and Generative Expand have become indispensable. They utilize AI to significantly speed up and improve image editing without taking control away from the photographer.

But since the recent updates following Adobe MAX earlier this month, some users have found that generative AI tools in Adobe Camera Raw, Lightroom, and Photoshop have taken steps backward. PetaPixel‘s testing has corroborated the complaints.

Adobe is aware of the issues and explains that, unlike non-AI tools, those powered by technology like Firefly, which is constantly being fine-tuned behind the scenes, are not continuously improving in every possible situation. While a one-step backward, two-step-forward situation is foreign to most photo editing applications, reality has changed in the age of AI.

“The quality has dropped to an unusable level. Textures that were rendered beautifully in previous versions now sometimes appear smudged or as if painted in with a brush. There are far more nonsensical fills — like birds randomly appearing in hair or clothes, and extra hands in bizarre places when the image already has two!” writes RedFishBlack on the Adobe Photoshop forums. “It’s like AI gone wrong. What happened to quality control? How does the AI actually get worse? This is beyond frustrating.”

As the disgruntled photo editor adds, there is no simple way to roll back to an older version of the Firefly tools. Images are processed server-side, so there is not much available by way of user control. RedFishBlack refers specifically to Generative Fill in Photoshop, but the problems extend to other tools, including Generative Remove, a tool tailor-made for helping photographers clean up photos and remove distractions.

A misty coastal scene with a small grey house surrounded by a field of purple lupines. The background features rocky shores, evergreen trees, and a calm body of water under a cloudy sky.Removing the shack from the foreground and the house in the background is a tricky task.
A misty coastal landscape with purple lupines in the foreground, a calm body of water, and a rocky shoreline. Evergreen trees are visible through the fog in the background, creating a serene and peaceful atmosphere.This variant isn’t quite right. The house in the background should be replaced by trees, not a different house.
A misty coastal landscape featuring a rocky shoreline, a calm body of water, and a foreground of lush purple lupine flowers and greenery under an overcast sky. In the distance, a dense forest is partially obscured by fog.No house this time, but the trees seem soft and weird.
A misty scene with a forest in the background and a rocky shoreline in the foreground. Trees and greenery are partially obscured by fog, creating a serene and mysterious atmosphere by the water's edge.At 100%, the issue is evident. The new trees look nothing like the existing trees. While this is fine for sharing on Instagram, this is unusable at a high-end level.

In a separate Adobe Community post, a professional photographer says they use generative fill “thousands of times per day” to “repair” their images.

“The generative fill was almost perfect in the previous version of Photoshop to complete this task. Since I updated to the newest version (26.0.0), I get very absurd results,” the user explains. Since the update, generative fill adds objects to a person, including a rabbit and letters on a person’s face.

People walk along a rainy street in a shopping area. Two individuals in traditional clothing hold an umbrella. Various shops and signs line the street, with some pedestrians carrying umbrellas.

People in traditional attire stand under an umbrella on a rainy street in a Japanese city. They are looking at something, possibly a map or phone. The street is lined with shops and signs, and a bright orange mailbox is in the foreground.Instead of just removing the people, Generative Remove added a trash can of some kind. This is a really puzzling result.

“The success rate has dropped to maybe 5-10% (or less!),” the photographer says. “Before the update, it was more like 90-95%.” Even when they add a prompt to improve the results, they say they get “absurd” results.

“Little hiccups are normal, but this ruins my workflow.”

A serene coastal scene featuring a small rocky island with tall evergreen trees, surrounded by calm water. In the distance, another island is visible. The sky is overcast, casting a tranquil atmosphere over the landscape.Before removing the boats using Generative Fill
A tranquil coastal scene with small rocky islands covered in dense trees, surrounded by calm blue water. Large boulders are in the foreground, and the sky is clear, casting a serene atmosphere over the landscape.After — Generative Fill can still do a great job in its current form.
A serene coastal scene featuring calm blue waters, rocky shores with sparse trees on the left, and a small, tree-covered island in the distance under a pale blue sky. Three buoys float on the water.Even under scrutiny, these new pixels look great.

The two users who responded say they have the same issue: getting weird objects added to their images and having massive problems with textures not matching the rest of an image.

Generative Remove and Generative Fill are technically different, although their use cases overlap. Adobe itself has advocated for the use of Generative Fill to remove objects from images in Photoshop, for example. Some of the issues with Generative Fill persist across different tools, too. Among the most significant problems for a typical photographic workflow is that Adobe’s generative AI is having a lot of issues with matching textures in an image and being resistant to removing an object and instead seems inclined to replace it with something else.

A serene black and white image depicting a calm lake reflecting the starry night sky. In the distance, a line of trees outlines the horizon, creating a tranquil and timeless atmosphere.When trying to remove planes from a night sky image, the new pixels should match the surrounding sky, not be dark blobs.
A sunset view over suburban rooftops with a clear sky transitioning from blue to soft pink and orange hues. Trees and houses are silhouetted in the dimming light, creating a peaceful evening scene.It’s pretty obvious where the powerlines across this image used to be.

As its name suggests, Generative Remove generates new pixels using artificial intelligence. If pixels are removed from an image, they must be replaced with new ones. For photographers, the new pixels are nearly always meant to jive with the background, making it look like a distraction was never there in the first place. If the pixels are too smooth, too noisy, or the wrong color, one distraction has just been replaced with a new one.

Generative Remove and Fill can be valuable when they work well because they significantly reduce the time a photographer must spend on laborious tasks. Replacing pixels by hand is hard to get right, and even when it works well, it takes an eternity. The promise of a couple of clicks saving as much as an hour or two is appealing for obvious reasons.

However, at the moment, these latest generative AI tools, many of which were speeding up their workflows in recent months, are now slowing them down thanks to strange, mismatched, and sometimes baffling results.

In response to a complaint on Reddit about Generative Remove in Lightroom adding objects rather than erasing them, Adobe employee Terry White, an excellent photographer and educator, says that users must be careful to paint over the entire object using Generative Remove.

A serene coastal village with wooden houses on a hillside, overlooking a calm harbor. A small white boat is docked on the water, with early evening light casting a peaceful ambiance.As as another example, removing the boat and dock in the background would create a more serene overall scene. However, that removal would be difficult to do manually thanks to the various textures, shades, and reflections. But what can Generative Remove do?
A serene coastal scene featuring a quiet harbor with a docked white fishing boat. Houses with weathered wood siding line the hillside in the background, under a clear blue sky. The calm water reflects the buildings and boat, creating a peaceful atmosphere.As it turns out, a lot in this case. This is a fantastic result.

“For best results when using Gen Remove is to make sure you brush the object you’re trying to remove completely including shadows and reflection. Any leftover fragments, no matter how small, will cause the AI to think it needs to attach a new object to that leftover piece. Causing it to replace instead of remove,” White explains. While this is good advice, overbrushing is not always enough.

The original poster on Reddit suggests “there is still room for improvement.”

“I agree,” White replies.

Adobe is listening to feedback and making tweaks, but AI inconsistencies point toward a broader issue. Generative AI is still a nascent technology and, clearly, not one that exclusively improves with time. Sometimes it gets worse, and for those with an AI-reliant workflow, that’s a problem that undercuts the utility of generative AI tools altogether.

As some examples above show, it is absolutely possible to get fantastic results using Generative Remove and Generative Fill. But they’re not a panacea, even if that is what photographers want, and more importantly, what Adobe is working toward. There is still need to utilize other non-generative AI tools inside Adobe’s photo software, even though they aren’t always convenient or quick. It’s not quite time to put away those manual erasers and clone stamp tools.

Read Entire Article