As part of its MAX event, Adobe has presented a battery of projects driven by artificial intelligence in order to facilitate creative work. Among the most notable is Project Stardust, an editing engine with object recognition that uses AI to edit photos. Although the project is in the initial development phase, the results are surprising.
Project Stardust allows you to select and edit various elements in your photos. When you open an image, the tool automatically separates objects, as if they were organized by layers. The user can select them with one click to modify or delete them without leaving a trace.
The demo shows a toolbar that is activated when selecting an object, which includes options such as Invert selection, Flip, Reorder either Eliminate. In addition to this, users can generate objects via text (like ChatGPT) and Project Stardust will add them in a defined area of the image. The AI will automatically adjust the object so that it integrates naturally.
Another interesting addition is the ability to delete background elements in your photos. The button Remove distractors It will automatically eliminate unwanted objects, like those tourists that sneak into the screenshots you took during your last trip. The recognition engine can separate them, although there is the possibility of refining the selection with a brush.
“Project Stardust is a powerful new object-aware editor that revolutionizes image editing and magically moves or deletes objects simply by clicking on them. With Project Stardust, users can easily select, edit and delete complex elements in any image, allowing them to select people in a photograph, move them to a different place in the composition and fill in the background where they were previously. Users can also change elements such as the color of a person’s clothing and the position they are in, treating any image as a file with layers.”
Adobe
Finally, the Adobe demo revealed that it is possible to exchange existing items using generative AI. You just have to select it, describe in natural language the object you are going to replace it with and press the “Generate” button. Project Stardust will adjust the size and rotation based on the position of the original in the photo.
Although Project Stardust is in its initial phase, the technology could be integrated into products such as Adobe Photoshop in the future.
Adobe wants to integrate artificial intelligence into all its products
Adobe does not want to be left behind in the artificial intelligence race and has integrated this technology into its suite of products. Along with Project Stardust, other prototypes of tools that could reach Creative Suite applications were shown. In the field of photography, Project See Through is capable of eliminating reflections in images that you capture behind glass.
Project Dub Dub Dub can translate a recording or audio track into another language, simplifying the dubbing process. When you press a button, the tool generates a track and automatically matches it with the dialog. All this while preserving the voice of the original speaker.
On the design side, Adobe announced Project Neo, an AI that incorporates 3D shapes into 2D designs without having to open Blender or another tool. Although this tool doesn’t generate complex models with millions of polygons, it gets the job done on simple tasks such as infographics, posters, or logos.
All projects are part of Sneaks, a series of prototypes developed by Adobe engineers to show the scope of technology and its possible application in the future product suite. The company has made some of its experiments available on Firefly website for users to test and provide feedback.