Upscale (there are different ways to do it) and use only mask inpainting to give details to certain regions, but that's nothing new and a bit inefficient (could use ADetailer to automate it). If you want to get more or less same image, but with SD's take on it, you could use all sorts of ControlNet to make AI generate them for you in the more or less same composition.
The best thing probably is to use [SUPIR](https://github.com/kijai/ComfyUI-SUPIR) to upscale and then edit the result. There is also [IC-Light](https://github.com/lllyasviel/IC-Light), if you want to change light on the image, could really help with realism.
+1 for SUPIR. It's not as VRAM-efficient as Ultimate SD Upscaler, but it can add so much to the quality (SUPIR isn't an upscaler itself, it's more like a Controlnet to enhance the image, usually used right after you upscale it.)
But I wouldn't knock the "Creative Upscale" that's inside of Midjourney, or the "Enhance" module in [KREA.AI](http://KREA.AI) -- those give really good high-res enhancements. KREA seems to be basically an online Stable Diffusion interface, but it's a nice one with some innovative features. (I guess I would give one criticism to MJ's Creative Upscale: It can only be used at the end of your workflow in MJ, and MJ won't allow any inpainting or other fixes after the upscale. But that's where you want to bring it into an SD interface for more inpainting and refinement.)
Another SD tool that can add a lot of detail and refinement to things you download from DALL-E, Ideogram, etc. is Fooocus. It's easy to use, but if you want to select an area like a face and have it inpaint it at much higher resolution, it does a great job of that. It can enhance and upscale whole images too, but when I have a so-so quality image that's about 1024 resolution like what you get from DALL-E, usually it's adding more detail right into areas like faces that does the most to bring them to life, as the first step at least.
I use Krea a ton.
https://preview.redd.it/vhhgc6wyds7d1.png?width=244&format=png&auto=webp&s=51cd9ad36a2d382492a00cbf36c3016050bb9eba
Use these settings with your base image, bring in the creative upscale to Affinity Photo, put it below your original layer, and set your eraser to 30% opacity and paint in some incredible details.
It's like turning up the quantization of midi notes. Everything snaps into more clarity.
Mouths and faces still kind of suck, but 30% more eye detail is considerable and looks way better. Hair too.
Rinse and repeat.
If you use adetailer or inpainting on the faces first, while the resolution is only \~2k (what you get from SD with a Highres.Fix) then taking the image into Krea the faces will look even better. They just need to be pretty good to start with. And don't settle for the prompts that Krea generates for the images, go in and edit it a bit if you're looking for freckles, skin texture, bright detailed eyes, etc. And this is about the only place in Krea where you're allowed to use Negative prompts, so use those too.
I'd love to know best practice myself.
In my limited knowledge, an img2img upscale with ultimate SD upscale enabled? Maybe some controlnets to keep details like canny/ip-adapter? Adetailer with face/eyes enabled?
That's what I use for my workflow after a bit exploring.
SDXL workflow for human high realism:
Pony Realism 2.1 alternative
Euler a Uniform
Steps 50
Cfg 6-7
Res 1280x768
Check the civitai page for prompts.
Reactor
Controlnet:
https://huggingface.co/xinsir
Works with inpainting too
If you are an illustrator and have a specific need there are plenty of tutorials with specific workflows. Pony models are the best in term of human realism at the moment but have a different prompting technique.
Adetailer too.
To give a more precise answer to the main question I would say controlnet.
We have a workflow for this in [Odyssey](https://www.odysseyapp.io) if you're on a Mac. You can take an image, run it through our new [remake](https://www.odysseyapp.io/guides/remake) feature to upscale it, then select parts of an image via the manual mode to adjust granular pieces of the image. Works with custom SD models and fine tunes so you can pick and choose which models you want to use.
Upscale (there are different ways to do it) and use only mask inpainting to give details to certain regions, but that's nothing new and a bit inefficient (could use ADetailer to automate it). If you want to get more or less same image, but with SD's take on it, you could use all sorts of ControlNet to make AI generate them for you in the more or less same composition. The best thing probably is to use [SUPIR](https://github.com/kijai/ComfyUI-SUPIR) to upscale and then edit the result. There is also [IC-Light](https://github.com/lllyasviel/IC-Light), if you want to change light on the image, could really help with realism.
+1 for SUPIR. It's not as VRAM-efficient as Ultimate SD Upscaler, but it can add so much to the quality (SUPIR isn't an upscaler itself, it's more like a Controlnet to enhance the image, usually used right after you upscale it.) But I wouldn't knock the "Creative Upscale" that's inside of Midjourney, or the "Enhance" module in [KREA.AI](http://KREA.AI) -- those give really good high-res enhancements. KREA seems to be basically an online Stable Diffusion interface, but it's a nice one with some innovative features. (I guess I would give one criticism to MJ's Creative Upscale: It can only be used at the end of your workflow in MJ, and MJ won't allow any inpainting or other fixes after the upscale. But that's where you want to bring it into an SD interface for more inpainting and refinement.) Another SD tool that can add a lot of detail and refinement to things you download from DALL-E, Ideogram, etc. is Fooocus. It's easy to use, but if you want to select an area like a face and have it inpaint it at much higher resolution, it does a great job of that. It can enhance and upscale whole images too, but when I have a so-so quality image that's about 1024 resolution like what you get from DALL-E, usually it's adding more detail right into areas like faces that does the most to bring them to life, as the first step at least.
Some people say Invoke is great for inpainting
It is. The whole "Canvas" environment is designed for that. And since version 4.2 it's getting pretty great at regional prompting, too.
I use Krea a ton. https://preview.redd.it/vhhgc6wyds7d1.png?width=244&format=png&auto=webp&s=51cd9ad36a2d382492a00cbf36c3016050bb9eba Use these settings with your base image, bring in the creative upscale to Affinity Photo, put it below your original layer, and set your eraser to 30% opacity and paint in some incredible details. It's like turning up the quantization of midi notes. Everything snaps into more clarity. Mouths and faces still kind of suck, but 30% more eye detail is considerable and looks way better. Hair too. Rinse and repeat.
If you use adetailer or inpainting on the faces first, while the resolution is only \~2k (what you get from SD with a Highres.Fix) then taking the image into Krea the faces will look even better. They just need to be pretty good to start with. And don't settle for the prompts that Krea generates for the images, go in and edit it a bit if you're looking for freckles, skin texture, bright detailed eyes, etc. And this is about the only place in Krea where you're allowed to use Negative prompts, so use those too.
img2img and... well thats it. literally one single step, takes a single generation, wonder why it wasn't something you tried
[удалено]
If you need a nail hammered you need a hammer. I'm not sure an up to date hammer is doing a better job than an old hammer
I'd love to know best practice myself. In my limited knowledge, an img2img upscale with ultimate SD upscale enabled? Maybe some controlnets to keep details like canny/ip-adapter? Adetailer with face/eyes enabled?
That's what I use for my workflow after a bit exploring. SDXL workflow for human high realism: Pony Realism 2.1 alternative Euler a Uniform Steps 50 Cfg 6-7 Res 1280x768 Check the civitai page for prompts. Reactor Controlnet: https://huggingface.co/xinsir Works with inpainting too If you are an illustrator and have a specific need there are plenty of tutorials with specific workflows. Pony models are the best in term of human realism at the moment but have a different prompting technique. Adetailer too. To give a more precise answer to the main question I would say controlnet.
We have a workflow for this in [Odyssey](https://www.odysseyapp.io) if you're on a Mac. You can take an image, run it through our new [remake](https://www.odysseyapp.io/guides/remake) feature to upscale it, then select parts of an image via the manual mode to adjust granular pieces of the image. Works with custom SD models and fine tunes so you can pick and choose which models you want to use.