Sun-Direction-Lora-Flux2Klein9B

Trigger word: match the sun direction from the reference

LoRA trained to be able to move the sun to a specific elevation and rotation angle relative to the camera.

This lora mainly works for exteriors. If the image is not an exterior, I can't assure it will work correctly as it hasn't been trained with any interior images.

MAKE SURE THE IMAGE YOU ARE TRYING TO CHANGE THE SUN DIRECTION DOESN'T HAVE A CLEAR LIGHT DIRECTION OR MAKE IT OVERCAST FIRST (the workflow takes care of this).

Basically add your OVERCAST image and the ball image as latent reference and you have it!

I am already working in a v2 where this intermediate overcast step is not necessary, and other stuff like light hardness, color, intensity, etc etc

This LoRA uses a ball reference image, so I created a Sphere Render Node to make easier to specify where the light comes from.

If you don't want to use the node, I added the blender scene to render the ball reference images in case you need it.

Download the Sphere Light Render Node from here:

• Sphere-Light-Render-ComfyUI Node

Examples

How to use

The trigger sentence is:

match the sun direction from the reference

Feel free to add any other words needed after the trigger sentence like: "add a clear blue sky" or "keep the cloudy sky"

It works way way better if the image doesn't have a clear light direction, like an overcast day.

If the image you want to add or change the sun direction is already overcast or without a clear light direction you can deactivate the top part of the workflow.

The top part of the workflow generates an overcast image to be ready to apply the sun in bottom part of the workflow.

If you wanna do a timelapse with different light directions, generate the relight images with a fixed seed to avoid some flickering between the images.

Hope you like it, already working on a better v2!

Eric Venti.