Here are the original, full weights for the DPO model.
You can use it to fix or improve your own models.
The method is simple: (This DPO model - SDXL) + Your Model.
I've been getting really good results with this. For me, it often works better than CyberFix.
HF original (Unet only): https://huggingface.co/mhdang/dpo-sdxl-text2image-v1