I will list out the ones we have tried and know will work.
I am spliting the list into ControlNets for 1.5 and SDXL models
1.5
control_v11p_sd15_normalbae https://civitai.com/models/38784?modelVersionId=44774
control_v11p_sd15_scribble https://civitai.com/models/38784?modelVersionId=44787
control_v11p_sd15_depth https://civitai.com/models/38784?modelVersionId=44736
control_v11p_sd15_canny https://civitai.com/models/38784?modelVersionId=44716
control_v11p_sd15_lineart https://civitai.com/models/38784?modelVersionId=44877
control_v11p_sd15s2_lineart_anime https://civitai.com/models/38784?modelVersionId=44879
SDXL
lllyasviel sd_control_collection https://huggingface.co/lllyasviel/sd_control_collection/tree/main *Not All models tested
Canny https://civitai.com/models/136070?modelVersionId=152216
Canny Small https://civitai.com/models/136070?modelVersionId=152152
Canny Mid https://civitai.com/models/136070?modelVersionId=152069
Canny Full https://civitai.com/models/136070?modelVersionId=151227
Depth https://civitai.com/models/136070?modelVersionId=152324
Depth Small https://civitai.com/models/136070?modelVersionId=152189
Depth Mid https://civitai.com/models/136070?modelVersionId=152091
Depth Full https://civitai.com/models/136070?modelVersionId=151823