Update README

.gitattributes

@@ -1,3 +1,5 @@
+*.png filter=lfs diff=lfs merge=lfs -text
+*.jpg filter=lfs diff=lfs merge=lfs -text
 *.7z filter=lfs diff=lfs merge=lfs -text
 *.arrow filter=lfs diff=lfs merge=lfs -text
 *.bin filter=lfs diff=lfs merge=lfs -text

README.md

@@ -3,22 +3,35 @@ license: apache-2.0
 library_name: videox_fun
 ---
 
-# Z-Image-Turbo-Fun-Controlnet-Union
+# Z-Image-Turbo-Fun-Controlnet-Union-2.0
 
-[![Github](https://img.shields.io/badge/🎬%20Code-Github-blue)](https://github.com/aigc-apps/VideoX-Fun)
+[![Github](https://img.shields.io/badge/🎬%20Code-VideoX_Fun-blue)](https://github.com/aigc-apps/VideoX-Fun)
 
 ## Model Features
-- This ControlNet is added on 6 blocks.
-- The model was trained from scratch for 10,000 steps on a dataset of 1 million high-quality images covering both general and human-centric content. Training was performed at 1328 resolution using BFloat16 precision, with a batch size of 64, a learning rate of 2e-5, and a text dropout ratio of 0.10.
+- This ControlNet is added on 15 layer blocks and 2 refiner layer blocks.
+- The model was trained from scratch for 70,000 steps on a dataset of 1 million high-quality images covering both general and human-centric content. Training was performed at 1328 resolution using BFloat16 precision, with a batch size of 64, a learning rate of 2e-5, and a text dropout ratio of 0.10.
 - It supports multiple control conditions—including Canny, HED, Depth, Pose and MLSD can be used like a standard ControlNet.
-- You can adjust control_context_scale for stronger control and better detail preservation. For better stability, we highly recommend using a detailed prompt. The optimal range for control_context_scale is from 0.65 to 0.80.
+- We found that under different strength levels, using different step numbers has a certain impact on the realism and clarity of the results. For strength and step testing, please refer to [Scale Test Results](#scale-test-results). 
+- You can adjust control_context_scale for stronger control and better detail preservation. For better stability, we highly recommend using a detailed prompt. The optimal range for control_context_scale is from 0.65 to 0.90. 
+  - **Note on Steps: As you increase the control strength (higher control_context_scale values), it's recommended to appropriately increase the number of inference steps to achieve better results and maintain generation quality. This is likely because the control model has not been distilled.**
+- Inpainting mode is also supported.
 
 ## TODO 
-- [ ] Train on more data and for more steps.
-- [ ] Support inpaint mode.
+- [ ] Train on better data.
 
 ## Results
 
+<table border="0" style="width: 100%; text-align: left; margin-top: 20px;">
+  <tr>
+    <td>Pose + Inpaint</td>
+    <td>Output</td>
+  </tr>
+  <tr>
+    <td><img src="asset/inpaint.jpg" width="100%" /><img src="asset/mask.jpg" width="100%" /></td>
+    <td><img src="results/pose_inpaint.png" width="100%" /></td>
+  </tr>
+</table>
+
 <table border="0" style="width: 100%; text-align: left; margin-top: 20px;">
   <tr>
     <td>Pose</td>
@@ -98,7 +111,24 @@ Then download the weights into models/Diffusion_Transformer and models/Personali
 ├── 📂 Diffusion_Transformer/
 │   └── 📂 Z-Image-Turbo/
 ├── 📂 Personalized_Model/
-│   └── 📦 Z-Image-Turbo-Fun-Controlnet-Union.safetensors
+│   └── 📦 Z-Image-Turbo-Fun-Controlnet-Union-2.0.safetensors
 ```
 
-Then run the file `examples/z_image_fun/predict_t2i_control.py`.
+Then run the file `examples/z_image_fun/predict_t2i_control_2.0.py` and `examples/z_image_fun/predict_i2i_inpaint_2.0.py`.
+
+## Scale Test Results
+
+The table below shows the generation results under different combinations of Diffusion steps and Control Scale strength:
+
+| Diffusion Steps | Scale 0.65 | Scale 0.70 | Scale 0.75 | Scale 0.8 | Scale 0.9 | Scale 1.0 |
+|:---------------:|:----------:|:----------:|:----------:|:---------:|:---------:|:---------:|
+| **9** | ![](results/scale_test/9_scale_0.65.png) | ![](results/scale_test/9_scale_0.70.png) | ![](results/scale_test/9_scale_0.75.png) | ![](results/scale_test/9_scale_0.8.png) | ![](results/scale_test/9_scale_0.9.png) | ![](results/scale_test/9_scale_1.0.png) |
+| **10** | ![](results/scale_test/10_scale_0.65.png) | ![](results/scale_test/10_scale_0.70.png) | ![](results/scale_test/10_scale_0.75.png) | ![](results/scale_test/10_scale_0.8.png) | ![](results/scale_test/10_scale_0.9.png) | ![](results/scale_test/10_scale_1.0.png) |
+| **20** | ![](results/scale_test/20_scale_0.65.png) | ![](results/scale_test/20_scale_0.70.png) | ![](results/scale_test/20_scale_0.75.png) | ![](results/scale_test/20_scale_0.8.png) | ![](results/scale_test/20_scale_0.9.png) | ![](results/scale_test/20_scale_1.0.png) |
+| **30** | ![](results/scale_test/30_scale_0.65.png) | ![](results/scale_test/30_scale_0.70.png) | ![](results/scale_test/30_scale_0.75.png) | ![](results/scale_test/30_scale_0.8.png) | ![](results/scale_test/30_scale_0.9.png) | ![](results/scale_test/30_scale_1.0.png) |
+| **40** | ![](results/scale_test/40_scale_0.65.png) | ![](results/scale_test/40_scale_0.70.png) | ![](results/scale_test/40_scale_0.75.png) | ![](results/scale_test/40_scale_0.8.png) | ![](results/scale_test/40_scale_0.9.png) | ![](results/scale_test/40_scale_1.0.png) |
+
+Parameter Description:
+
+Diffusion Steps: Number of iteration steps for the diffusion model (9, 10, 20, 30, 40)
+Control Scale: Control strength coefficient (0.65 - 1.0)