End of training
Browse files
README.md
CHANGED
|
@@ -16,7 +16,7 @@ should probably proofread and complete it, then remove this comment. -->
|
|
| 16 |
|
| 17 |
This model is a fine-tuned version of [deepseek-ai/deepseek-coder-1.3b-base](https://huggingface.co/deepseek-ai/deepseek-coder-1.3b-base) on an unknown dataset.
|
| 18 |
It achieves the following results on the evaluation set:
|
| 19 |
-
- Loss: 0.
|
| 20 |
|
| 21 |
## Model description
|
| 22 |
|
|
@@ -52,65 +52,65 @@ The following hyperparameters were used during training:
|
|
| 52 |
|
| 53 |
| Training Loss | Epoch | Step | Validation Loss |
|
| 54 |
|:-------------:|:-------:|:------:|:---------------:|
|
| 55 |
-
| 0.
|
| 56 |
-
| 0.
|
| 57 |
-
| 0.
|
| 58 |
-
| 0.
|
| 59 |
-
| 0.
|
| 60 |
-
| 0.
|
| 61 |
-
| 0.
|
| 62 |
-
| 0.
|
| 63 |
-
| 0.
|
| 64 |
-
| 0.
|
| 65 |
-
| 0.
|
| 66 |
-
| 0.
|
| 67 |
-
| 0.
|
| 68 |
-
| 0.
|
| 69 |
-
| 0.
|
| 70 |
-
| 0.
|
| 71 |
-
| 0.
|
| 72 |
-
| 0.
|
| 73 |
-
| 0.
|
| 74 |
-
| 0.
|
| 75 |
-
| 0.
|
| 76 |
-
| 0.
|
| 77 |
-
| 0.
|
| 78 |
-
| 0.
|
| 79 |
-
| 0.
|
| 80 |
-
| 0.
|
| 81 |
-
| 0.
|
| 82 |
-
| 0.
|
| 83 |
-
| 0.
|
| 84 |
-
| 0.
|
| 85 |
-
| 0.
|
| 86 |
-
| 0.
|
| 87 |
-
| 0.
|
| 88 |
-
| 0.
|
| 89 |
-
| 0.
|
| 90 |
-
| 0.
|
| 91 |
-
| 0.
|
| 92 |
-
| 0.
|
| 93 |
-
| 0.
|
| 94 |
-
| 0.
|
| 95 |
-
| 0.
|
| 96 |
-
| 0.
|
| 97 |
-
| 0.
|
| 98 |
-
| 0.
|
| 99 |
-
| 0.
|
| 100 |
-
| 0.
|
| 101 |
-
| 0.
|
| 102 |
-
| 0.
|
| 103 |
-
| 0.
|
| 104 |
-
| 0.
|
| 105 |
-
| 0.
|
| 106 |
-
| 0.
|
| 107 |
-
| 0.
|
| 108 |
-
| 0.
|
| 109 |
-
| 0.
|
| 110 |
-
| 0.
|
| 111 |
-
| 0.
|
| 112 |
-
| 0.
|
| 113 |
-
| 0.
|
| 114 |
|
| 115 |
|
| 116 |
### Framework versions
|
|
|
|
| 16 |
|
| 17 |
This model is a fine-tuned version of [deepseek-ai/deepseek-coder-1.3b-base](https://huggingface.co/deepseek-ai/deepseek-coder-1.3b-base) on an unknown dataset.
|
| 18 |
It achieves the following results on the evaluation set:
|
| 19 |
+
- Loss: 0.1733
|
| 20 |
|
| 21 |
## Model description
|
| 22 |
|
|
|
|
| 52 |
|
| 53 |
| Training Loss | Epoch | Step | Validation Loss |
|
| 54 |
|:-------------:|:-------:|:------:|:---------------:|
|
| 55 |
+
| 0.3906 | 0.2000 | 3114 | 0.3862 |
|
| 56 |
+
| 0.3635 | 0.4000 | 6228 | 0.3630 |
|
| 57 |
+
| 0.3503 | 0.6000 | 9342 | 0.3475 |
|
| 58 |
+
| 0.3403 | 0.8001 | 12456 | 0.3313 |
|
| 59 |
+
| 0.3331 | 1.0001 | 15570 | 0.3307 |
|
| 60 |
+
| 0.3239 | 1.2001 | 18684 | 0.3182 |
|
| 61 |
+
| 0.3155 | 1.4001 | 21798 | 0.3090 |
|
| 62 |
+
| 0.3143 | 1.6001 | 24912 | 0.3098 |
|
| 63 |
+
| 0.3114 | 1.8001 | 28026 | 0.3078 |
|
| 64 |
+
| 0.305 | 2.0001 | 31140 | 0.3037 |
|
| 65 |
+
| 0.2934 | 2.2001 | 34254 | 0.2976 |
|
| 66 |
+
| 0.2983 | 2.4002 | 37368 | 0.2936 |
|
| 67 |
+
| 0.295 | 2.6002 | 40482 | 0.2963 |
|
| 68 |
+
| 0.2932 | 2.8002 | 43596 | 0.2853 |
|
| 69 |
+
| 0.2866 | 3.0002 | 46710 | 0.2792 |
|
| 70 |
+
| 0.2784 | 3.2002 | 49824 | 0.2809 |
|
| 71 |
+
| 0.276 | 3.4002 | 52938 | 0.2756 |
|
| 72 |
+
| 0.2727 | 3.6002 | 56052 | 0.2685 |
|
| 73 |
+
| 0.2704 | 3.8002 | 59166 | 0.2710 |
|
| 74 |
+
| 0.2711 | 4.0003 | 62280 | 0.2679 |
|
| 75 |
+
| 0.2601 | 4.2003 | 65394 | 0.2656 |
|
| 76 |
+
| 0.2574 | 4.4003 | 68508 | 0.2620 |
|
| 77 |
+
| 0.255 | 4.6003 | 71622 | 0.2549 |
|
| 78 |
+
| 0.2555 | 4.8003 | 74736 | 0.2529 |
|
| 79 |
+
| 0.2546 | 5.0003 | 77850 | 0.2499 |
|
| 80 |
+
| 0.2437 | 5.2003 | 80964 | 0.2487 |
|
| 81 |
+
| 0.2457 | 5.4003 | 84078 | 0.2448 |
|
| 82 |
+
| 0.2424 | 5.6004 | 87192 | 0.2412 |
|
| 83 |
+
| 0.236 | 5.8004 | 90306 | 0.2394 |
|
| 84 |
+
| 0.2378 | 6.0004 | 93420 | 0.2389 |
|
| 85 |
+
| 0.2286 | 6.2004 | 96534 | 0.2352 |
|
| 86 |
+
| 0.2288 | 6.4004 | 99648 | 0.2333 |
|
| 87 |
+
| 0.2276 | 6.6004 | 102762 | 0.2304 |
|
| 88 |
+
| 0.2233 | 6.8004 | 105876 | 0.2292 |
|
| 89 |
+
| 0.2247 | 7.0004 | 108990 | 0.2242 |
|
| 90 |
+
| 0.212 | 7.2005 | 112104 | 0.2226 |
|
| 91 |
+
| 0.2091 | 7.4005 | 115218 | 0.2231 |
|
| 92 |
+
| 0.2113 | 7.6005 | 118332 | 0.2188 |
|
| 93 |
+
| 0.2086 | 7.8005 | 121446 | 0.2154 |
|
| 94 |
+
| 0.2045 | 8.0005 | 124560 | 0.2106 |
|
| 95 |
+
| 0.1936 | 8.2005 | 127674 | 0.2120 |
|
| 96 |
+
| 0.1942 | 8.4005 | 130788 | 0.2052 |
|
| 97 |
+
| 0.194 | 8.6006 | 133902 | 0.2028 |
|
| 98 |
+
| 0.1971 | 8.8006 | 137016 | 0.2020 |
|
| 99 |
+
| 0.1878 | 9.0006 | 140130 | 0.1978 |
|
| 100 |
+
| 0.1787 | 9.2006 | 143244 | 0.1972 |
|
| 101 |
+
| 0.1788 | 9.4006 | 146358 | 0.1962 |
|
| 102 |
+
| 0.1768 | 9.6006 | 149472 | 0.1920 |
|
| 103 |
+
| 0.1741 | 9.8006 | 152586 | 0.1893 |
|
| 104 |
+
| 0.172 | 10.0006 | 155700 | 0.1889 |
|
| 105 |
+
| 0.1624 | 10.2007 | 158814 | 0.1881 |
|
| 106 |
+
| 0.1624 | 10.4007 | 161928 | 0.1874 |
|
| 107 |
+
| 0.1603 | 10.6007 | 165042 | 0.1828 |
|
| 108 |
+
| 0.1578 | 10.8007 | 168156 | 0.1791 |
|
| 109 |
+
| 0.1547 | 11.0007 | 171270 | 0.1796 |
|
| 110 |
+
| 0.1482 | 11.2007 | 174384 | 0.1781 |
|
| 111 |
+
| 0.1462 | 11.4007 | 177498 | 0.1764 |
|
| 112 |
+
| 0.1404 | 11.6007 | 180612 | 0.1747 |
|
| 113 |
+
| 0.1436 | 11.8008 | 183726 | 0.1733 |
|
| 114 |
|
| 115 |
|
| 116 |
### Framework versions
|