machineai-compiler-optimizer / project_roadmap.md
sosonsong's picture
Upload folder using huggingface_hub
87b4df2 verified

ํ”„๋กœ์ ํŠธ ๋กœ๋“œ๋งต: AI ์ปดํŒŒ์ผ๋Ÿฌ ์ตœ์ ํ™”

์ตœ์ข… ๋ชฉํ‘œ

๊ฐ•ํ™”ํ•™์Šต(RL) AI๊ฐ€ C ์ฝ”๋“œ๋ฅผ ์ž๋™์œผ๋กœ ์ตœ์ ํ™”ํ•˜์—ฌ ์ˆœ์ˆ˜ -O1 ๋Œ€๋น„ ํ‰๊ท  +90% ์ด์ƒ ์†๋„ ํ–ฅ์ƒ์„ ๋‹ฌ์„ฑํ•˜๋Š” ๊ฒƒ (์ดˆ๊ธฐ ๋ชฉํ‘œ +10% โ†’ +51.9% ๋‹ฌ์„ฑ โ†’ ๊ณ„์† ์ƒํ–ฅ ์ค‘)

์™„๋ฃŒ๋œ ๋‹จ๊ณ„

  • [์™„๋ฃŒ] 1๋‹จ๊ณ„: ํ™˜๊ฒฝ ๊ตฌ์ถ• (clang 18.1.3, llvm, Python ํŒจํ‚ค์ง€)
  • [์™„๋ฃŒ] 2๋‹จ๊ณ„: IR ํŠน์ง• ์ถ”์ถœ๊ธฐ ๊ตฌํ˜„ (7์ฐจ์› ๋ฒกํ„ฐ, call ๊ฐ์ง€ ๋ฒ„๊ทธ ์ˆ˜์ •)
  • [์™„๋ฃŒ] 3๋‹จ๊ณ„: ๊ฐ•ํ™”ํ•™์Šต ํ™˜๊ฒฝ ๊ตฌํ˜„ (LoopUnrollEnv, action 6๊ฐœ)
  • [์™„๋ฃŒ] 4๋‹จ๊ณ„: x86-64 ํ•™์Šต ์™„์„ฑ
    • PPO 20,000์Šคํ… ํ•™์Šต ์™„๋ฃŒ
    • avg +51.9% (๋ชฉํ‘œ 5๋ฐฐ ์ดˆ๊ณผ)
    • loop_heavy +74.1% / nested +69.4% / matmul +60.7% / call_heavy +3.6%
    • ์ €์žฅ ๋ชจ๋ธ: models/x86v2_base.zip
  • [์™„๋ฃŒ] 5๋‹จ๊ณ„: ARM64 ์ „์ดํ•™์Šต
    • x86โ†’ARM64 ์ „์ด, 2,000์Šคํ…๋งŒ์— +47.2%
    • ์Šคํ… 90% ์ ˆ๊ฐ ๊ฒ€์ฆ ์™„๋ฃŒ
    • ์ €์žฅ ๋ชจ๋ธ: models/arm64_transfer.zip
  • [์™„๋ฃŒ] 6๋‹จ๊ณ„: ๋ฉ”ํƒ€ํ•™์Šต (Reptile ๊ธฐ๋ฐ˜)
    • 100์Šคํ…๋งŒ์— ARM64 +45.0% ๋‹ฌ์„ฑ
    • ์›๋ณธ ๋Œ€๋น„ ์Šคํ… 99.5% ์ ˆ๊ฐ
    • ์ €์žฅ ๋ชจ๋ธ: models/meta_init.zip
  • [์™„๋ฃŒ] 7๋‹จ๊ณ„: HuggingFace ๊ณต๊ฐœ ๋ฐฐํฌ

์ง„ํ–‰ ์˜ˆ์ • ๋‹จ๊ณ„

  • [์˜ˆ์ •] 8๋‹จ๊ณ„: ๋” ๋งŽ์€ ์ตœ์ ํ™” ์•ก์…˜ ์ถ”๊ฐ€
    • ๋ฒกํ„ฐํ™”(SIMD), ์ธ๋ผ์ธ ํ™•์žฅ, ๋ฉ”๋ชจ๋ฆฌ ์ ‘๊ทผ ํŒจํ„ด ์ตœ์ ํ™”
    • ๋ชฉํ‘œ: avg +70% ์ด์ƒ
  • [์˜ˆ์ •] 9๋‹จ๊ณ„: call_heavy ๋ฌธ์ œ ํ•ด๊ฒฐ
    • ํ˜„์žฌ +1~3% โ†’ ๋ชฉํ‘œ +30% ์ด์ƒ
    • IR ํŠน์ง• ํ™•์žฅ + ์ธ๋ผ์ธ ์•ก์…˜ ์ถ”๊ฐ€
  • [์˜ˆ์ •] 10๋‹จ๊ณ„: ์‹ค์ œ ARM ํ•˜๋“œ์›จ์–ด ๊ฒ€์ฆ
    • ๋ผ์ฆˆ๋ฒ ๋ฆฌ ํŒŒ์ด 5 ๋˜๋Š” ํด๋ผ์šฐ๋“œ ARM64 ์ธ์Šคํ„ด์Šค
    • QEMU ๋Œ€๋น„ 10๋ฐฐ ๋น ๋ฅธ ํ•™์Šต ํ™˜๊ฒฝ
  • [์˜ˆ์ •] 11๋‹จ๊ณ„: ๋ถ„์‚ฐ ์—ฐํ•ฉํ•™์Šต (Federated Learning)
    • ์—ฌ๋Ÿฌ ๋จธ์‹ ์ด ๊ฐ€์ค‘์น˜ ๊ณต์œ  (Flower ํ”„๋ ˆ์ž„์›Œํฌ)
    • HuggingFace ๊ธฐ๋ฐ˜ ์ปค๋ฎค๋‹ˆํ‹ฐ ๊ธฐ์—ฌ ๊ตฌ์กฐ
  • [์˜ˆ์ •] 12๋‹จ๊ณ„: LLM + RL ํ•˜์ด๋ธŒ๋ฆฌ๋“œ
    • LLM์ด ์ฝ”๋“œ ๊ตฌ์กฐ ์ดํ•ด โ†’ RL์ด ์‹คํ–‰ ์†๋„๋กœ ๋ณด์ƒ
    • ๋ชฉํ‘œ: avg +80% ์ด์ƒ
  • [์˜ˆ์ •] 13๋‹จ๊ณ„: ๋„๋ฉ”์ธ ํŠนํ™” ๋ฒ„์ „
    • ๋”ฅ๋Ÿฌ๋‹ ์ถ”๋ก  / ๊ฒŒ์ž„ ์—”์ง„ / ์ž„๋ฒ ๋””๋“œ ํŠนํ™”
  • [์˜ˆ์ •] 14๋‹จ๊ณ„: ํ”„๋กœ๋•์…˜ ์ปดํŒŒ์ผ๋Ÿฌ ํ†ตํ•ฉ
    • LLVM ํ”Œ๋Ÿฌ๊ทธ์ธ ํ†ตํ•ฉ
    • pip ํŒจํ‚ค์ง€ ๋ฐฐํฌ
    • ๋ชฉํ‘œ: avg +90% ์ด์ƒ (๊ตฌ๊ธ€ MLGO ์ˆ˜์ค€)

ํ”„๋กœ์ ํŠธ ๊ตฌ์กฐ

Claude ์ง„ํ–‰ ๋ฐฉ์‹ (์ค‘์š”)

  • ๋ฐ˜๋“œ์‹œ ํ•œ ๋ฒˆ์— ํ•˜๋‚˜์˜ STEP๋งŒ ์•ˆ๋‚ดํ•  ๊ฒƒ
  • ๊ฐ STEP ์™„๋ฃŒ ํ›„ ๋ฐ˜๋“œ์‹œ ๊ฒฐ๊ณผ ํ™•์ธ ํ›„ ๋‹ค์Œ์œผ๋กœ ๋„˜์–ด๊ฐˆ ๊ฒƒ
  • ์—๋Ÿฌ ๋ฐœ์ƒ์‹œ ์›์ธ ์„ค๋ช… ํ›„ ์ˆ˜์ • ๋ฐฉ๋ฒ•์„ ๋‹จ๊ณ„๋ณ„๋กœ ์•ˆ๋‚ดํ•  ๊ฒƒ
  • ์ฝ”๋“œ๋Š” ๋ณต์‚ฌ-๋ถ™์—ฌ๋„ฃ๊ธฐ๋กœ ๋ฐ”๋กœ ์‚ฌ์šฉ ๊ฐ€๋Šฅํ•˜๊ฒŒ ์ œ๊ณตํ•  ๊ฒƒ
  • ๊ฐ STEP ๋์— ๋ฐ˜๋“œ์‹œ "๊ฒฐ๊ณผ ๋ถ™์—ฌ๋„ฃ์–ด ์ฃผ์„ธ์š”! โœ‹" ๋กœ ๋งˆ๋ฌด๋ฆฌํ•  ๊ฒƒ

์•ˆ์ „ ๊ทœ์น™ (์ค‘์š”)

  • ํ•ต์‹ฌ ํŒŒ์ผ ์ˆ˜์ • ํ›„ ๋ฐ˜๋“œ์‹œ python3 benchmark.py ๋กœ ๊ฒ€์ฆํ•  ๊ฒƒ
  • avg +52.7% ์ด์ƒ์ด๋ฉด git commit, ๋ฏธ๋งŒ์ด๋ฉด git checkout . ๋กœ ๋ณต๊ตฌ
  • Git ์ปค๋ฐ‹: git commit -am "์„ค๋ช…"
  • Git ๋ณต๊ตฌ: git checkout .