📢 Who want's to have a quick start for adapting CoT schema for any LLM, this post would be relevant.
text
📢 Who want's to have a quick start for adapting CoT schema for any LLM, this post would be relevant.
new_line
new_line
 Excited to share a new version of 🌟 bulk-chain 🌟!
text
 Excited to share a new version of 🌟 bulk-chain 🌟!
new_line
Bulk-chain is high-level wrapper over LLM providers for efficient quering LLMs hosted by third-party services. 
text
Bulk-chain is high-level wrapper over LLM providers for efficient quering LLMs hosted by third-party services. 
new_line
It brings native batching via support of async clients.
text
It brings native batching via support of async clients.
new_line
new_line
🌟 
text
🌟 
https://github.com/nicolay-r/bulk-chain/tree/master
https://github.com/nicolay-r/bulk-chain/tree/master
link
new_line
new_line
What's new:
text
What's new:
new_line
☑️ Simplified inference setup
text
☑️ Simplified inference setup
new_line
 The API is now closer to the OpenAI paradigm for toggling streaming.
text
 The API is now closer to the OpenAI paradigm for toggling streaming.
new_line
 Instead of separate patterns in 1.2.0, now it is possible to simple toggles to enable streaming and async behavior.
text
 Instead of separate patterns in 1.2.0, now it is possible to simple toggles to enable streaming and async behavior.
new_line
☑️ 🛠️  Fixed issues when passing code contain {} blocks
text
☑️ 🛠️  Fixed issues when passing code contain {} blocks
new_line
☑️ 🛠️ Async streaming + batching now works properly
text
☑️ 🛠️ Async streaming + batching now works properly
new_line
☑️ 🛠️ Logging of prompts could be disabled
text
☑️ 🛠️ Logging of prompts could be disabled
new_line
new_line
https://github.com/nicolay-r/bulk-chain
https://github.com/nicolay-r/bulk-chain
link
new_line
new_line
🚨 Guys, I am open to work as developer / researcher in AI / NLP / IR in the UK 🇬🇧
text
🚨 Guys, I am open to work as developer / researcher in AI / NLP / IR in the UK 🇬🇧
new_line
new_line
🌟   Feel free to support bulk-chain on Github if you like so, or this post. 
text
🌟   Feel free to support bulk-chain on Github if you like so, or this post. 
new_line
         It helps alot!
text
         It helps alot!
📢 Who want's to have a quick start for adapting CoT schema for any LLM, this post would be relevant.

 Excited to share a new version of 🌟 bulk-chain 🌟!
Bulk-chain is high-level wrapper over LLM providers for efficient quering LLMs hosted by third-party services. 
It brings native batching via support of async clients.

🌟 https://github.com/nicolay-r/bulk-chain/tree/master

What's new:
☑️ Simplified inference setup
 The API is now closer to the OpenAI paradigm for toggling streaming.
 Instead of separate patterns in 1.2.0, now it is possible to simple toggles to enable streaming and async behavior.
☑️ 🛠️  Fixed issues when passing code contain {} blocks
☑️ 🛠️ Async streaming + batching now works properly
☑️ 🛠️ Logging of prompts could be disabled

https://github.com/nicolay-r/bulk-chain

🚨 Guys, I am open to work as developer / researcher in AI / NLP / IR in the UK 🇬🇧

🌟   Feel free to support bulk-chain on Github if you like so, or this post. 
         It helps alot!
🔥
unmodeled-tyler John6666 Reality123b