📢 Impressed with the application of the microsoft/Phi-3-mini-4k-instruct (3B) performance in zero-shot-learning (ZSL) mode reasoning 🧠 on Target Sentiment Analysis (TSA) problem. 
text
📢 Impressed with the application of the microsoft/Phi-3-mini-4k-instruct (3B) performance in zero-shot-learning (ZSL) mode reasoning 🧠 on Target Sentiment Analysis (TSA) problem. 
new_line
💡 There are three major takeaways  out of this experiment 🧪 and they are as follows:
text
💡 There are three major takeaways  out of this experiment 🧪 and they are as follows:
new_line
✅ 1. Phi-3 slightly outperforms Mistral-7B (official Mistral API, v0.1 or v0.2) on texts written in English
text
✅ 1. Phi-3 slightly outperforms Mistral-7B (official Mistral API, v0.1 or v0.2) on texts written in English
new_line
✅ 2. Performs similar to LLaMA-3-8B-Instruct on texts translated in English 🔥 
text
✅ 2. Performs similar to LLaMA-3-8B-Instruct on texts translated in English 🔥 
new_line
☑️ 3. Reasoning in non-english language (🇷🇺) is pretty decent but underperforms to the similar 7B sized models.
text
☑️ 3. Reasoning in non-english language (🇷🇺) is pretty decent but underperforms to the similar 7B sized models.
new_line
new_line
This is a huge step forward since release of Phi-2, especially because the predecessor (microsoft/phi-2) was not capable for performing reasoning in non-english texts (🇷🇺) at all!
text
This is a huge step forward since release of Phi-2, especially because the predecessor (microsoft/phi-2) was not capable for performing reasoning in non-english texts (🇷🇺) at all!
new_line
new_line
Benchmark: 
text
Benchmark: 
https://github.com/nicolay-r/RuSentNE-LLM-Benchmark
https://github.com/nicolay-r/RuSentNE-LLM-Benchmark
link
new_line
Model: 
text
Model: 
https://huggingface.co/microsoft/Phi-3-mini-4k-instruct
microsoft/Phi-3-mini-4k-instruct
model
resource
https://huggingface.co/microsoft/Phi-3-mini-4k-instruct
new_line
Dataset: 
text
Dataset: 
https://github.com/dialogue-evaluation/RuSentNE-evaluation
https://github.com/dialogue-evaluation/RuSentNE-evaluation
link
new_line
Related paper: Large Language Models in Targeted Sentiment Analysis (2404.12342)
text
Related paper: Large Language Models in Targeted Sentiment Analysis (2404.12342)
new_line
Collection: 
text
Collection: 
https://huggingface.co/collections/nicolay-r/sentiment-analysis-665ba391e0eba729021ea101
https://huggingface.co/collections/nicolay-r/sentiment-analysis-665ba391e0eba729021ea101
link
new_line
📢 Impressed with the application of the microsoft/Phi-3-mini-4k-instruct (3B) performance in zero-shot-learning (ZSL) mode reasoning 🧠 on Target Sentiment Analysis (TSA) problem. 
💡 There are three major takeaways  out of this experiment 🧪 and they are as follows:
✅ 1. Phi-3 slightly outperforms Mistral-7B (official Mistral API, v0.1 or v0.2) on texts written in English
✅ 2. Performs similar to LLaMA-3-8B-Instruct on texts translated in English 🔥 
☑️ 3. Reasoning in non-english language (🇷🇺) is pretty decent but underperforms to the similar 7B sized models.

This is a huge step forward since release of Phi-2, especially because the predecessor (microsoft/phi-2) was not capable for performing reasoning in non-english texts (🇷🇺) at all!

Benchmark: https://github.com/nicolay-r/RuSentNE-LLM-Benchmark
Model: https://huggingface.co/microsoft/Phi-3-mini-4k-instruct
Dataset: https://github.com/dialogue-evaluation/RuSentNE-evaluation
Related paper: Large Language Models in Targeted Sentiment Analysis (2404.12342)
Collection: https://huggingface.co/collections/nicolay-r/sentiment-analysis-665ba391e0eba729021ea101

🔥
victor Taylor658 ithonestman kristaller486 adamm-hf hiauiarau
👀
osanseviero ithonestman adamm-hf
65f5dc345f9b537bfb125988
/avatars/7fa9de162694d34a214ccd8ecb02fa0a.svg
Sergey Zubrilin
hiauiarau
user
64e62d11d27a8292c3637f86
https://cdn-avatars.huggingface.co/v1/production/uploads/64e62d11d27a8292c3637f86/aptDeBHpCJxcREj6KPLN1.jpeg
Nicolay Rusnachenko
nicolay-r
user