LiquidAI/LFM2.5-8B-A1B
Text Generation • 8B • Updated • 56
Kalyan KS PRO
kalyan-ks
AI & ML interests
NLP (LLMs)
Recent Activity
liked a model about 2 hours ago
LiquidAI/LFM2.5-8B-A1B upvoted a changelog about 4 hours ago
Filter Models page by Base Models only liked a model about 7 hours ago
knowledgator/opir-edge-v1.0Organizations
liked a
model about 2 hours ago
upvoted a changelog about 4 hours ago
Hugging Face Changelog
Filter Models page by Base Models only
• 29
liked 2
models about 7 hours ago
upvoted a collection about 7 hours ago
liked a
model 1 day ago
upvoted a collection 2 days ago
posted an update 2 days ago
Post
1563
LLM Guardrail Models are Less Robust Against Text Mutation Attacks
Blog post - https://huggingface.co/blog/kalyan-ks/llm-guardrail-models-less-robust
Evaluated the robustness of three LLM guardrail models (GLiGuard, LlamaGuard3 and MiniGuard).
Evaluation is done using 16 text mutation attacks over three datasets (AEGIS 2.0, WildGuard and ExpGuard).
Achieved average Unsafe ASR score of up to 33% and average Safe ASR score of up to 25% against GLiGuard model.
Achieved average Unsafe ASR score of up to 35% and average Safe ASR score of up to 17% against LlamaGuard3-8B model.
Achieved average Unsafe ASR score of up to 45% and average Safe ASR score of up to 15% against MiniGuard v0.1 model.
Blog post - https://huggingface.co/blog/kalyan-ks/llm-guardrail-models-less-robust
Evaluated the robustness of three LLM guardrail models (GLiGuard, LlamaGuard3 and MiniGuard).
Evaluation is done using 16 text mutation attacks over three datasets (AEGIS 2.0, WildGuard and ExpGuard).
Achieved average Unsafe ASR score of up to 33% and average Safe ASR score of up to 25% against GLiGuard model.
Achieved average Unsafe ASR score of up to 35% and average Safe ASR score of up to 17% against LlamaGuard3-8B model.
Achieved average Unsafe ASR score of up to 45% and average Safe ASR score of up to 15% against MiniGuard v0.1 model.
liked a
dataset 3 days ago
liked a
model 4 days ago
upvoted a collection 4 days ago
liked a
dataset 4 days ago
liked a
Space 5 days ago
upvoted an article 5 days ago
Article
LLM Guardrail Models are Less Robust Against Text Mutation Attacks
kalyan-ks
• • 1 published an article 5 days ago
Article
LLM Guardrail Models are Less Robust Against Text Mutation Attacks
kalyan-ks
• • 1 liked a
model 6 days ago
updated 3
models 6 days ago
liked a
model 7 days ago
