LLM-Drop/BAGEL-MoE-7B-GEN-16to8
Text-to-Image • Updated • 39 • 2
Shwai He
shwai-he
AI & ML interests
Deep Learning, Mechine Learning, Natural Language Processing.
Recent Activity
authored a paper 9 days ago
Selective Reflection-Tuning: Student-Selected Data Recycling for LLM
Instruction-Tuning authored a paper 9 days ago
What Matters in Transformers? Not All Attention is Needed authored a paper 9 days ago
Capacity-Aware Inference: Mitigating the Straggler Effect in Mixture of
ExpertsOrganizations
liked 2
models 12 days ago
liked a
dataset 7 months ago
liked a
model about 1 year ago
liked 14
models over 1 year ago
s1ghhh/Mistral-7B-v0.1-Drop4Attn
7B • Updated • 5 • 2
s1ghhh/Llama-2-13b-Drop8Block
13B • Updated • 26 • 2
s1ghhh/Llama-2-13b-Drop4Block
13B • Updated • 4 • 2
s1ghhh/Llama-2-13b-Drop8Attn
13B • Updated • 4 • 2
s1ghhh/Llama-2-13b-Drop4Attn
13B • Updated • 5 • 2
s1ghhh/Llama-2-13b-Drop4MLP
13B • Updated • 4 • 2
s1ghhh/Llama-2-13b-Drop8MLP
13B • Updated • 3 • 2
s1ghhh/Mistral-7B-v0.1-Drop4Block
7B • Updated • 4 • 2
s1ghhh/Mistral-7B-v0.1-Drop8Block
7B • Updated • 3 • 2
s1ghhh/Mistral-7B-v0.1-Drop8Attn
7B • Updated • 4 • 2
s1ghhh/Mistral-7B-v0.1-Drop4MLP
7B • Updated • 2 • 2
s1ghhh/Mistral-7B-v0.1-Drop8MLP
7B • Updated • 3 • 2
s1ghhh/Llama-3-70b-Drop
Text Generation • 71B • Updated • 17 • 4
s1ghhh/Llama-2-70b-Drop
Text Generation • Updated • 3 • 2