Inference Optimization

community

AI & ML interests

None defined yet.

Recent Activity

kylesayrs updated a model about 8 hours ago

inference-optimization/Meta-Llama-3-8B-Instruct-W4A16_actorder_group

kylesayrs published a model about 8 hours ago

inference-optimization/Meta-Llama-3-8B-Instruct-W4A16_actorder_group

dsikka updated a dataset 2 days ago

inference-optimization/Qwen3-8b-sharegpt-5k

View all activity

inference-optimization 's models 231

inference-optimization/Llama-3.2-1B-Instruct_5_bits_mode_noise

1B • Updated Mar 12 • 9

inference-optimization/Llama-3.2-1B-Instruct_5_bits_mode_hybrid

1B • Updated Mar 12 • 9

inference-optimization/Llama-3.2-1B-Instruct_7_bits_mode_heuristic

1B • Updated Mar 12 • 12

inference-optimization/Llama-3.2-1B-Instruct_7_bits_mode_hybrid

1B • Updated Mar 12 • 11

inference-optimization/Llama-3.2-1B-Instruct_6.5_bits_mode_heuristic

1B • Updated Mar 12 • 16

inference-optimization/Llama-3.2-1B-Instruct_6_bits_mode_heuristic

1B • Updated Mar 12 • 13

inference-optimization/Qwen3-8B_7_bits_mode_heuristic

7B • Updated Mar 12 • 11

inference-optimization/Qwen3-8B_7_bits_mode_noise

7B • Updated Mar 12 • 11

inference-optimization/Qwen3-8B_7_bits_mode_hybrid

7B • Updated Mar 12 • 11

inference-optimization/Qwen3-8B_6.5_bits_mode_heuristic

7B • Updated Mar 12 • 13

inference-optimization/Qwen3-8B_6.5_bits_mode_noise

7B • Updated Mar 12 • 11

inference-optimization/Qwen3-8B_6.5_bits_mode_hybrid

7B • Updated Mar 12 • 14

inference-optimization/Qwen3-8B_6_bits_mode_heuristic

7B • Updated Mar 12 • 12

inference-optimization/Qwen3-8B_6_bits_mode_noise

7B • Updated Mar 12 • 16

inference-optimization/Qwen3-8B_6_bits_mode_hybrid

7B • Updated Mar 12 • 12

inference-optimization/Qwen3-8B_5.5_bits_mode_heuristic

6B • Updated Mar 12 • 11

inference-optimization/Qwen3-8B_5.5_bits_mode_noise

6B • Updated Mar 12 • 13

inference-optimization/Qwen3-8B_5.5_bits_mode_hybrid

6B • Updated Mar 12 • 12

inference-optimization/Qwen3-8B_5_bits_mode_heuristic

6B • Updated Mar 12 • 11

inference-optimization/Qwen3-8B_5_bits_mode_noise

6B • Updated Mar 12 • 13

inference-optimization/Qwen3-8B_5_bits_mode_hybrid

6B • Updated Mar 12 • 12

inference-optimization/Llama-3.1-8B-Instruct_7_bits_mode_heuristic

7B • Updated Mar 12 • 8

inference-optimization/Llama-3.1-8B-Instruct_7_bits_mode_noise

7B • Updated Mar 12 • 7

inference-optimization/Llama-3.1-8B-Instruct_7_bits_mode_hybrid

7B • Updated Mar 12 • 10

inference-optimization/Llama-3.1-8B-Instruct_6.5_bits_mode_heuristic

7B • Updated Mar 12 • 15

inference-optimization/Llama-3.1-8B-Instruct_6.5_bits_mode_noise

7B • Updated Mar 12 • 8

inference-optimization/Llama-3.1-8B-Instruct_6.5_bits_mode_hybrid

7B • Updated Mar 12 • 6

inference-optimization/Llama-3.1-8B-Instruct_6_bits_mode_heuristic

6B • Updated Mar 12 • 7

inference-optimization/Llama-3.1-8B-Instruct_6_bits_mode_noise

6B • Updated Mar 12 • 10

inference-optimization/Llama-3.1-8B-Instruct_6_bits_mode_hybrid

6B • Updated Mar 12 • 9