Живі запити до моделей

оновлюється кожні 5 с · рушій зараз: llama.cpp (qwen2.5-coder-32b)
запитів / год110
успішних110
токенів / год4621
сер. швидкість4.8 t/s
часмодельрушійкодсекt/sтокенів
22:10:01qwen2.5-coder-32bllamacpp20014.226.897
22:09:40qwen2.5-coder-32bllamacpp20010.884.347
22:09:29qwen2.5-coder-32bllamacpp2008.332.420
22:09:20qwen2.5-coder-32bllamacpp2004.161.04
22:09:16qwen2.5-coder-32bllamacpp2009.695.048
22:09:05qwen2.5-coder-32bllamacpp20016.057.7124
22:08:49qwen2.5-coder-32bllamacpp20022.447.2162
22:08:26qwen2.5-coder-32bllamacpp2005.331.910
22:08:21qwen2.5-coder-32bllamacpp2008.683.329
22:08:12qwen2.5-coder-32bllamacpp2006.972.316
22:08:05qwen2.5-coder-32bllamacpp2009.465.451
22:07:55qwen2.5-coder-32bllamacpp2000.636.44
22:07:54qwen2.5-coder-32bllamacpp2002.351.74
22:07:52qwen2.5-coder-32bllamacpp2004.770.84
22:07:47qwen2.5-coder-32bllamacpp2004.790.84
22:07:42qwen2.5-coder-32bllamacpp2006.313.623
22:07:35qwen2.5-coder-32bllamacpp2006.387.749
22:07:28qwen2.5-coder-32bllamacpp2006.027.646
22:07:22qwen2.5-coder-32bllamacpp20012.587.797
21:58:57qwen2.5-coder-32bllamacpp2006.587.549
21:58:51qwen2.5-coder-32bllamacpp2002.537.118
21:58:48qwen2.5-coder-32bllamacpp2000.894.54
21:58:47qwen2.5-coder-32bllamacpp2006.567.348
21:58:40qwen2.5-coder-32bllamacpp20016.077.7124
21:58:24qwen2.5-coder-32bllamacpp20020.837.8162