How would I go about adding another model to the benchmarks?

[Eyal Cidon (ecidon)]

If for example I would want to add a Llama model what would I need to do?

[Yifan Xiong (abuccts)]

Hi Eyal Cidon (@ecidon), you may add the model in model_benchmarks by adding a class and registering it, or add it in docker_benchmarks by providing a docker image and entrypoint script. Here're the example PRs on model benchmark and docker benchmark for your reference.