Understanding different modes of the Driver

[divyanshk]

Firstly, congrats on the repo!

I am trying better understand the framework. Can you explain a bit more about the different modes "executor", "scheduler", "ray". https://github.com/deepseek-ai/smallpond/blob/main/smallpond/execution/driver.py#L32

I have seen text on "ray" and "scheduler" mode in other places but not sure about the "executor" mode, especially since that is the default option used in the benchmarks.

cc. wangrunji0408
Thanks!

[Roganic]

"Executor" and "Scheduler" might be early versions of the implementation I guess

[wangrunji0408]

This argument is used to determine which component to start ("scheduler" or "executor"). The main script should start with "scheduler", which will then start several executors internally. The "ray" mode was introduced later to run plans on the Ray Core.

It's a bit misleading that "executor" is the default mode. In fact it should be "scheduler".

[divyanshk]

Thanks! @wangrunji0408 Glad my understanding aligns!