If it’s a decent model and I can access it through an API (even just a MacOS native API) and it benefits from a high performance implementation that Apple can likely provide, I wouldn’t mind this at all. I’m currently using up much more space on various local GGUFs in a never ending search for the most capable local model.
If it’s a decent model and I can access it through an API (even just a MacOS native API) and it benefits from a high performance implementation that Apple can likely provide, I wouldn’t mind this at all. I’m currently using up much more space on various local GGUFs in a never ending search for the most capable local model.