Please suggest ideal free LLMs available for download from Hugging Face that are suitable for use in a Privacy AI Keyboard. I need two models: a general default model with tool-calling capabilities and a model specifically for AI instructions. I am using an iPhone 15 Pro Max, so please recommend the most capable GGUF or MLX models that will perform well on this device. Include direct links to download the recommended models, as well as the precise metadata, quantization, and specifications for each specific model version you suggest.
Council picked: Qwen2.5-3B-Instruct (Q4_K_M) as default tool-caller + Phi-3.5-mini-instruct (Q4_K_M) for instructions
Aug 16