Testing the Model

Go to Models > New Model and enter the following details

Display Name: Granite 4 Tiny
Model Name: granite4:tiny-h
Description: IBM Granite 4.0-H-Tiny is a hyper-efficient, 7-billion total parameter hybrid mixture-of-experts (MoE) language model. 
Base URL: http://host.docker.internal:11434/v1

Enable Tool Use

Final Result

Try it out

Enter the following prompt at the console.

Write a small hello world program in Rust.

The Result