feat: add PreTrainedTokenizer support.

chore: simplify HF tokenizer conversion.

fix error for pip install (#278)

fix: pad tokenizer vocab to match model vocab_size (#282)

feat: tool calls. (#281)

fix: support \n\n. (#274)

feat: add host arg. (#273)

use cpp highlight for `.comp` (#271)

cover.

feat: improved api reliability. (#268)

fix: support close socket on windows.

fix: support close socket on windows.

update readme.md.

fix: hoisting.

fix: correct required vulkan device extensions.