Skip to content

Qwen3-4B-Q4_K_M model not working in Unity Llama Sharp demo #12

Description

@nimeshjh

Hi,
I'm trying to use the Qwen3-4B-Q4_K_M.gguf model with the LlamaSharp Unity demo, but it doesn't work properly. Here’s what I’ve tried and observed:

✅ System Details:
Platform: Windows 11
Unity Version: Unity 6000.1.4f1
Model: Qwen3-4B-Q4_K_M.gguf

❌ Issue:
The Unity app loads but crashes
Other models like TinyLlama, Mistral, or Llama2 work fine in the same setup.

Let me know if logs or crash dumps are needed.

Thanks for the great project!

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions