AI Assistant not using attachments with local LLM
I am testing out the AI assistant in DataGrip. I used the provided models in the trial and saw decent output, but when switching to a local LLM through Ollama it ignores all context provided and hallucinates like crazy. in the attached interaction I provided it the airflow schema, it ignores it then starts making stuff up.
请先登录再写评论。
This seems to be model specific, Mistral works and it is able to read the schema. But Deepseek and Qwen couldn't
It kinda works. It can tell it is a schema and can read the name, but doesn't seem to be able to infer anything from it. Has anyon e found a local LLM that works well with AI Assistant in Data Grip?
I thought that the schema attachment was a file, but it isn't I asked the model to repeat the prompt text it received and this is what it came back with. It tells it the schema name but is passing blank information for everything about the schema. Certainly this can't be intended functionality.
When using a cloud model (sonnet) this is what it gets instead.
Edward Sparks , could you please share Chat Dumps via https://uploads.jetbrains.com/ and share upload id?
To obtain Chat Dump use Dump Chat option