Feat: LLM Chat #155

Merged

zach merged 67 commits from feat/llm-chat-tab into main 2026-10-18 17:05:05 +02:00

Conversation 5 Commits 67 Files Changed 153

+17947 -841

zach commented 2026-08-31 18:57:51 +02:00

Owner

Copy Link

Copy Source

What & why

New chat interface in sidebar

The sidebar now has two tabs, notifications and chat. The chat is a frontend for whatever endpoint API the user sets in Config.llm.endpoint. Currently hardcoded-ish for llama.cpp endpoints but will generalize.

Tools

The chat has these tools defined:

• WebFetch - Fetches a website's contents
• Readfile - Reads a file from disk
• Shell commands - Sandboxed shell usage with readonly view of actual filesystem

Related issue

No response

Type

New feature

Tested

• Build succeeds
• Existing tests pass
• Manually verified

Breaking changes?

No response

Checklist

• CI passes (format, lint, typecheck)
• Clean commits
• No new warnings
• Docs updated if needed

### What & why ## New chat interface in sidebar The sidebar now has two tabs, notifications and chat. The chat is a frontend for whatever endpoint API the user sets in `Config.llm.endpoint`. Currently hardcoded-ish for `llama.cpp` endpoints but will generalize. ### Tools The chat has these tools defined: - WebFetch - Fetches a website's contents - Readfile - Reads a file from disk - Shell commands - Sandboxed shell usage with readonly view of actual filesystem ### Related issue _No response_ ### Type New feature ### Tested - [x] Build succeeds - [ ] Existing tests pass - [x] Manually verified ### Breaking changes? _No response_ ### Checklist - [ ] CI passes (format, lint, typecheck) - [x] Clean commits - [ ] No new warnings - [x] Docs updated if needed

zach added 9 commits 2026-08-31 18:57:52 +02:00

initial commit for llm chat tab in sidebar 47bab21e22

add removal of chat sessions, auto title + icon, proper stick-to-bottom as response is streamed 9657e5092a

start initial work on detaching chat to floating window 37c6a9986e

better chat list view + anchor to bottom. sqlite db for chats + LIFO-ordered aae3757daf

add markdown parsing + latex + tree-sitter highlighting for codeblocks in llm responses e18875a752

async parsing + tex caching 3946541f87

async parsing + tex caching 78988700be

rotated view + wheel inverter c33dbc147f

better scrollbar in codeblocks + enter anim for delegates 293bf67e09

AramJonghu commented 2026-08-31 19:24:37 +02:00

Collaborator

Copy Link

Copy Source

AI concern

My main concern would be if the chat window is an opt-in setting. I would personally think many users are not waiting for an llm integration into a quickshell project; I know I am not.

Will this be an opt-in feature? Meaning that the user would need to go into settings or the config file to enable the front-end to even show the chat window.

Build failure

It seems build is failing due to missing libcmark-gfm. I'm not sure what package this is as in artix repo + arch extra and multilib as I can't find it. I cannot find it in https://archlinux.org/packages or https://aur.archlinux.org either.

### AI concern My main concern would be if the chat window is an opt-in setting. I would personally think many users are not waiting for an llm integration into a quickshell project; I know I am not. Will this be an opt-in feature? Meaning that the user would need to go into settings or the config file to enable the front-end to even show the chat window. ### Build failure It seems build is failing due to missing `libcmark-gfm`. I'm not sure what package this is as in artix repo + arch extra and multilib as I can't find it. I cannot find it in https://archlinux.org/packages or https://aur.archlinux.org either.

zach commented 2026-08-31 21:43:58 +02:00

Author

Owner

Copy Link

Copy Source

There will be a config option to disable it, like everything else. It'll most likely be enabled by default though so that users can see that it exists without going deep into settings and stumble upon it.

I would personally think many users are not waiting for an llm integration into a quickshell project; I know I am not.

I disagree with that statement wholeheartedly, I don't think that LLM integration and Quickshell projects are mutually exclusive, in fact there's already multiple Quickshell configs that implement an LLM chat interface.

The package is just called cmark.

There will be a config option to disable it, like everything else. It'll most likely be enabled by default though so that users can see that it exists without going deep into settings and stumble upon it. >I would personally think many users are not waiting for an llm integration into a quickshell project; I know I am not. I disagree with that statement wholeheartedly, I don't think that LLM integration and Quickshell projects are mutually exclusive, in fact there's already multiple Quickshell configs that implement an LLM chat interface. The package is just called `cmark`.

AramJonghu commented 2026-08-31 22:00:40 +02:00

Collaborator

Copy Link

Copy Source

I meant to say opt-out, not opt-in. I'd prefer opt-in personally.

I mean to say that a general user using a desktop environment or a desktop like shell would unlikely want llm chat integration. There are no statistics I have found of this, but reading people leaving windows generally do not like AI. Granted; Microsoft shoves Copilot everywhere in Windows.

It's up to you. I'm okay with it so long it can be hidden completely (apart from the setting to be able to toggle it to enable the feature). Since it is a config option, all good for me.

I meant to say opt-out, not opt-in. I'd prefer opt-in personally. I mean to say that a general user using a desktop environment or a desktop like shell would unlikely want llm chat integration. There are no statistics I have found of this, but reading people leaving windows generally do not like AI. Granted; Microsoft shoves Copilot everywhere in Windows. It's up to you. I'm okay with it so long it can be hidden completely (apart from the setting to be able to toggle it to enable the feature). Since it is a config option, all good for me.

AramJonghu force-pushed feat/llm-chat-tab from 24593472e3 to c9f7856982 2026-08-31 22:48:06 +02:00 Compare

AramJonghu commented 2026-08-31 23:28:43 +02:00

Collaborator

Copy Link

Copy Source

c9f7856982 fixes the missing dependencies in the Dockerfile. Issue is that the build still fails, maybe related to ci/CMakeLists mismatch with new dependencies.

[c9f7856982](https://git.zach-dev.cc/zach/z-bar-qt/commit/c9f7856982d970955ac87db29098ac6eb929f81d) fixes the missing dependencies in the Dockerfile. Issue is that the build still fails, maybe related to ci/CMakeLists mismatch with new dependencies.

AramJonghu commented 2026-09-01 15:19:17 +02:00

Collaborator

Copy Link

Copy Source

I have stopped the runner service temporarily. Some change in workflows or resources on the server is causing issues.

I have stopped the runner service temporarily. Some change in workflows or resources on the server is causing issues.

zach force-pushed feat/llm-chat-tab from dfecaf9cbc to fcb848b6d2 2026-09-03 22:48:30 +02:00 Compare

zach added 29 commits 2026-09-30 15:13:53 +02:00

better support for opening chat in floating window 1ab49d4b38

fab menu and model selector 88bb413f9a

chore: format llm c files 2df1cfe9aa

chore: format llm c files 14b54206b1

chore: format python codeicons 79bedd5119

fix(Docker): add required deps to dockerfile 5ec682d780

fix: font family d5d2311c24

chore: split cmake into multiple files and fix settings searching regex + add enabled option to llm e58440fea4

fix: uncomment settings index cache path d3ac675492

fix: cmake install dir 0d4c08cfbb

fix: cmake install dir be541d8f8d

fix: add gnuinstalldirs include 15769ba78e

fix: property link modules 57a6e48dcb

feat: implement findChild* methods bc927b16af

feat: implement findChild* methods a8fdc31b8d

use blobgroup for window chat interface + slim sidebar e700a4f96b

fix: truncate webfetch content to fit context e2786a3f1e

fix: tool call prompt a59e4286ad

fix: truncate context logic 5fc6fda804

Merge branch 'main' into feat/llm-chat-tab cafdce2352

gitignore 83f6f95f6e

Merge branch 'main' into feat/llm-chat-tab 51ed270774

new chatlistview component, file attachments, performance & primitive test d8a3d5732e

chore: format 13f1a3fede

fixed: mousewheel swallow bdfb9fc241

Merge branch 'main' into feat/llm-chat-tab 5153cc4f17

chore: format & fix prettierignore ca51f660ad

fix: format and apply lint fixes in python script 83bc153ee3

separate dashboard and settings changes to new branch 4f797a9741

zach force-pushed feat/llm-chat-tab from 34d4c6a57a to 4f797a9741 2026-09-30 15:13:53 +02:00 Compare

zach changed title from Feat: LLM Chat and Nightlight shader to Feat: LLM Chat 2026-09-30 15:23:57 +02:00

zach added 1 commit 2026-09-30 17:59:19 +02:00

Merge branch 'main' into feat/llm-chat-tab 63b96471b0

zach added 2 commits 2026-09-30 18:41:20 +02:00

fix: add wheelinverter to cmake c1f26e7dcb

Merge branch 'main' into feat/llm-chat-tab 54f966b4ea

zach added 1 commit 2026-09-30 19:30:10 +02:00

fix: restore lost changes e8bf8b9727

zach added 1 commit 2026-09-30 23:33:45 +02:00

Merge branch 'main' into feat/llm-chat-tab c64088441b

zach added 1 commit 2026-10-01 17:11:31 +02:00

Merge branch 'main' into feat/llm-chat-tab 4b67cc1d88

zach added 1 commit 2026-10-02 19:54:46 +02:00

Merge branch 'main' into feat/llm-chat-tab add3beed59

zach added 1 commit 2026-10-03 20:26:22 +02:00

Merge branch 'main' into feat/llm-chat-tab 506b69165d

zach added 1 commit 2026-10-04 13:54:06 +02:00

fix: merge two strokecanvas into one + better cursorShape and pointer handling f1918172c3

zach added 1 commit 2026-10-04 13:56:09 +02:00

Merge branch 'main' into feat/llm-chat-tab e148a0f843

zach added 1 commit 2026-10-04 18:20:24 +02:00

Merge branch 'main' into feat/llm-chat-tab 99fdfbc465

zach added 1 commit 2026-10-05 09:58:02 +02:00

Merge branch 'main' into feat/llm-chat-tab b91befa9f7

zach added 1 commit 2026-10-05 19:34:08 +02:00

Merge branch 'main' into feat/llm-chat-tab 11e94fbb4b

zach added 1 commit 2026-10-06 00:55:55 +02:00

add rounding var a00bbe50f2

zach added 1 commit 2026-10-06 13:33:45 +02:00

Merge branch 'main' into feat/llm-chat-tab c06cbea854

zach added 1 commit 2026-10-07 13:32:50 +02:00

Merge branch 'main' into feat/llm-chat-tab 76823eff79

zach added 1 commit 2026-10-07 13:33:58 +02:00

revert rounding var 4d75b317cd

zach added 1 commit 2026-10-07 22:37:49 +02:00

fix: qt 6.12 build a13fa8442b

zach added 1 commit 2026-10-07 22:39:21 +02:00

Merge branch 'main' into feat/llm-chat-tab 4c410d638c

zach added 1 commit 2026-10-08 12:08:55 +02:00

gemini glow fixes + positioning for window view d70fb61e4a

zach added 1 commit 2026-10-08 12:10:16 +02:00

Merge branch 'main' into feat/llm-chat-tab bf6a7027e4

zach added 1 commit 2026-10-11 08:42:24 +02:00

Merge branch 'main' into feat/llm-chat-tab a4f6aa1d4a

zach added 1 commit 2026-10-12 15:54:54 +02:00

Merge branch 'main' into feat/llm-chat-tab 2cabd72fc0

zach added 1 commit 2026-10-12 15:58:34 +02:00

Merge branch 'main' into feat/llm-chat-tab bee8cd061b

zach added 1 commit 2026-10-12 16:06:24 +02:00

Merge branch 'main' into feat/llm-chat-tab fc81be922f

zach added 1 commit 2026-10-18 12:58:44 +02:00

chore: restructure llm plugin to be more coherent & fix various bugs in llm ui 1fe8a3a959

zach added 1 commit 2026-10-18 13:03:27 +02:00

fix: remove unimplemented method 0a503bc27c

zach added 1 commit 2026-10-18 14:43:01 +02:00

Merge branch 'main' into feat/llm-chat-tab 45aa6c9005

zach added 1 commit 2026-10-18 15:23:45 +02:00

chore: formatter & clangd lsp option 08d42e1f8a

zach merged commit d3345906b9 into main 2026-10-18 17:05:05 +02:00

zach deleted branch feat/llm-chat-tab 2026-10-18 17:05:06 +02:00

Sign in to join this conversation.

Reviewers

No Reviewers

Labels

Clear labels

bug

Something isn't working

documentation

Improvements or additions to documentation

duplicate

This issue or pull request already exists

enhancement

New feature or request

good first issue

Good for newcomers

help wanted

Extra attention is needed

invalid

This doesn't seem right

question

Further information is requested

wontfix

This will not be worked on

No labels

Milestone

No items

No Milestone

Projects

Clear projects

No projects

Assignees

Clear assignees

AramJonghu Inorishio zach

No Assignees

2 Participants

Notifications

Subscribe

Due Date

No due date set.

Dependencies

No dependencies set.

Reference: zach/z-bar-qt#155