feat: add index.ignore config to skip indexing paths

[gleber]

Mirrors sync.ignore — gitignore-style patterns read from config.get(["index", "ignore"]). Filters both incremental file:changed queuing and full reindexSpace cycles.

I've added a lot of files to the space directory, but I do not want them to be indexed. Currently SB is unusable. In the long run, I'd want them to be viewable but not indexed or synced (I do not think this is supported yet), discoverable only via links from other accessible files.

[zefhemel]

For your use, would sync.ignore not suffice?

[gleber]

I've got it set already:

config.set {
  sync = {
    ignore = {
      "gmail/**",
      "gcal/**",
      "drive/**",
      "gdrive/**",
      "syncdata/**",
      "_plug/**",
      "Library/**",
      ".silverbullet.db*",
      ".ingest-state.json"
    }
  },
...

but it does not help and a lot of files are in CTRL+K:

SB web UI freezes for 1-2s on every interaction, click, typing, etc. I regularly see this in the console:

[Service Worker] [Sync] Completed: 1 operations in 1.165s

If I do Sync: Space command, here's what I see:

[Service Worker] [sync] Performing a full sync cycle...
logger.ts:43 [Service Worker] [sync] File has changed on secondary, but not primary: copy from secondary to primary AGENTS.md
logger.ts:43 [Service Worker] [Sync] Completed: 1 operations in 1.227s
6logger.ts:43 [Service Worker] [sync] Performing a single file sync CONFIG.md
logger.ts:43 [Service Worker] [sync] Performing a full sync cycle...
logger.ts:43 [Service Worker] [sync] File has changed on secondary, but not primary: copy from secondary to primary AGENTS.md
logger.ts:43 [Service Worker] [Sync] Completed: 1 operations in 1.207s
3logger.ts:43 [Service Worker] [sync] Performing a single file sync CONFIG.md
logger.ts:43 [Service Worker] [sync] Performing a full sync cycle...
logger.ts:43 [Service Worker] [sync] Sync already in progress...
(anonymous) @ logger.ts:43
syncSingleFile @ sync.ts:183
syncSingleFile @ sync_engine.ts:135
observedRequest @ service_worker.ts:370
emit @ event.ts:32
(anonymous) @ proxy_router.ts:309
setTimeout
handleGet @ proxy_router.ts:307
await in handleGet
handleRequest @ proxy_router.ts:254
(anonymous) @ proxy_router.ts:227
await in (anonymous)
onFetch @ proxy_router.ts:241
(anonymous) @ service_worker.ts:388
logger.ts:43 [Service Worker] [sync] File has changed on secondary, but not primary: copy from secondary to primary AGENTS.md
logger.ts:43 [Service Worker] [Sync] Completed: 1 operations in 1.133s
2logger.ts:43 [Service Worker] [sync] Performing a single file sync CONFIG.md
logger.ts:43 [Service Worker] [sync] Performing a full sync cycle...
logger.ts:43 [Service Worker] [sync] File has changed on secondary, but not primary: copy from secondary to primary AGENTS.md
logger.ts:43 [Service Worker] [Sync] Completed: 1 operations in 1.161s
5logger.ts:43 [Service Worker] [sync] Performing a single file sync CONFIG.md
logger.ts:43 [Service Worker] [sync] Performing a full sync cycle...
logger.ts:43 [Service Worker] [sync] File has changed on secondary, but not primary: copy from secondary to primary AGENTS.md
logger.ts:43 [Service Worker] [Sync] Completed: 1 operations in 1.369s
logger.ts:43 [Service Worker] [sync] Performing a single file sync CONFIG.md

Note: AGENTS.md is a symlink to CLAUDE.md, I doubt it is being actually modified by anything.

[zefhemel]

Ah yes of course, it doesn't sync those files but it does "see" them. But there's also the SB_SPACE_IGNORE environment variable, see: https://silverbullet.md/Install/Configuration

That's what you need?