Release 2.4.16

What's new

Commits details since the last release

• [57d497e] by @thiswillbeyourgithub, 8 seconds ago:
  bump version 2.4.15 -> 2.4.16

bumpver.toml
docs/source/conf.py
setup.py
wdoc/wdoc.py

• [76f19f7] by @thiswillbeyourgithub, 3 hours ago:
  docs: add todo for pytests
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

README.md

• [d12e4ef] by @thiswillbeyourgithub, 3 hours ago:
  docs: remove the unit test from the todo
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

README.md

• [140964f] by @thiswillbeyourgithub, 4 hours ago:
  docs: mention how to run the tests
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

README.md

• [8203084] by @thiswillbeyourgithub (aider), 4 hours ago:
  feat: Add basic pytest setup with initial tests for wdoc module

tests/init.py
tests/conftest.py
tests/test_wdoc.py

• [ae0bb6d] by @thiswillbeyourgithub, 4 hours ago:
  fix: import type hints from beartype
  Signed-off-by: thiswillbeyourgithub
  26625900+thiswillbeyourgithub@users.noreply.github.com

fix: import typing from beartype

Signed-off-by: thiswillbeyourgithub
26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/batch_file_loader.py
wdoc/utils/customs/compressed_embeddings_cache.py
wdoc/utils/customs/fix_llm_caching.py
wdoc/utils/embeddings.py
wdoc/utils/env.py
wdoc/utils/interact.py
wdoc/utils/llm.py
wdoc/utils/loaders.py
wdoc/utils/logger.py
wdoc/utils/misc.py
wdoc/utils/prompts.py
wdoc/utils/retrievers.py
wdoc/utils/tasks/query.py
wdoc/utils/tasks/summarize.py
wdoc/utils/typechecker.py
wdoc/wdoc.py

• [b24fa88] by @thiswillbeyourgithub, 4 hours ago:
  minor: remove unused import
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/llm.py

• [d6a4a47] by @thiswillbeyourgithub, 4 hours ago:
  minor
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/llm.py

Release 2.4.15

What's new

Commits details since the last release

• [e385d21] by @thiswillbeyourgithub, 6 seconds ago:
  bump version 2.4.14 -> 2.4.15

bumpver.toml
docs/source/conf.py
setup.py
wdoc/wdoc.py

• [c5408a3] by @thiswillbeyourgithub, 12 seconds ago:
  docs: fix doc link
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

README.md

Release 2.4.13

What's new

Commits details since the last release

• [af74747] by @thiswillbeyourgithub, 27 seconds ago:
  bump version 2.4.12 -> 2.4.13

bumpver.toml
setup.py
wdoc/wdoc.py

• [e6bb58e] by @thiswillbeyourgithub, 79 minutes ago:
  docs: added read the docs website
  Signed-off-by: thiswillbeyourgithub
  26625900+thiswillbeyourgithub@users.noreply.github.com

.readthedocs.yaml
docs/Makefile
docs/make.bat
docs/requirements.txt
docs/source/conf.py
docs/source/index.rst
docs/source/readme.md
docs/source/usage.md

• [9c3c15b] by @thiswillbeyourgithub, 3 minutes ago:
  feat: wdoc_parse_file can now be used with anki filetype
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/main.py
wdoc/wdoc.py

• [e62b376] by @thiswillbeyourgithub, 3 minutes ago:
  fix: wdoc_parse_file had issue with --debug and --verbose arguments
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/wdoc.py

Release 2.4.12

What's new

Commits details since the last release

• [ade4804] by @thiswillbeyourgithub, 6 seconds ago:
  bump version 2.4.11 -> 2.4.12

bumpver.toml
setup.py
wdoc/wdoc.py

• [98c23c4] by @thiswillbeyourgithub, 22 seconds ago:
  fix: --version display using tools
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/main.py

Release 2.4.11

What's new

Commits details since the last release

• [a9000f7] by @thiswillbeyourgithub, 25 seconds ago:
  bump version 2.4.10 -> 2.4.11

bumpver.toml
setup.py
wdoc/wdoc.py

• [d7c6ae1] by @thiswillbeyourgithub, 78 seconds ago:
  docs: update the summary in the readme example
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

README.md

• [b972423] by @thiswillbeyourgithub, 2 minutes ago:
  fix: youtube_language argument for cached youtube loader
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/loaders.py

• [4146722] by @thiswillbeyourgithub, 6 minutes ago:
  fix: summary example in readme should use en instead of english
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

README.md

• [323c72e] by @thiswillbeyourgithub, 10 minutes ago:
  todo: mention images
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

README.md

• [8e7d800] by @thiswillbeyourgithub, 12 minutes ago:
  docs: rename planned feature to roadmap
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

README.md

• [d00bf05] by @thiswillbeyourgithub, 3 days ago:
  fix: typo
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

README.md

Release 2.4.10

What's new

Commits details since the last release

• [4e96536] by @thiswillbeyourgithub, 14 seconds ago:
  bump version 2.4.9 -> 2.4.10

bumpver.toml
setup.py
wdoc/wdoc.py

• [e62b1e3] by @thiswillbeyourgithub, 23 seconds ago:
  feat: added an automoatically updated todo list
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

README.md

• [8fc7db6] by @thiswillbeyourgithub, 78 minutes ago:
  minor: remove unused import
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/misc.py

• [8b866f6] by @thiswillbeyourgithub, 79 minutes ago:
  minor: use Path instead of PosixPath
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/docs/USAGE.md
wdoc/utils/batch_file_loader.py
wdoc/utils/embeddings.py
wdoc/utils/loaders.py
wdoc/utils/misc.py
wdoc/wdoc.py

• [b5b2f32] by @thiswillbeyourgithub, 22 hours ago:
  fix: italic todo
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

README.md

• [3056d33] by @thiswillbeyourgithub, 22 hours ago:
  new: maintain a list of TODOs thanks to my other side project

README.md

• [a49c307] by @thiswillbeyourgithub, 23 hours ago:
  doc
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

README.md

• [452d309] by @thiswillbeyourgithub, 23 hours ago:
  synchronized todo list
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

README.md

• [0f6a666] by @thiswillbeyourgithub, 3 days ago:
  docs: forgot to correct WDoc to wdoc
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

scripts/NtfySummarizer/README.md
scripts/TheFiche/README.md

• [45b640a] by @thiswillbeyourgithub, 9 days ago:
  bump version 2.4.8 -> 2.4.9

bumpver.toml
setup.py
wdoc/wdoc.py

• [720a601] by @thiswillbeyourgithub, 9 days ago:
  upgrade persistdict
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

setup.py

• [02a9a99] by @thiswillbeyourgithub, 11 days ago:
  bump version 2.4.7 -> 2.4.8

bumpver.toml
setup.py
wdoc/wdoc.py

• [4122ec8] by @thiswillbeyourgithub, 11 days ago:
  fix: vtt format
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/loaders.py

• [2316f3b] by @thiswillbeyourgithub, 11 days ago:
  bump version 2.4.6 -> 2.4.7

bumpver.toml
setup.py
wdoc/wdoc.py

• [9ae4c0c] by @thiswillbeyourgithub, 11 days ago:
  prompt: mention that the summary must include the approximate time for the top level bullet point
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/prompts.py

• [f4b68fe] by @thiswillbeyourgithub, 11 days ago:
  bump version 2.4.5 -> 2.4.6

bumpver.toml
setup.py
wdoc/wdoc.py

• [7dfab93] by @thiswillbeyourgithub, 11 days ago:
  docs: mention we have timestamps for audio now
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

README.md

• [24bcf00] by @thiswillbeyourgithub, 11 days ago:
  new: parse audio transcript as a full text with some timestamps to know when what was said
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/loaders.py

• [938c3ca] by @thiswillbeyourgithub, 11 days ago:
  minor: move some timecode conversion functions to misc.py
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/loaders.py
wdoc/utils/misc.py

• [4c660d6] by @thiswillbeyourgithub, 11 days ago:
  docs: mention that long audio are splits then combined
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

README.md

• [c7bb348] by @thiswillbeyourgithub, 11 days ago:
  feat: automatically split audio that are too large for whisper
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/loaders.py

• [ff9bb34] by @thiswillbeyourgithub, 11 days ago:
  bump version 2.4.4 -> 2.4.5

bumpver.toml
setup.py
wdoc/wdoc.py

• [f998429] by @thiswillbeyourgithub, 11 days ago:
  new: when removing silence from audio, dont crash if a filter fails
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/loaders.py

• [dd48a82] by @thiswillbeyourgithub, 11 days ago:
  bump version 2.4.3 -> 2.4.4

bumpver.toml
setup.py
wdoc/wdoc.py

• [16fc81f] by @thiswillbeyourgithub, 11 days ago:
  fix: forgot an argument to the load_local_video
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/loaders.py

• [0842582] by @thiswillbeyourgithub, 11 days ago:
  minor
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/loaders.py

• [a8f0c62] by @thiswillbeyourgithub, 2 weeks ago:
  update persistdict
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

setup.py

• [73566b4] by @thiswillbeyourgithub, 2 weeks ago:
  dont upgrade persistdict yet
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

setup.py

• [4a6c1d7] by @thiswillbeyourgithub, 2 weeks ago:
  fix: return None if a key is missing instead of crashing
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/customs/compressed_embeddings_cache.py

• [2cfdda0] by @thiswillbeyourgithub, 2 weeks ago:
  fix: dont make compressed_embeddings_cache rely on setitems and getitems methods because Im removing them from persistdict
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/customs/compressed_embeddings_cache.py

• [6145a28] by @thiswillbeyourgithub, 2 weeks ago:
  minor: rename the folder of cache langchain.db to langchain_db
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/wdoc.py

• [6d96f32] by @thiswillbeyourgithub, 2 weeks ago:
  in the prompts use instead of <detailed_instructions>
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/prompts.py

• [2563a42] by @thiswillbeyourgithub, 2 weeks ago:
  slightly better prompt for answering a question
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/prompts.py

Release 2.4.3

What's new

Commits details since the last release

• [d397dd0] by @thiswillbeyourgithub, 14 seconds ago:
  bump version 2.4.2 -> 2.4.3

bumpver.toml
setup.py
wdoc/wdoc.py

• [1b0e84a] by @thiswillbeyourgithub, 69 seconds ago:
  fix: pattern and recursed_filetype args were not passed on
  Thanks to @rfishermonteith in #12

Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/misc.py

• [a1ff236] by @thiswillbeyourgithub, 10 hours ago:
  fix: text splitter thanks to @rfishermonteith in #11
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/misc.py

• [743354f] by @thiswillbeyourgithub, 5 days ago:
  add message to user telling to open an issue
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/wdoc.py

• [ebb9b2e] by @thiswillbeyourgithub, 5 days ago:
  new: in case of error with yt dlp tell user to try to update
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/loaders.py

• [e329e08] by @thiswillbeyourgithub, 5 days ago:
  minor: check for info metadata in yt dlp
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/loaders.py

Release 2.4.2

What's new

Commits details since the last release

• [a0acfd7] by @thiswillbeyourgithub, 31 seconds ago:
  bump version 2.4.1 -> 2.4.2

bumpver.toml
setup.py
wdoc/wdoc.py

• [bf27dad] by @thiswillbeyourgithub, 6 hours ago:
  fix: variable name
  thanks to @NordMike in #9

Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/loaders.py

• [a356c8d] by @thiswillbeyourgithub, 6 hours ago:
  fix: chapters in yt dlp
  thanks to @NordMike in
  #10

Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/loaders.py

Release 2.4.1

What's new

Commits details since the last release

• [c1c11f8] by @thiswillbeyourgithub, 3 minutes ago:
  bump version 2.4.0 -> 2.4.1

bumpver.toml
setup.py
wdoc/wdoc.py

• [633c483] by @thiswillbeyourgithub, 48 seconds ago:
  update yt dlp to latest
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

setup.py

• [d18d777] by @thiswillbeyourgithub, 3 minutes ago:
  fix: trust platform dir to create the appropriate paths for logging and cache
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/logger.py

• [d76b9fc] by @thiswillbeyourgithub, 20 minutes ago:
  use latest persistdict version
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

setup.py

• [cbbb1bf] by @thiswillbeyourgithub, 29 minutes ago:
  fix: mkdir local filestore
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/customs/compressed_embeddings_cache.py

Release 2.4.0

What's new

Commits details since the last release

• [3a10bd6] by @thiswillbeyourgithub, 74 seconds ago:
  bump version 2.3.9 -> 2.4.0

bumpver.toml
setup.py
wdoc/wdoc.py

• [f035f22] by @thiswillbeyourgithub, 2 minutes ago:
  minor: better storing of metadata for yt
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/loaders.py

• [b5d1d6a] by @thiswillbeyourgithub, 6 minutes ago:
  new: include youtube chapters into the summary as metadata
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/wdoc.py

• [960fdce] by @thiswillbeyourgithub, 7 minutes ago:
  minor: include title and channel as metadata
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/loaders.py

• [391fab7] by @thiswillbeyourgithub, 7 minutes ago:
  feat and fix: proper youtube loader implementation using yt_dlp instead of yt_dl and with vtt subtitle parsing using timecode aware parsing
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/loaders.py

• [7678491] by @thiswillbeyourgithub, 68 minutes ago:
  minor: fix type
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/loaders.py

• [20e6b2b] by @thiswillbeyourgithub, 2 hours ago:
  bump version 2.3.8 -> 2.3.9

bumpver.toml
setup.py
wdoc/wdoc.py

• [bc1bd69] by @thiswillbeyourgithub, 2 hours ago:
  fix: python version
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

setup.py

• [e111e7d] by @thiswillbeyourgithub, 2 hours ago:
  fix: nonsense to install yt dlp and parse youtube in peace
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

setup.py
wdoc/utils/import_tricks.py
wdoc/utils/loaders.py

• [f930af0] by @thiswillbeyourgithub, 2 hours ago:
  fix: always crash if only one document to load and fails (allows more helpful error messages)
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

wdoc/utils/batch_file_loader.py

• [c929a96] by @thiswillbeyourgithub, 2 hours ago:
  new: in case of error in the ntfy script, print the full stacktrace
  Signed-off-by: thiswillbeyourgithub 26625900+thiswillbeyourgithub@users.noreply.github.com

scripts/NtfySummarizer/NtfySummarizer.py