Course material file upload, content indexing and topic extraction - #19

Open

Apps247 wants to merge 86 commits into

mainfrom

aprameya/course-material-coverage-analysis

Commits on May 21, 2026

Added PDF text extraction
Apps247
committed
750984b
UI Fix
Apps247
committed
5487aa3
Added OCR feature
Apps247
committed
f9de9b5
Removed broken indexing progress bar feature
Apps247
committed
132e356
Added text extraction microservice
Apps247
committed
f743fc7
Fixed AWS Textract microservice and laravel interaction
Apps247
committed
5c58a47
Added OCR timer
Apps247
committed
ce4f372

Commits on May 22, 2026

Changed region
Apps247
committed
124dedc
Added docs
Apps247
committed
0ce192d
Changed button colour
Apps247
committed
bfd1fd9

Commits on Jun 8, 2026

Changed structure to match other microservices
Apps247
committed
ab675c9

Commits on Jun 9, 2026

Added search indexing and basic UI
Apps247
committed
b7baf15
More robust PDF checking, and optimizations
Apps247
committed
00378d4
Added program search
Apps247
committed
874e914

Commits on Jun 10, 2026

Clicking search result shows original page
Apps247
committed
5c5c630

Commits on Jun 11, 2026

Updated docs
Apps247
committed
6f3126b
Switched to Spatie\PdfToImage
Apps247
committed
2dbc2af
Thumbnail feature, refactored, reverted to poppler
Apps247
committed
2464bc5
Added comments explaining quirky code
Apps247
committed
2c951b9
Added comments explaining quirky code
Apps247
committed
902c4e1
Merge branch 'aprameya/course-material-coverage-analysis' of https://github.com/forestryTLS/curriculum-development-tool into aprameya/course-material-coverage-analysis
Apps247
committed
e0af3bb

Commits on Jun 12, 2026

Fixed pdf to image preview issue
Apps247
committed
6027420
Simplified DB schema
Apps247
committed
d891b6f

Commits on Jun 13, 2026

Refactor and improvements
Apps247
committed
edd9aa1

Commits on Jun 15, 2026

Added download button to program materials view, misc changes
Apps247
committed
e760414
Refactored search controller, added thumbnails to program search
Apps247
committed
a73d7da
Bug fix
Apps247
committed
a463a15

Commits on Jun 24, 2026

Commits on Jun 25, 2026

Course Material File UI and controller
Apps247
committed
8d184e9
Topic extraction service set up
Apps247
committed
71f628a

Commits on Jun 29, 2026

Improved topic extraction
Apps247
committed
831bf76
Added PowerPoint processing case
Apps247
committed
7a2de2f

Commits on Jul 2, 2026

Refactored topic extraction into text extraction service, added type-specific topic extraction methods and optimizations
Apps247
committed
0465a47

Commits on Jul 6, 2026

Commits on Jul 8, 2026

Added temporary refresh button
Apps247
committed
9b52d96
BERTopic improvements DRAFT
Apps247
committed
1a01435

Commits on Jul 9, 2026

Improved BERTopic extraction DRAFT
Apps247
committed
e063d05
Improved parameters and postprocessing
Apps247
committed
99ce22e

Commits on Jul 13, 2026

Refactored step10 to use single template
Apps247
committed
b02e0cd
Added adjective-final removals and custom stopword vectorizing
Apps247
committed
78fa49b
Added dropdown for material type
Apps247
committed
0190b43

Commits on Jul 15, 2026

Commits on Jul 16, 2026

Loosened threshold for slides
Apps247
committed
f3e8842
File topic editing UI functionality and bug fixes
Apps247
committed
cce8852

Commits on Jul 17, 2026

Made course topics master and material UI just add or remove
Apps247
committed
e922ee6
Added topic matching method
Apps247
committed
e4827b0

Commits on Jul 20, 2026

Fixed temporary search
Apps247
committed
9239001
Added review and accept system for suggested topics
Apps247
committed
9105bec
Optimizations and cleanup
Apps247
committed
5eee2ab
Uppercase-lowercase Bug Fix
Apps247
committed
740d3eb

Commits on Jul 21, 2026

Preserved case for topics
Apps247
committed
6623dd1

Commits on Jul 22, 2026

Commits on Jul 23, 2026

Removed unnecessary course_id column
Apps247
committed
c952998

Commits on Jul 24, 2026

Python tests and bug fixes
Apps247
committed
ca9be4a

Commits on Jul 25, 2026

Refactored E2E fixtures
Apps247
committed
a6a0285
Feature test for suggested topics
Apps247
committed
b383409

Commits on Jul 26, 2026

End-to-end test
Apps247
committed
d37a1dc

Commits on Jul 27, 2026

Updated docs
Apps247
committed
2611241
File upload potential fix
Apps247
committed
bdda3e9
pytest OCR test
Apps247
committed
d7fcfbf

Commits on Jul 30, 2026

Requested changes
Apps247
committed
664e7fb
Added enum for topic source and docstring
Apps247
committed
b060ad0

Commits on Jul 31, 2026

Further requested changes for server and tests
Apps247
committed
43ac4c6
PHP-side requested changes
Apps247
committed
0c330b1
Set allow_credentials=False
Apps247
committed
5a4b834
Multi-part file sending
Apps247
committed
877bb3d
Made search result highlighting more robust
Apps247
committed
fce7f59
Bug fix
Apps247
committed
64d951a
Added retry button if indexing failed
Apps247
committed
009698a
Updated Schema doc
Apps247
committed
1096066
Bug fix
Apps247
committed
1892cb6
Added S3 deletion on job completion or failure
Apps247
committed
7740e75
Fixed material type requirement and added new test
Apps247
committed
780bb6d