Initial commit adding the ability to use TextServices#623
Initial commit adding the ability to use TextServices#623JackLewis-digirati wants to merge 18 commits into
Conversation
…rolls back if there's a failure
What this PR doesImplements the text-services pipeline integration (issue #617). When a manifest is created or updated with a
Once the text service finishes, a background SQS handler (
Key design decisions
Only
|
Use AddDistinctById() helper as used elsewhere, updated it to return the number of items added, change base type to make more accommodating and add optional hook to alter item on add. Set label on AutoComplete and SearchService if not set. Rather than iterate and read contexts, add search2 context manually as it's a published constant
Resolves #617
What does this change?
This PR enables pipelines in iiif-presentation as well as implementing a connection to the text services project.
Note
This PR now wraps database operations in a transaction so that failures to submit a manifest correctly rolls everything back. Additionally, as text services requires S3 to be available from the moment of submission, the S3 is saved before pipeline submission. This then needs to roll back by deleting the staging manifest from S3
Database Migration
Note
Details of migration. What does it change? Is it breaking/non-breaking?
pipeline_jobstable that tracks jobs being submitted to text-services, while being extendable to other pipelines in the futureConfiguration Changes
Note
This PR introduces configuration changes.
TextServices:BuilderApiUrinullTextServices:SearchApiUrinullAWS:SQS:TextJobQueueNamenull