Commit Graph
2875 Commits
Author SHA1 Message Date
tcely 3890ad8806 Add tubesync-fs-worker to background-task-workers bundle 2025-05-29 20:14:23 -04:00
tcely b4c14ea1dc Add tubesync-db-worker to background-task-workers bundle 2025-05-29 20:12:56 -04:00
tcely 71c0ae6ed2 Add tubesync-network-worker to background-task-workers bundle 2025-05-29 20:10:49 -04:00
tcely 9b33606168 Create background-task-workers bundle 2025-05-29 20:08:00 -04:00
tcely 7e9be86789 Create gunicorn dependency for huey-net-limited 2025-05-29 20:00:47 -04:00
tcely 16b8f9ad3c Create gunicorn dependency for huey-network 2025-05-29 19:59:40 -04:00
tcely 7078c2b1ed Create gunicorn dependency for huey-filesystem 2025-05-29 19:58:16 -04:00
tcely c8f95456f2 Create gunicorn dependency for huey-database 2025-05-29 19:56:57 -04:00
tcely 37a60447ac Add channel_id to the minimal metadata 2025-05-29 11:41:09 -04:00
tcely e21da0fb26 Update Media.has_metadata
One of the `*_id` keys must have a value.
2025-05-29 11:29:32 -04:00
tcely 5e20ebdf47 Do not call Media.save_to_metadata function unless needed 2025-05-29 10:18:23 -04:00
tcely 6b64614561 Use the Media.metadata_clear function 2025-05-29 09:57:09 -04:00
tcely 9a5acdd2ab Create new Media instances with defaults 2025-05-29 08:52:07 -04:00
tcely 9fd8c7ce69 Merge branch 'main' into patch-6 2025-05-29 01:41:05 -04:00
tcely 6aac84922b Revert Depend on 0033 temporarily 2025-05-29 01:16:06 -04:00
tcely cf27324c78 Merge branch 'meeb:main' into index-rewrite 2025-05-29 01:13:10 -04:00
meeb e3ce550e6a Merge pull request #938 from tcely/patch-14
Rename media files from all sources by default
2025-05-29 15:05:19 +10:00
tcely 460f2c0669 Update README.md 2025-05-29 00:52:31 -04:00
tcely 2120776581 Merge branch 'main' into patch-14 2025-05-29 00:47:27 -04:00
tcely 5e224254b5 Create huey-filesystem/run 2025-05-29 00:34:14 -04:00
tcely 2b0d3db90a Create huey-database/run 2025-05-29 00:33:07 -04:00
tcely c1159088e5 Create huey-network/run 2025-05-29 00:31:31 -04:00
tcely 6e5099e199 Create huey-net-limited/run 2025-05-29 00:29:55 -04:00
meeb c0f9b05eb4 Merge pull request #1077 from tcely/patch-7
Set a value when `Media.published` is `None`
2025-05-29 14:24:22 +10:00
meeb 4d160ee673 Merge pull request #1073 from tcely/patch-4
Targeted indexing schedule
2025-05-29 14:14:43 +10:00
tcely 7ae89b3471 Create huey-filesystem/type 2025-05-29 00:11:10 -04:00
tcely 8b08177394 Create huey-database/type 2025-05-29 00:10:01 -04:00
tcely c16d3fe18f Create huey-network/type 2025-05-29 00:08:53 -04:00
tcely 227624a854 Create huey-net-limited/type 2025-05-29 00:07:52 -04:00
tcely c39491b644 Create huey-filesystem/down-signal 2025-05-29 00:05:32 -04:00
tcely 61260fe2a5 Create huey-database/down-signal 2025-05-29 00:04:27 -04:00
tcely 08d593d320 Create huey-network/down-signal 2025-05-29 00:03:04 -04:00
tcely 5c54909edd Create huey-net-limited/down-signal 2025-05-29 00:01:50 -04:00
tcely f2afbc17b4 Create huey-filesystem/dependencies.d/base 2025-05-28 23:58:21 -04:00
tcely 379d54873b Create huey-database/dependencies.d/base 2025-05-28 23:56:16 -04:00
tcely 730e75e086 Create huey-network/dependencies.d/base 2025-05-28 23:54:11 -04:00
tcely 16ee589ab3 Create huey-net-limited/dependencies.d/base 2025-05-28 23:46:36 -04:00
tcely 482d85768d Create the /config/tasks directory 2025-05-28 22:32:25 -04:00
tcely 8d64a966ff Add more configuration 2025-05-28 22:15:12 -04:00
tcely 261e17954f Add django_huey queues to settings 2025-05-28 21:17:27 -04:00
tcely 15d4a8f4e4 Create huey.py 2025-05-28 21:13:15 -04:00
tcely 0b5a475e03 Ignore indexed data when trying to reuse old metadata 2025-05-28 16:37:57 -04:00
tcely d970733204 Providing the source column is still needed 2025-05-28 12:27:41 -04:00
tcely 595e3479ec Depend on 0033 temporarily 2025-05-28 06:19:41 -04:00
tcely 212f4fb9c7 Create 0035_alter_metadata_unique_together_metadata_source_and_more.py 2025-05-28 06:12:39 -04:00
tcely 7f63c99d5c Remove an unused import 2025-05-28 05:41:47 -04:00
tcely db7cceacc5 Merge pull request #681 from tcely/patch-10
Use `Metadata` table to store Source indexing results
2025-05-28 05:38:06 -04:00
tcely 1927b96fcc Manage the "Checking all media" task better
There is a delay for that task that allows small sources to finish indexing first.

That left us with large indexing tasks and that task running concurrently, which some databases really do not handle well.

Remove the task during indexing and schedule it when indexing has completed.
2025-05-28 05:37:09 -04:00
tcely 2e1b96bb61 Write to the database in batched transactions 2025-05-28 05:16:37 -04:00
tcely 811e36abe0 Do not accept indexing results as media metadata 2025-05-28 01:53:01 -04:00