Commit Graph
100 Commits
Author SHA1 Message Date
tcely fe47e48c43 Link to the Media and use a default site 2025-04-16 06:43:48 -04:00
tcely 029833dff6 Use the related_model manager 2025-04-16 05:49:13 -04:00
tcely 25ff4b64f0 Remove exception logging 2025-04-16 05:23:02 -04:00
tcely f563619425 Remove unneeded white-space 2025-04-16 05:03:24 -04:00
tcely 51261b06fa Use a cleaner exception 2025-04-16 05:00:18 -04:00
tcely d26855eb9e Update 0031_metadata_metadataformat.py 2025-04-16 04:47:14 -04:00
tcely 7c14fa3261 Hard-code the class name 2025-04-16 04:36:13 -04:00
tcely 6062725a79 Ignore the exception when new metadata is missing 2025-04-16 04:28:40 -04:00
tcely 3e0628e4f3 The field is accessed differently now 2025-04-16 03:48:30 -04:00
tcely 89fcfc1c68 Log the exception that is likely causing tests to fail 2025-04-16 03:31:05 -04:00
tcely a0e920f75c Get back to a working state for tests 2025-04-16 03:23:08 -04:00
tcely 2ca1fb72e9 Start using the new metadata models 2025-04-16 01:25:17 -04:00
tcely 623a81acde Be consistent and explicit with the len check 2025-04-14 20:04:10 -04:00
tcely 0317bc4318 Switch the log to debug level 2025-04-14 20:00:15 -04:00
tcely 44a940faee fixup: empty lists should work too 2025-04-14 19:52:44 -04:00
tcely 1d153954bc Try to use invalid values from dumpdata 2025-04-14 19:49:00 -04:00
tcely cb22eb348d Additions from the rest container 2025-04-14 18:12:33 -04:00
tcely debac50ca3 Fix dumpdata output
I want a map of which functions are called,
when they are called,
and from which class they were defined.

These things are still not clear enough for me.
2025-04-14 17:48:37 -04:00
tcely 873a0167ed Support use_chunked_fetch 2025-04-14 09:10:15 -04:00
tcely 465abe23d0 Use qs_gen in tasks.py 2025-04-13 13:30:26 -04:00
tcely 7c293a0444 Avoid UnorderedObjectListWarning 2025-04-13 12:14:36 -04:00
tcely cfceae2eb9 fixup: typo 2025-04-13 11:26:27 -04:00
tcely 950cdbd848 Use django_queryset_generator in cleanup_old_media 2025-04-13 11:24:15 -04:00
tcely 29e94427c9 Fill in the django_queryset_generator function 2025-04-13 11:13:32 -04:00
tcely eb206f9f4d Sketch for django_queryset_generator function 2025-04-13 10:17:09 -04:00
tcely 22dd86bb06 Merge branch 'main' into patch-2 2025-04-13 08:19:34 -04:00
tcely 8a94efda57 Use django.db.reset_queries() in workers 2025-04-13 07:47:52 -04:00
tcely 8e3bfdd3c4 Don't sleep as long when not using the ThreadPool 2025-04-13 05:39:01 -04:00
tcely bb42691d62 Remove all use of the query set iterator function
The `sqlite` driver appears to be fundamentally incompatible with the Django query set `iterator` function.

It only works for the first chunk, then it fails any further database operations because the database is already locked.
2025-04-13 05:05:44 -04:00
tcely 3350c0c2e2 fixup: missed mqs => uuid_qs 2025-04-13 04:43:10 -04:00
tcely fa9446c40e name property uses title column 2025-04-13 04:32:50 -04:00
tcely 71c4d63043 Iterate over independent query sets 2025-04-13 03:53:07 -04:00
tcely 2011918b00 fixup: function definition 2025-04-12 16:46:51 -04:00
tcely 6e27695a62 Add Metadata.ingest_formats function 2025-04-12 16:43:31 -04:00
tcely 533dc453f0 Add a metadata_load function to ingest JSON strings 2025-04-12 15:09:11 -04:00
tcely 7c8c5e2b41 Use Django query set iterator function some more 2025-04-12 12:16:54 -04:00
tcely d4c360eaee Use Django query set iterator function 2025-04-12 10:35:50 -04:00
tcely ef1dd0eba8 Reduce the memory usage 2025-04-12 09:22:25 -04:00
tcely 689ad677c8 Fix indentation for signals.py 2025-04-12 06:36:05 -04:00
tcely 4441f92193 Fix indentation for signals.py 2025-04-12 06:23:56 -04:00
tcely 9421a3e983 Fix the can_download calculation code 2025-04-12 06:20:33 -04:00
tcely c20990fca3 Do not call resize_image_to_height on smaller images 2025-04-12 04:41:38 -04:00
tcely ee00cffd76 Try refresh_formats for NoFormatException 2025-04-12 03:27:17 -04:00
tcely 64e4fca707 Update 0031_metadata_metadataformat.py 2025-04-11 05:59:41 -04:00
tcely 74107e15e9 Update 0031_metadata_metadataformat.py 2025-04-11 05:56:37 -04:00
tcely 9bf84efb16 Add JSONEncoder for all iterable objects 2025-04-11 05:50:04 -04:00
tcely 26dc67503d Create 0031_metadata_metadataformat.py 2025-04-11 03:44:58 -04:00
tcely 7ddb0285c1 Merge branch 'meeb:main' into new-tables 2025-04-11 03:31:32 -04:00
tcely 5081348225 Added the basic columns for metadata and formats 2025-04-11 03:18:43 -04:00
tcely 81dbb8f834 Remove BACKGROUND_TASK_ASYNC_THREADS adjustment 2025-04-11 01:13:48 -04:00
tcely ba63cece20 Revert changes to README.md 2025-04-11 01:08:00 -04:00
tcely 75e5f96b34 Merge branch 'meeb:main' into patch-2 2025-04-11 01:06:22 -04:00
tcely 4c6b4e3c73 Update README.md 2025-04-11 01:02:49 -04:00
tcely 117e7c2eef 3.9 is a better minimum Python version
The parser change and a few other things mean that compatibility with `3.8` is unlikely to last much longer.
2025-04-11 00:58:45 -04:00
tcely 47107489fd Merge branch 'main' into delete-source-reworked 2025-04-11 00:13:45 -04:00
tcely 580a77a5c8 Only hide warnings when using https
When not verifying certificates and using `https` we want to hide warnings about the certificate.

Otherwise, we want to not hide anything.
2025-04-10 19:01:03 -04:00
tcely d41acf40d0 Merge branch 'main' into tcely-media-servers-make_request 2025-04-10 16:05:42 -04:00
tcely 91c7608ea2 Set executable bit 2025-04-10 14:46:23 -04:00
tcely edd3c2767a Nicer formatting for the output 2025-04-10 14:44:25 -04:00
tcely 66d8d5eec9 dash is happy when we use expr 2025-04-10 14:24:23 -04:00
tcely b03a1a3623 Time and report on the s6-svc command 2025-04-10 13:45:30 -04:00
tcely 09fea17791 Resolve paths for me from service names 2025-04-10 13:30:17 -04:00
tcely 19f277e628 Create restart_services.sh 2025-04-10 13:07:13 -04:00
tcely f4aef97e17 POST to /Items/{ID}/Refresh 2025-04-09 23:05:53 -04:00
tcely cf3630f78b Merge branch 'meeb:main' into tcely-media-servers-make_request 2025-04-09 18:42:23 -04:00
tcely 40144a8400 Import the check_source_directory_exists task 2025-04-09 18:41:03 -04:00
tcely a1fa823b18 POST to /Items/{ID}/Refresh 2025-04-09 17:18:23 -04:00
tcely d5e5881334 fixup: missed one refesh_formats 2025-04-09 03:45:44 -04:00
tcely 8816ba3af0 refesh_formats => refresh_formats 2025-04-09 03:41:13 -04:00
tcely 5b53621360 Use the refesh_formats task instead of the function 2025-04-09 03:28:53 -04:00
tcely 3b0ecf29be Move refesh_formats to last position in the NET queue 2025-04-09 02:51:57 -04:00
tcely a62b64c3ee Adjust FS tasks
Move thumbnail download from NET to FS.
It does use the network, but not with `yt_dlp` and not in a way that YouTube cares about.
2025-04-09 02:42:30 -04:00
tcely 8bcb5cafdb Remove unnecessary kwargs 2025-04-09 02:12:41 -04:00
tcely 60ce61bfd8 Increase minor version 2025-04-09 00:41:57 -04:00
tcely 6278030a9b Check source directory when tasks were reset 2025-04-09 00:10:26 -04:00
tcely c145987b0f Use distinct transactions 2025-04-09 00:04:08 -04:00
tcely 7a0fdd16cd Remove unused media_post_delete 2025-04-08 21:11:08 -04:00
tcely aa78c7309e Use a single Val call 2025-04-08 20:13:20 -04:00
tcely e394232b15 Use a set of audio-only extensions 2025-04-08 20:10:55 -04:00
tcely 55f55e7305 Extract audio from webm downloads 2025-04-08 20:01:20 -04:00
tcely 15b8d4b83f Add warning to the dashboard 2025-04-08 17:31:20 -04:00
tcely c7b9e26ab0 Add file renaming warning to README.md 2025-04-08 16:52:46 -04:00
tcely 033656b436 Be consistent in the task also 2025-04-08 16:23:48 -04:00
tcely afe0a75824 Handle None returned by getattr 2025-04-08 16:21:01 -04:00
tcely 30633b1aba Update README.md 2025-04-08 16:10:07 -04:00
tcely e01d155b10 Switch to getattr 2025-04-08 15:55:24 -04:00
tcely 48bca2b996 Enable the ThreadPool when TUBESYNC_WORKERS is used 2025-04-08 14:45:44 -04:00
tcely e12aa28a2b Adjusting BACKGROUND_TASK_ASYNC_THREADS is no longer needed 2025-04-08 14:33:14 -04:00
tcely 045bfcbfd6 Add a random offset to the sleep value 2025-04-08 14:22:09 -04:00
tcely 0011a4ef55 Add a random offset to the sleep value 2025-04-08 14:20:59 -04:00
tcely d77ca0f7cc Add a random offset to the sleep value 2025-04-08 14:19:38 -04:00
tcely 7b081a7aaf Relaunch the filesystem worker after 12 hours 2025-04-08 14:14:42 -04:00
tcely 784acae83a Relaunch the database worker after 24 hours 2025-04-08 14:10:03 -04:00
tcely 738fca1200 Relaunch the network worker after 12 hours 2025-04-08 14:01:53 -04:00
tcely b0a72cf1fb Set verbose_name for refesh_formats task 2025-04-08 02:08:48 -04:00
tcely 4d16994062 Stop increasing the minimum sleep 2025-04-07 17:28:54 -04:00
tcely c72a9c8584 Use a task per instance for Media.refresh_formats 2025-04-07 17:20:26 -04:00
tcely 456eadd35e Add files via upload 2025-04-07 14:35:39 -04:00
tcely 3549bbf9f6 Merge branch 'meeb:main' into patch-10 2025-04-07 06:19:29 -04:00
tcely 2c41a90695 Migrate old tasks to the new queues 2025-04-07 03:57:31 -04:00