Commit Graph
100 Commits
Author SHA1 Message Date
tcely c12662d85b Merge branch 'meeb:main' into patch-6 2025-04-19 13:03:08 -04:00
tcely eee233962b Remove extra white-space 2025-04-19 11:47:12 -04:00
tcely 1c9ef93ec9 Remove created condition 2025-04-18 21:03:23 -04:00
tcely 60ffc4cdc8 Use Media.has_metadata in Media.save function 2025-04-18 19:58:29 -04:00
tcely 5516cad86b Search by Media.uuid on metadata tables 2025-04-17 23:37:09 -04:00
tcely 934e4c9fcb Adjust admin displays 2025-04-17 22:57:56 -04:00
tcely c46d044c51 Add new models to admin.py 2025-04-17 22:02:37 -04:00
tcely 45dba712c5 Remove extra white-space 2025-04-17 21:23:33 -04:00
tcely 8ec35292b9 Don't modify the original metadata yet
I've lost some metadata during testing because of deleting the new `Metadata` instances without restoring the original metadata JSON.
2025-04-17 20:24:01 -04:00
tcely b4d7f01975 Merge branch 'meeb:main' into patch-6 2025-04-17 18:34:53 -04:00
tcely 970e8c9a60 Adjustments for the perl-base upgrade 2025-04-17 15:43:36 -04:00
tcely 083e29a189 Save a step for test branches 2025-04-17 15:37:55 -04:00
tcely 8fe43170a4 Debian on arm is armhf
Not that we are likely to use this,  but I figured this out, and it costs nothing to leave a case here.
2025-04-17 15:32:14 -04:00
tcely a6fea90720 Remove a raw value
For now, `file_ext` has the same value as,
`CHECKSUM_ALGORITHM`,
but I used another variable to make changing it easier.
2025-04-17 15:28:20 -04:00
tcely 624406eb27 Add /etc/apt/apt.conf.d/docker-disable-pkgcache 2025-04-17 14:41:21 -04:00
tcely a1495d27f0 Update local_settings.py.container 2025-04-17 12:45:49 -04:00
tcely 142e93500f Use the db import for reset_queries 2025-04-17 03:31:10 -04:00
tcely 134231fda7 Use the new setting 2025-04-17 03:27:17 -04:00
tcely 035eeea54c Add SQLITE_DELAY_FLOAT setting 2025-04-17 03:24:05 -04:00
tcely b1e7f0eed2 Be explicit about not using durable with atomic 2025-04-17 03:11:14 -04:00
tcely 3b5c776634 Do not interfere with the exception handling 2025-04-17 03:06:17 -04:00
tcely 4bf975bf92 Move the SQLite case to the end of the function 2025-04-17 03:03:00 -04:00
tcely 09969afa6e Import and set the variable 2025-04-17 02:53:46 -04:00
tcely d60a159af7 Add delay for SQLite to allow for more interleaving 2025-04-17 02:48:46 -04:00
tcely 5e4dfa158a Merge branch 'main' into patch-3 2025-04-17 02:37:27 -04:00
tcely 2ef653a29a Update 0031_metadata_metadataformat.py 2025-04-16 15:56:44 -04:00
tcely 44b92643eb Index on site & key 2025-04-16 15:40:45 -04:00
tcely 4777b85113 Indentation 2025-04-16 15:17:33 -04:00
tcely 47a3220c42 Invalidate the cached metadata 2025-04-16 07:57:38 -04:00
tcely 24db1f072d Disable parent_link 2025-04-16 07:17:31 -04:00
tcely baedb192f4 Update 0031_metadata_metadataformat.py 2025-04-16 07:16:17 -04:00
tcely 9d94729583 Handle assertion errors 2025-04-16 07:09:48 -04:00
tcely fe47e48c43 Link to the Media and use a default site 2025-04-16 06:43:48 -04:00
tcely 029833dff6 Use the related_model manager 2025-04-16 05:49:13 -04:00
tcely 25ff4b64f0 Remove exception logging 2025-04-16 05:23:02 -04:00
tcely f563619425 Remove unneeded white-space 2025-04-16 05:03:24 -04:00
tcely 51261b06fa Use a cleaner exception 2025-04-16 05:00:18 -04:00
tcely d26855eb9e Update 0031_metadata_metadataformat.py 2025-04-16 04:47:14 -04:00
tcely 7c14fa3261 Hard-code the class name 2025-04-16 04:36:13 -04:00
tcely 6062725a79 Ignore the exception when new metadata is missing 2025-04-16 04:28:40 -04:00
tcely 3e0628e4f3 The field is accessed differently now 2025-04-16 03:48:30 -04:00
tcely 89fcfc1c68 Log the exception that is likely causing tests to fail 2025-04-16 03:31:05 -04:00
tcely a0e920f75c Get back to a working state for tests 2025-04-16 03:23:08 -04:00
tcely 2a5bf30ab6 Adjust the relative link in README.md 2025-04-16 02:36:43 -04:00
tcely 2ca1fb72e9 Start using the new metadata models 2025-04-16 01:25:17 -04:00
tcely cf51901bee Link to settings.py 2025-04-15 17:55:45 -04:00
tcely 7fd87fbb89 Mention settings.py setting 2025-04-15 17:51:53 -04:00
tcely 57b7502a7b Update README.md
Link to the environment variable anchor.
2025-04-15 17:47:52 -04:00
tcely 623a81acde Be consistent and explicit with the len check 2025-04-14 20:04:10 -04:00
tcely 0317bc4318 Switch the log to debug level 2025-04-14 20:00:15 -04:00
tcely 44a940faee fixup: empty lists should work too 2025-04-14 19:52:44 -04:00
tcely 1d153954bc Try to use invalid values from dumpdata 2025-04-14 19:49:00 -04:00
tcely cb22eb348d Additions from the rest container 2025-04-14 18:12:33 -04:00
tcely debac50ca3 Fix dumpdata output
I want a map of which functions are called,
when they are called,
and from which class they were defined.

These things are still not clear enough for me.
2025-04-14 17:48:37 -04:00
tcely 873a0167ed Support use_chunked_fetch 2025-04-14 09:10:15 -04:00
tcely 465abe23d0 Use qs_gen in tasks.py 2025-04-13 13:30:26 -04:00
tcely 7c293a0444 Avoid UnorderedObjectListWarning 2025-04-13 12:14:36 -04:00
tcely cfceae2eb9 fixup: typo 2025-04-13 11:26:27 -04:00
tcely 950cdbd848 Use django_queryset_generator in cleanup_old_media 2025-04-13 11:24:15 -04:00
tcely 29e94427c9 Fill in the django_queryset_generator function 2025-04-13 11:13:32 -04:00
tcely eb206f9f4d Sketch for django_queryset_generator function 2025-04-13 10:17:09 -04:00
tcely 7d33cd8579 Merge branch 'main' into patch-3 2025-04-13 08:30:11 -04:00
tcely 22dd86bb06 Merge branch 'main' into patch-2 2025-04-13 08:19:34 -04:00
tcely 8a94efda57 Use django.db.reset_queries() in workers 2025-04-13 07:47:52 -04:00
tcely 8e3bfdd3c4 Don't sleep as long when not using the ThreadPool 2025-04-13 05:39:01 -04:00
tcely bb42691d62 Remove all use of the query set iterator function
The `sqlite` driver appears to be fundamentally incompatible with the Django query set `iterator` function.

It only works for the first chunk, then it fails any further database operations because the database is already locked.
2025-04-13 05:05:44 -04:00
tcely 3350c0c2e2 fixup: missed mqs => uuid_qs 2025-04-13 04:43:10 -04:00
tcely fa9446c40e name property uses title column 2025-04-13 04:32:50 -04:00
tcely 71c4d63043 Iterate over independent query sets 2025-04-13 03:53:07 -04:00
tcely 2011918b00 fixup: function definition 2025-04-12 16:46:51 -04:00
tcely 6e27695a62 Add Metadata.ingest_formats function 2025-04-12 16:43:31 -04:00
tcely 533dc453f0 Add a metadata_load function to ingest JSON strings 2025-04-12 15:09:11 -04:00
tcely 7c8c5e2b41 Use Django query set iterator function some more 2025-04-12 12:16:54 -04:00
tcely d4c360eaee Use Django query set iterator function 2025-04-12 10:35:50 -04:00
tcely ef1dd0eba8 Reduce the memory usage 2025-04-12 09:22:25 -04:00
tcely 689ad677c8 Fix indentation for signals.py 2025-04-12 06:36:05 -04:00
tcely 4441f92193 Fix indentation for signals.py 2025-04-12 06:23:56 -04:00
tcely 9421a3e983 Fix the can_download calculation code 2025-04-12 06:20:33 -04:00
tcely c20990fca3 Do not call resize_image_to_height on smaller images 2025-04-12 04:41:38 -04:00
tcely ee00cffd76 Try refresh_formats for NoFormatException 2025-04-12 03:27:17 -04:00
tcely 64e4fca707 Update 0031_metadata_metadataformat.py 2025-04-11 05:59:41 -04:00
tcely 74107e15e9 Update 0031_metadata_metadataformat.py 2025-04-11 05:56:37 -04:00
tcely 9bf84efb16 Add JSONEncoder for all iterable objects 2025-04-11 05:50:04 -04:00
tcely 26dc67503d Create 0031_metadata_metadataformat.py 2025-04-11 03:44:58 -04:00
tcely 7ddb0285c1 Merge branch 'meeb:main' into new-tables 2025-04-11 03:31:32 -04:00
tcely 5081348225 Added the basic columns for metadata and formats 2025-04-11 03:18:43 -04:00
tcely 81dbb8f834 Remove BACKGROUND_TASK_ASYNC_THREADS adjustment 2025-04-11 01:13:48 -04:00
tcely ba63cece20 Revert changes to README.md 2025-04-11 01:08:00 -04:00
tcely 75e5f96b34 Merge branch 'meeb:main' into patch-2 2025-04-11 01:06:22 -04:00
tcely 4c6b4e3c73 Update README.md 2025-04-11 01:02:49 -04:00
tcely 117e7c2eef 3.9 is a better minimum Python version
The parser change and a few other things mean that compatibility with `3.8` is unlikely to last much longer.
2025-04-11 00:58:45 -04:00
tcely 47107489fd Merge branch 'main' into delete-source-reworked 2025-04-11 00:13:45 -04:00
tcely 580a77a5c8 Only hide warnings when using https
When not verifying certificates and using `https` we want to hide warnings about the certificate.

Otherwise, we want to not hide anything.
2025-04-10 19:01:03 -04:00
tcely d41acf40d0 Merge branch 'main' into tcely-media-servers-make_request 2025-04-10 16:05:42 -04:00
tcely 91c7608ea2 Set executable bit 2025-04-10 14:46:23 -04:00
tcely edd3c2767a Nicer formatting for the output 2025-04-10 14:44:25 -04:00
tcely 66d8d5eec9 dash is happy when we use expr 2025-04-10 14:24:23 -04:00
tcely b03a1a3623 Time and report on the s6-svc command 2025-04-10 13:45:30 -04:00
tcely 09fea17791 Resolve paths for me from service names 2025-04-10 13:30:17 -04:00
tcely 19f277e628 Create restart_services.sh 2025-04-10 13:07:13 -04:00