Commit Graph
1113 Commits
Author SHA1 Message Date
tcely 0f986949e5 Have filter_response return a copy, if requested 2025-01-09 13:36:43 -05:00
tcely 29c39aab1f Add SHRINK_NEW_MEDIA_METADATA setting 2025-01-09 13:20:22 -05:00
tcely 3e3f80d287 More filter_response asserts 2025-01-09 12:04:01 -05:00
tcely 4c9fa40bb0 More filter_response asserts 2025-01-09 11:47:10 -05:00
meeb b829b233f8 Merge pull request #615 from tcely/patch-5
Test and log ffmpeg version output earlier
2025-01-10 02:20:47 +11:00
meeb ee5f611592 Merge pull request #614 from tcely/patch-4
Make better use of CPU cache with nginx
2025-01-10 02:19:49 +11:00
meeb 1b1fc67984 Merge pull request #613 from tcely/patch-1
exec nginx so bash isn't still running
2025-01-10 02:18:13 +11:00
tcely 682a53da34 Add a filter_response test
First, only check that changes did happen.
2025-01-09 10:17:37 -05:00
tcely 100382f66f Rename compact_data to compact_json
This was misleading because the data dict becomes a JSON string.
2025-01-09 09:28:58 -05:00
tcely ad10bcfa61 Log both compacted and reduced sizes 2025-01-08 22:48:23 -05:00
tcely d35f52f8ac Drop /expire/ URLs from automatic_captions too 2025-01-08 11:31:23 -05:00
tcely 7b42213bbb Keep curl and add less
These are very useful when using the shell inside the container and don't use much space.
2025-01-08 00:36:37 -05:00
tcely f0b7d31949 Test and log ffmpeg version output earlier
Running the ffmpeg in an earlier (hopefully cached) layer should clean up the logs a bit.

On a related note, shadowing the environment variable was causing some confusing log output, so stop doing that as well.
2025-01-08 00:31:30 -05:00
tcely ab5e63f643 Make better use of CPU cache with nginx 2025-01-08 00:12:21 -05:00
tcely 6e116899a7 We don't need to keep bash running 2025-01-07 23:45:25 -05:00
tcely 1c432ccce1 Some formats are using a different URL 2025-01-07 13:49:58 -05:00
tcely 7793701228 Simplify results from _url_keys
Also, name the tuple values when using the results.
2025-01-07 13:01:06 -05:00
tcely 8ac5b36eee Use the exception function for traceback 2025-01-07 06:38:56 -05:00
tcely 2d85bcbe14 Use a distinct try to log errors 2025-01-07 06:20:01 -05:00
tcely c7457e94ac Check that the drop_key exists 2025-01-07 05:58:50 -05:00
tcely 7b8d11791d Drop keys from formats that cannot be useful 2025-01-07 05:39:50 -05:00
tcely 431de2e0df Loop over a set of keys for each URL type 2025-01-07 04:11:14 -05:00
tcely db25fa8029 Adjusted comment 2025-01-07 03:35:58 -05:00
tcely 9a4101a0a1 Fix formatting 2025-01-07 03:18:39 -05:00
tcely 2f34fff713 Fixes from testing
The `automatic_captions` has a layer for language codes that I didn't account for.

The type checking was copied and I didn't adjust for the arguments in this function.
2025-01-07 02:55:05 -05:00
tcely 25d2ff6802 Don't reduce the actual data yet 2025-01-07 02:12:22 -05:00
tcely ca75398548 Merge branch 'meeb:main' into filter-metadata-response 2025-01-07 01:35:13 -05:00
tcely 8c31720bf7 Log the reduction of metadata length 2025-01-07 01:33:06 -05:00
tcely 63fa97cc58 More compact JSON
The software doesn't need an extra space per key.
2025-01-07 00:43:59 -05:00
meeb f6e557f502 Merge pull request #611 from tcely/patch-1
Don't chmod a+r when it already has those permissions
2025-01-07 16:41:35 +11:00
tcely 8c22b6c99e Add response filtering
These functions aren't being used yet, they will be tested against my database before that happens.
2025-01-07 00:05:57 -05:00
tcely 215aa64f2d Change to a logged warning for NFO permission problems 2025-01-06 10:35:37 -05:00
tcely e64f71a970 Don't chmod a+r when it already has those permissions 2025-01-06 10:23:17 -05:00
meeb 25bc6143e0 Merge pull request #610 from tcely/patch-1
Match another variation of the message
2025-01-03 01:48:43 +11:00
tcely 59865a885b Match another variation of the message
```
{key}: This video is available to this channel's members on level: Level 2: Contributor (or any higher level). Join this YouTube channel from your computer or Android app.
```
2025-01-02 02:39:19 -05:00
tcely bc02f241a1 Merge branch 'main' into patch-3 2024-12-26 01:17:21 -05:00
tcely fbcd01fe6c Merge branch 'main' into rename-files-with-source-format-issue-185 2024-12-26 01:08:23 -05:00
meeb e2f2a7bb49 Merge pull request #595 from tcely/patch-7
Do not try to skip already skipped media
2024-12-26 12:56:40 +11:00
meeb b40564ff93 Merge pull request #596 from tcely/patch-8
Reduce image size and keep pycache in a volume
2024-12-26 12:44:42 +11:00
meeb 4248824332 Merge pull request #599 from tcely/patch-4
Fix paths for when filename includes sub-directories
2024-12-26 12:43:16 +11:00
meeb 3b3203c7f1 Merge pull request #591 from tcely/patch-5
Handle raise_no_formats exception
2024-12-26 12:42:10 +11:00
meeb 76ac432e53 Merge pull request #593 from RichardHyde/handle_member_only_videos
Handle download_media_metadata task failures
2024-12-26 12:40:45 +11:00
meeb 417675c1ea Merge pull request #597 from tcely/patch-1
Update ci.yaml
2024-12-26 12:30:53 +11:00
meeb 083467296e Merge pull request #601 from tcely/patch-9
Only log new media
2024-12-26 12:29:26 +11:00
tcely d74e6bf2ca Avoid the unlikely possibility of None comparison 2024-12-25 20:16:07 -05:00
meeb 5774e6dfc6 Merge pull request #604 from tcely/patch-12
Use title from DB
2024-12-26 12:05:46 +11:00
meeb e38709809e Merge pull request #606 from tcely/patch-15
Made messages more human friendly
2024-12-26 11:59:53 +11:00
meeb 37b303ecec Merge pull request #605 from tcely/patch-14
Cleanup removed media that has not been downloaded too
2024-12-26 11:59:12 +11:00
meeb c08619cd87 Merge pull request #602 from tcely/patch-10
Remove duplicated ' to:'
2024-12-26 11:57:30 +11:00
meeb 2591e384b4 Merge pull request #600 from tcely/patch-6
Do not log download progress lines by default
2024-12-26 11:56:59 +11:00