Commit Graph

85 Commits

Author SHA1 Message Date
Charlotte
a416df2aaf fix static file server statistics resetting (#33)
Currently, the static file server will try to reset the statistics about
files served rapidly starting from midnight for about a second.

This removes log spam and a load spike at midnight.
2025-02-06 19:00:20 +01:00
Stanley Dimant
355d34c730 move gauge init into cleanup task 2025-01-14 10:17:00 +01:00
rootdarkarchon
cc89882bbc Add MCDO (#31)
* rudimentary charadata first impl

* update submodule

* update properly

* some fixes etc

* add cascade and some other fixes

* most of charadata impl

* dotnet 9

* net9 and migration to k4os

* bum papi

---------

Co-authored-by: Stanley Dimant <root.darkarchon@outlook.com>
2025-01-11 22:42:55 +01:00
Stanley Dimant
6682e27e4c increase more timeouts 2024-11-22 18:34:36 +01:00
Stanley Dimant
f2ebbd72fe increase cached file provider timeout 2024-11-22 18:33:52 +01:00
Stanley Dimant
3a9f93b157 let file shards register against main or so 2024-11-16 23:02:04 +01:00
Stanley Dimant
33d5f44754 some minor fixes and improvements, probably 2024-11-06 12:51:23 +01:00
Stanley Dimant
c80848fa2e reimplment ReadAsync for BlockFileDataStream/SubStream 2024-11-04 11:51:13 +01:00
Stanley Dimant
433ad32f2b refactor storage cleanup 2024-09-07 14:05:11 +02:00
Stanley Dimant
4fd1ce3d6e add try catch to the initial file rawsize calc 2024-09-06 10:51:52 +02:00
Stanley Dimant
efe7fe98f2 add raw filesize to db 2024-09-04 16:53:05 +02:00
Stanley Dimant
dc33858626 some refactoring 2024-05-06 14:05:24 +02:00
Stanley Dimant
51be5ccd57 allow more time for download tasks in cachedfileprovider 2024-05-04 15:36:09 +02:00
Stanley Dimant
69b5dba901 more queue fixes 2024-05-04 15:31:59 +02:00
Stanley Dimant
6ab27d9698 requeue requests where files are still downloading 2024-05-04 15:21:53 +02:00
Stanley Dimant
761a25c5fc refactor cleanup stuff 2024-05-03 21:54:36 +02:00
Stanley Dimant
fc78031418 limit is double though jksdfjklsdfkl 2024-05-03 19:02:41 +02:00
Stanley Dimant
8284c3c159 fixes for fixes 2024-05-03 16:14:37 +02:00
Stanley Dimant
6e3ff34522 speed up cleanup service 2024-05-03 16:09:37 +02:00
Stanley Dimant
90c9c85498 clean up some code and optinmize cleanup 2024-05-02 16:04:43 +02:00
Stanley Dimant
26866b44fe overwrite times after copying 2024-05-02 15:14:54 +02:00
Stanley Dimant
7221ca0555 access, not write 2024-05-02 15:10:45 +02:00
Stanley Dimant
adafc1dbcf add access times I guess 2024-05-02 15:10:24 +02:00
Stanley Dimant
525fe1df4e add central cold storage options for file servers 2024-05-02 14:03:42 +02:00
Stanley Dimant
ff81b269b8 kms 2024-04-28 12:27:28 +02:00
Stanley Dimant
33df74b037 some fixes maybe 2024-04-28 12:21:24 +02:00
Stanley Dimant
ff4ddef18d fix send ready message service probably 2024-04-28 12:03:11 +02:00
rootdarkarchon
7410c09a4c fix AnyFilesDownloading 2024-03-01 11:17:20 +01:00
rootdarkarchon
68f0b28e9d add some more metrics for files downloading from caches 2024-03-01 11:13:10 +01:00
rootdarkarchon
b5734bdda5 some fixes maybe 2024-02-22 12:36:37 +01:00
rootdarkarchon
ed5274a337 oml 2024-01-18 21:23:24 +01:00
rootdarkarchon
7f04db2c13 flush filestream 2024-01-18 21:17:11 +01:00
rootdarkarchon
9f82f8a25a handle download errors on shards better 2024-01-18 21:00:14 +01:00
rootdarkarchon
79b6dcf646 adjust shard cleanup service too 2024-01-17 01:40:25 +01:00
rootdarkarchon
b4830e9f8a make cleanup check time configurable, add distribution file server address 2024-01-17 01:32:11 +01:00
rootdarkarchon
213fea5d41 set user agent correctly 2024-01-15 12:51:16 +01:00
rootdarkarchon
6eac05e91b refactor file server 2024-01-15 12:26:09 +01:00
rootdarkarchon
c674e4eccd something 2024-01-14 21:41:22 +01:00
rootdarkarchon
1c97fd9150 do not use async for queue processing 2024-01-14 21:24:12 +01:00
rootdarkarchon
c3d674b188 fix queue processing, the third 2024-01-14 12:37:51 +01:00
rootdarkarchon
4d226eb616 fix queue processing, again 2024-01-14 12:34:44 +01:00
rootdarkarchon
024796c459 fix queue processing 2024-01-14 12:32:52 +01:00
rootdarkarchon
a66e93c901 update metrics more often 2024-01-14 12:28:04 +01:00
rootdarkarchon
4c1131a988 break, not return 2024-01-14 12:05:58 +01:00
rootdarkarchon
63286127a2 add alias to jwt, remove caching from auth, remove db usage from files 2024-01-14 11:57:18 +01:00
rootdarkarchon
2c7ff6f73a some file server fixes I guess 2024-01-13 12:08:49 +01:00
rootdarkarchon
3ed4ef454c clean up downloads on shards 2023-12-07 17:28:22 +01:00
rootdarkarchon
df87e45e9c revert chunking on fileservers 2023-11-17 11:12:48 +01:00
rootdarkarchon
b4105f3d01 ok I'm giving up 2023-11-17 01:10:50 +01:00
rootdarkarchon
0b61f3e1d9 why is this such a pain 2023-11-17 01:07:58 +01:00