Commits · ea173167f5568597d2c862f6a5d565dacb2ada87 · TeDomum / matrix-media-repo

Jul 16, 2023
- Re-enable plugins · be16c9eb
  Travis Ralston authored 1 year ago
  
  be16c9eb
Jul 05, 2023
- Remove now-defunct preview controller to clear errors · 1fd3cb31
  Travis Ralston authored 1 year ago
  
  1fd3cb31
- Stop using `github.com/pkg/errors` directly · 45bd5887
  Travis Ralston authored 1 year ago
  
  45bd5887
- Reshuffle url previewers to match thumbnailer structure · 84d31a70
  Travis Ralston authored 1 year ago
  
  84d31a70
- Re-shift some of the previewers · 26bb5220
  Travis Ralston authored 1 year ago
  
  26bb5220
- Stop using terms "whitelist" and "blacklist" · 6031828e
  Travis Ralston authored 1 year ago
  
  6031828e
- Don't append strings for error logging · 562ab861
  Travis Ralston authored 1 year ago
  
  562ab861
- Move URL previewers out of legacy directory · 86243e53
  Travis Ralston authored 1 year ago
  
  86243e53
Jun 11, 2023
- Start preparing for the Great Code Purge · 994f54b1
  Travis Ralston authored 1 year ago
  
  994f54b1
May 28, 2023
- Re-route direct uploads through new pipeline · 987f9cc0
  Travis Ralston authored 1 year ago
  
  For https://github.com/turt2live/matrix-media-repo/issues/411
  987f9cc0
Mar 06, 2023
- Replace deprecated ioutil usage · f32bbbf6
  Travis Ralston authored 2 years ago
  
  f32bbbf6
Feb 15, 2023
- Replace http routing library & update endpoints to match · ab8b9ace
  Travis Ralston authored 2 years ago
  
  ab8b9ace
Feb 12, 2023
- Fix imports · e076e2f7
  Travis Ralston authored 2 years ago
  
  e076e2f7
- Use unique ID generation *everywhere* · 2a2acea5
  Travis Ralston authored 3 years ago
  
  2a2acea5
- Initial clustering support: ID generation service · b22b9e22
  Travis Ralston authored 2 years ago
  
  b22b9e22
- Remove IPFS · 33aa8cad
  Travis Ralston authored 2 years ago
  
  33aa8cad
Aug 17, 2022
- Dependency upgrades round 1 · d9d52085
  Travis Ralston authored 2 years ago
  
  d9d52085
Mar 20, 2022
- Log exceptions relating to temporary object cleanup · f676a9d8
  Travis Ralston authored 3 years ago
  
  f676a9d8
Feb 11, 2022
- Move download cache call to earlier in the download process · 923cd394
  Travis Ralston authored 3 years ago
  
  923cd394
Jan 09, 2022
- Untested patch: Check record hash before transferring in DB · 1d38640d
  Travis Ralston authored 3 years ago
  
  See https://github.com/turt2live/matrix-media-repo/issues/353
  1d38640d
Jan 07, 2022
- Add `urlPreviews.userAgent` config. · 3c79fcd4
  Nick Barrett authored 3 years ago
  
  3c79fcd4
May 04, 2021
- Revert "Early gzip compression work" · 8d05c654
  Travis Ralston authored 3 years ago
  
  This reverts commit 5e51abbd.
  8d05c654
May 03, 2021
- Early gzip compression work · 5e51abbd
  Travis Ralston authored 3 years ago
  
  For https://github.com/turt2live/matrix-media-repo/issues/53
  5e51abbd
Apr 30, 2021
- Fix crashes when workers panic · d6baaf8b
  Travis Ralston authored 3 years ago
  
  This is probably super ugly Go code, but it works.
  d6baaf8b
Mar 18, 2021
- Add optional Sentry support for error reporting · a040a3e5
  Travis Ralston authored 4 years ago
  
  Fixes https://github.com/turt2live/matrix-media-repo/issues/312
  a040a3e5
Mar 17, 2021
- Improve some database handling around downloads · 55ddefb0
  Travis Ralston authored 4 years ago
  
  Fixes https://github.com/turt2live/matrix-media-repo/issues/311
  55ddefb0
Mar 13, 2021
- Add a verify mode to imports · 5561b94f
  Travis Ralston authored 4 years ago
  
  Fixes https://github.com/turt2live/matrix-media-repo/issues/276
  5561b94f
- Improve GDPR imports: end when finished, handle duplicate media · 367ed7e0
  Travis Ralston authored 4 years ago
  
  Fixes https://github.com/turt2live/matrix-media-repo/issues/274 Fixes https://github.com/turt2live/matrix-media-repo/issues/273
  367ed7e0
Mar 08, 2021
- Remove a case of a download causing a second download · 88d712e6
  Travis Ralston authored 4 years ago
  
  88d712e6
- Return filename from remote downloads · 38e80e4b
  Travis Ralston authored 4 years ago
  
  Fixes https://github.com/turt2live/matrix-media-repo/issues/275
  38e80e4b
- Fix photo oEmbed previews · 0d5a5dbf
  Travis Ralston authored 4 years ago
  
  Fixes https://github.com/turt2live/matrix-media-repo/issues/299
  0d5a5dbf
- Fix rich oEmbed previews · 7413cc98
  Travis Ralston authored 4 years ago
  
  Fixes https://github.com/turt2live/matrix-media-repo/issues/296 Fixes https://github.com/turt2live/matrix-media-repo/issues/277
  7413cc98
- Update misc dependencies · 9f403a92
  Travis Ralston authored 4 years ago
  
  9f403a92
Jan 03, 2021
- Add antispam plugin support + OCR example · d38f198b
  Travis Ralston authored 4 years ago
  
  d38f198b
Nov 19, 2020
- fix missing zero-check to disable thumbnailing size limits · a491f259
  Sorunome authored 4 years ago
  
  a491f259
Sep 24, 2020
- Request remote media with r0 instead of v1 · 49a2757a
  Sorunome authored 4 years ago
  
  49a2757a
Aug 17, 2020
- Split caches into distinct structs · 5df7dcfd
  Travis Ralston authored 4 years ago
  
  Fixes https://github.com/turt2live/matrix-media-repo/issues/271 at the same time
  5df7dcfd
Aug 12, 2020

Use a slim memory profile for imports done with gdpr_import · c260888d

Travis Ralston authored 4 years ago

Instead of buffering all the export files into memory (which could be hundreds of gb) we buffer them in one at a time and hope that they don't contain extra information.

On a 171mb export, this change used 45mb of memory at most. Previously the task would have required about 1gb. For larger (200gb+ exports) this is obviously better.

c260888d

Aug 06, 2020
- Add an offline import tool for Synapse · 97e36a23
  Travis Ralston authored 4 years ago
  
  97e36a23
Aug 01, 2020
- Add support for dynamic thumbnails · dabdaece
  Travis Ralston authored 4 years ago
  
  Fixes https://github.com/turt2live/matrix-media-repo/issues/146
  dabdaece