14 Commits

Author SHA1 Message Date
Kegan Dougal
37aa1469a5 WIP: use complement libraries 2023-10-11 12:23:46 +01:00
David Robertson
13256d9393
Extra test case 2023-08-16 17:02:29 +01:00
David Robertson
fac67e43a4
Simpler test 2023-04-03 20:24:45 +01:00
David Robertson
fc26d232dd
Fix room indices 2023-04-03 20:13:40 +01:00
David Robertson
0ff7ff0b42
Test 2 2023-04-03 13:56:38 +01:00
David Robertson
3a44187245
Test case 1 2023-04-03 12:50:14 +01:00
David Robertson
0de818a796
s/Enabled/Core/g 2023-03-28 13:53:57 +01:00
Kegan Dougal
66a010f249 extensions refactor: handle processing extensions in the same way
This allows us to automatically trace and automatically process only
enabled extensions. Live update code will be modified to use the same
code paths.
2023-02-08 12:58:52 +00:00
Kegan Dougal
05ddb6812b extensions refactor: automatically handle the enabled flag
Part of a series of refactors on the extensions code.
2023-02-08 11:30:54 +00:00
Kegan Dougal
aa28df161c Rename package -> github.com/matrix-org/sliding-sync 2022-12-15 11:08:50 +00:00
Kegan Dougal
3070292fba Fix failing receipts test; use a newer synapse version 2022-12-15 10:11:46 +00:00
Kegan Dougal
a978810625 Sad timeouts are sad 2022-12-14 19:11:07 +00:00
Kegan Dougal
42e34b9ead Race condition on private receipts 2022-12-14 19:04:10 +00:00
Kegan Dougal
be8543a21a add extensions for typing and receipts; bugfixes and additional perf improvements
Features:
 - Add `typing` extension.
 - Add `receipts` extension.
 - Add comprehensive prometheus `/metrics` activated via `SYNCV3_PROM`.
 - Add `SYNCV3_PPROF` support.
 - Add `by_notification_level` sort order.
 - Add `include_old_rooms` support.
 - Add support for `$ME` and `$LAZY`.
 - Add correct filtering when `*,*` is used as `required_state`.
 - Add `num_live` to each room response to indicate how many timeline entries are live.

Bug fixes:
 - Use a stricter comparison function on ranges: fixes an issue whereby UTs fail on go1.19 due to change in sorting algorithm.
 - Send back an `errcode` on HTTP errors (e.g expired sessions).
 - Remove `unsigned.txn_id` on insertion into the DB. Otherwise other users would see other users txn IDs :(
 - Improve range delta algorithm: previously it didn't handle cases like `[0,20] -> [20,30]` and would panic.
 - Send HTTP 400 for invalid range requests.
 - Don't publish no-op unread counts which just adds extra noise.
 - Fix leaking DB connections which could eventually consume all available connections.
 - Ensure we always unblock WaitUntilInitialSync even on invalid access tokens. Other code relies on WaitUntilInitialSync() actually returning at _some_ point e.g on startup we have N workers which bound the number of concurrent pollers made at any one time, we need to not just hog a worker forever.

Improvements:
 - Greatly improve startup times of sync3 handlers by improving `JoinedRoomsTracker`: a modest amount of data would take ~28s to create the handler, now it takes 4s.
 - Massively improve initial initial v3 sync times, by refactoring `JoinedRoomsTracker`, from ~47s to <1s.
 - Add `SlidingSyncUntil...` in tests to reduce races.
 - Tweak the API shape of JoinedUsersForRoom to reduce state block processing time for large rooms from 63s to 39s.
 - Add trace task for initial syncs.
 - Include the proxy version in UA strings.
 - HTTP errors now wait 1s before returning to stop clients tight-looping on error.
 - Pending event buffer is now 2000.
 - Index the room ID first to cull the most events when returning timeline entries. Speeds up `SelectLatestEventsBetween` by a factor of 8.
 - Remove cancelled `m.room_key_requests` from the to-device inbox. Cuts down the amount of events in the inbox by ~94% for very large (20k+) inboxes, ~50% for moderate sized (200 events) inboxes. Adds book-keeping to remember the unacked to-device position for each client.
2022-12-14 18:53:55 +00:00