add streaming body to requests and responses #3

Merged

lx merged 64 commits from stream-body into main 2022-09-13 10:56:54 +00:00

Conversation 0 Commits 64 Files changed 22 +1854 -636

lx commented 2022-07-21 19:01:34 +00:00

Owner

Copy link

No description provided.

lx added 13 commits 2022-07-21 19:01:34 +00:00

initial work on associated stream ... 368ba90879

still require testing, and fixing a few kinks:
- sending packets > 16k truncate them
- send one more packet than it could at eos
- probably update documentation

/!\ contains breaking changes

rechunk stream fb5462ecdb

further work on streams ... 4745e7c4ba

most changes still required are related to error handling

wait for any ready stream instead of the highest priority one 5d7541e13a

start supporting sending error on stream 0fec85b47a

use a framing protocol instead of even/odd channel d3d18b8e8b

add detection of premature eos cdff8ae1be

Move things around f35fa7d18d

Refactor send.rs 9dffa812c4

Use Bytes instead of Vec<u8> 26989bba14

Rename AutoSerialize into SimpleMessage and refactor a bit 44bbc1c00c

One possibility, but I don't like it 7d148c7e76

Propose alternative API 4934ed726d

lx added 1 commit 2022-07-22 08:55:59 +00:00

Hide streaming versions as much as possible c358fe3c92

lx added 1 commit 2022-07-22 10:45:51 +00:00

Clean up framing protocol 0b71ca12f9

lx added 1 commit 2022-07-22 11:02:06 +00:00

Use bounded channels on receive side for backpressure 9cb28c21b4

lx added 1 commit 2022-07-22 11:06:21 +00:00

Move things around and fix error bit 5da59ebec5

lx added 1 commit 2022-07-22 11:23:50 +00:00

Simplify send.rs f9db9a4b69

lx added 1 commit 2022-07-22 11:28:02 +00:00

Add comment 50627c2060

lx added 1 commit 2022-07-22 11:32:14 +00:00

Small optimization b9df442f03

lx added 1 commit 2022-07-22 11:40:14 +00:00

Add Resp::into_parts 67ea3a48fa

lx added 1 commit 2022-07-22 11:45:05 +00:00

Terminology: don't use the word "body" anymore, talk of "attached stream" aa1b29d41a

lx added 1 commit 2022-07-22 11:48:52 +00:00

Cargo fmt; better adapt with_capacity_values 50358b944a

lx added 1 commit 2022-07-22 12:38:20 +00:00

Remove copy of serialized thing in encode 4825669293

lx added 1 commit 2022-07-22 12:45:36 +00:00

Impose static lifetime on message and response cbc21e40ac

lx added 1 commit 2022-07-22 13:17:00 +00:00

Add Req::new a0dac87e3b

lx added 1 commit 2022-07-22 13:23:54 +00:00

Bump netapp version to 0.5 a5e5fd0408

lx added 1 commit 2022-07-22 14:43:02 +00:00

Conversion between ByteStream and AsyncRead ab80ade4f0

lx added 1 commit 2022-07-25 08:59:09 +00:00

Remove blocking_send that crashes fed0542313

lx added 1 commit 2022-07-25 09:06:57 +00:00

Remove broken test c17a5f84ff

lx added 1 commit 2022-07-25 09:07:28 +00:00

Cargo fmt 7499721a10

lx added 1 commit 2022-07-25 13:05:03 +00:00

Add some debugging 74e57016f6

lx added 1 commit 2022-07-26 10:01:25 +00:00

Add stream example to fullmesh example bdf7d4731d

lx added 1 commit 2022-07-26 10:12:03 +00:00

Fix things going wrong when sending chan is closed b55f61c38b

lx force-pushed stream-body from 9f0474de1c to b55f61c38b 2022-08-31 17:26:37 +00:00 Compare

lx added 1 commit 2022-08-31 20:19:52 +00:00

Remove useless phantom and pub(crate) 2c9d595da0

lx added 1 commit 2022-09-01 07:45:39 +00:00

recv side: use unbounded channel to remove deadlock 3fd30c6e28

lx added 1 commit 2022-09-01 08:29:46 +00:00

Refactor: create a BytesBuf utility crate (will also be usefull in Garage) 263db66fce

lx added 1 commit 2022-09-01 09:21:35 +00:00

Stream errors are now std::io::Error 7909a95d3c

lx added 1 commit 2022-09-01 09:35:04 +00:00

Also encode errorkind in stream 745c786184

lx added 1 commit 2022-09-01 10:16:04 +00:00

Add OrderTag to Req and Resp, refactor errors cd203f5708

lx added 1 commit 2022-09-01 10:46:43 +00:00

Add actual support for order tag 4a59b73d7b

lx added 7 commits 2022-09-01 12:23:17 +00:00

Ping less frequently 81b2ff3a4e

Add dump of sending queue 700f783956

add debug_name in proto to differenciate messages 01db3c4319

Better messages in proto.rs 984ba65e65

Be more lenient on pings 7703659742

SVR -> SRV d75146fb81

Merge branch 'fix-ping' into stream-body 22d96929d5

lx added 2 commits 2022-09-01 13:54:20 +00:00

fix trace message 3292566738

Implement request cancellation 522f420e2b

lx added 1 commit 2022-09-01 14:02:00 +00:00

try debug b931d0d1cf

lx force-pushed stream-body from 5b8306e789 to b82ad70dd5 2022-09-01 14:11:47 +00:00 Compare

lx added 1 commit 2022-09-01 14:13:49 +00:00

less verbosity f6ad1d0fab

lx added 2 commits 2022-09-02 12:15:17 +00:00

Merge branch 'main' into fix-ping c865cc9f9c

Merge branch 'fix-ping' into stream-body 9bf29a7a18

lx added 1 commit 2022-09-02 12:24:48 +00:00

Merge branch 'main' into stream-body 5af23955af

lx added 1 commit 2022-09-06 17:43:14 +00:00

Implement Least Attained First scheduling of streams 0f799a7768

lx added 1 commit 2022-09-12 15:19:35 +00:00

slightly change example f0326607ee

lx added 1 commit 2022-09-12 15:20:53 +00:00

reword doc comment 8a7aca9837

lx added 1 commit 2022-09-12 15:43:18 +00:00

Add documentation f022a77f97

lx added 1 commit 2022-09-13 09:31:36 +00:00

Use BytesMut instead of Vec<u8> in bytes_buf (extend is probably faster) 2305c2cf03

lx added 1 commit 2022-09-13 09:51:13 +00:00

try make more like before bf0e82047f

lx added 1 commit 2022-09-13 09:52:39 +00:00

fix comment add2b54743

lx added 1 commit 2022-09-13 10:05:55 +00:00

Add comment on cancellation db96af2609

lx added 1 commit 2022-09-13 10:08:44 +00:00

fill_buffer do something only if buf is empty 9362d26890

lx added 1 commit 2022-09-13 10:13:05 +00:00

No longer need to derive Clone on message types 8ab6256c3b

lx added 1 commit 2022-09-13 10:20:58 +00:00

add precision to protocol description 18d5abc981

lx added 1 commit 2022-09-13 10:25:44 +00:00

Uniformize flag naming c00676feba

lx added 1 commit 2022-09-13 10:28:16 +00:00

Missing cleanup b509e6057f

lx force-pushed stream-body from 3f4a4f59cf to 395f942fc7 2022-09-13 10:37:59 +00:00 Compare

lx added 1 commit 2022-09-13 10:49:06 +00:00

undo needless change 298e956a19

lx changed title from WIP: add streaming body to requests and responses to add streaming body to requests and responses 2022-09-13 10:56:46 +00:00

lx merged commit 8ac109e3a8 into main 2022-09-13 10:56:54 +00:00

lx referenced this pull request from a commit 2022-09-13 10:56:54 +00:00

Merge pull request 'add streaming body to requests and responses' (#3) from stream-body into main

Sign in to join this conversation.

Reviewers

No reviewers

Labels

Clear labels

No items

No labels

Milestone

Clear milestone

No items

No milestone

Projects

Clear projects

No items

No project

Assignees

Clear assignees

No assignees

1 participant

Notifications

Subscribe

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference: lx/netapp#3

No description provided.