add streaming body to requests and responses #3

Merged

lx merged 64 commits from stream-body into main 2022-09-13 10:56:54 +00:00

Conversation 0 Commits 64 Files Changed 22 +1854 -636

lx commented 2022-07-21 19:01:34 +00:00

Owner

Copy Link

No description provided.

lx added 13 commits 2022-07-21 19:01:34 +00:00

368ba90879 initial work on associated stream ...

still require testing, and fixing a few kinks:
- sending packets > 16k truncate them
- send one more packet than it could at eos
- probably update documentation

/!\ contains breaking changes

fb5462ecdb rechunk stream

4745e7c4ba further work on streams ...

most changes still required are related to error handling

5d7541e13a wait for any ready stream instead of the highest priority one

0fec85b47a start supporting sending error on stream

d3d18b8e8b use a framing protocol instead of even/odd channel

cdff8ae1be add detection of premature eos

f35fa7d18d

Move things around

9dffa812c4

Refactor send.rs

26989bba14

Use Bytes instead of Vec<u8>

44bbc1c00c

Rename AutoSerialize into SimpleMessage and refactor a bit

7d148c7e76

One possibility, but I don't like it

4934ed726d

Propose alternative API

lx added 1 commit 2022-07-22 08:55:59 +00:00

c358fe3c92

Hide streaming versions as much as possible

lx added 1 commit 2022-07-22 10:45:51 +00:00

0b71ca12f9

Clean up framing protocol

lx added 1 commit 2022-07-22 11:02:06 +00:00

9cb28c21b4

Use bounded channels on receive side for backpressure

lx added 1 commit 2022-07-22 11:06:21 +00:00

5da59ebec5

Move things around and fix error bit

lx added 1 commit 2022-07-22 11:23:50 +00:00

f9db9a4b69

Simplify send.rs

lx added 1 commit 2022-07-22 11:28:02 +00:00

50627c2060

Add comment

lx added 1 commit 2022-07-22 11:32:14 +00:00

b9df442f03

Small optimization

lx added 1 commit 2022-07-22 11:40:14 +00:00

67ea3a48fa

Add Resp::into_parts

lx added 1 commit 2022-07-22 11:45:05 +00:00

aa1b29d41a

Terminology: don't use the word "body" anymore, talk of "attached stream"

lx added 1 commit 2022-07-22 11:48:52 +00:00

50358b944a

Cargo fmt; better adapt with_capacity_values

lx added 1 commit 2022-07-22 12:38:20 +00:00

4825669293

Remove copy of serialized thing in encode

lx added 1 commit 2022-07-22 12:45:36 +00:00

cbc21e40ac

Impose static lifetime on message and response

lx added 1 commit 2022-07-22 13:17:00 +00:00

a0dac87e3b

Add Req::new

lx added 1 commit 2022-07-22 13:23:54 +00:00

a5e5fd0408

Bump netapp version to 0.5

lx added 1 commit 2022-07-22 14:43:02 +00:00

ab80ade4f0

Conversion between ByteStream and AsyncRead

lx added 1 commit 2022-07-25 08:59:09 +00:00

fed0542313

Remove blocking_send that crashes

lx added 1 commit 2022-07-25 09:06:57 +00:00

c17a5f84ff

Remove broken test

lx added 1 commit 2022-07-25 09:07:28 +00:00

7499721a10

Cargo fmt

lx added 1 commit 2022-07-25 13:05:03 +00:00

74e57016f6

Add some debugging

lx added 1 commit 2022-07-26 10:01:25 +00:00

bdf7d4731d

Add stream example to fullmesh example

lx added 1 commit 2022-07-26 10:12:03 +00:00

b55f61c38b

Fix things going wrong when sending chan is closed

lx force-pushed stream-body from 9f0474de1c to b55f61c38b 2022-08-31 17:26:37 +00:00 Compare

lx added 1 commit 2022-08-31 20:19:52 +00:00

2c9d595da0

Remove useless phantom and pub(crate)

lx added 1 commit 2022-09-01 07:45:39 +00:00

3fd30c6e28

recv side: use unbounded channel to remove deadlock

lx added 1 commit 2022-09-01 08:29:46 +00:00

263db66fce

Refactor: create a BytesBuf utility crate (will also be usefull in Garage)

lx added 1 commit 2022-09-01 09:21:35 +00:00

7909a95d3c

Stream errors are now std::io::Error

lx added 1 commit 2022-09-01 09:35:04 +00:00

745c786184

Also encode errorkind in stream

lx added 1 commit 2022-09-01 10:16:04 +00:00

cd203f5708

Add OrderTag to Req and Resp, refactor errors

lx added 1 commit 2022-09-01 10:46:43 +00:00

4a59b73d7b

Add actual support for order tag

lx added 7 commits 2022-09-01 12:23:17 +00:00

81b2ff3a4e

Ping less frequently

700f783956

Add dump of sending queue

01db3c4319

add debug_name in proto to differenciate messages

984ba65e65

Better messages in proto.rs

7703659742

Be more lenient on pings

d75146fb81

SVR -> SRV

22d96929d5

Merge branch 'fix-ping' into stream-body

lx added 2 commits 2022-09-01 13:54:20 +00:00

3292566738

fix trace message

522f420e2b

Implement request cancellation

lx added 1 commit 2022-09-01 14:02:00 +00:00

b931d0d1cf

try debug

lx force-pushed stream-body from 5b8306e789 to b82ad70dd5 2022-09-01 14:11:47 +00:00 Compare

lx added 1 commit 2022-09-01 14:13:49 +00:00

f6ad1d0fab

less verbosity

lx added 2 commits 2022-09-02 12:15:17 +00:00

c865cc9f9c

Merge branch 'main' into fix-ping

9bf29a7a18

Merge branch 'fix-ping' into stream-body

lx added 1 commit 2022-09-02 12:24:48 +00:00

5af23955af

Merge branch 'main' into stream-body

lx added 1 commit 2022-09-06 17:43:14 +00:00

0f799a7768

Implement Least Attained First scheduling of streams

lx added 1 commit 2022-09-12 15:19:35 +00:00

f0326607ee

slightly change example

lx added 1 commit 2022-09-12 15:20:53 +00:00

8a7aca9837

reword doc comment

lx added 1 commit 2022-09-12 15:43:18 +00:00

f022a77f97

Add documentation

lx added 1 commit 2022-09-13 09:31:36 +00:00

2305c2cf03

Use BytesMut instead of Vec<u8> in bytes_buf (extend is probably faster)

lx added 1 commit 2022-09-13 09:51:13 +00:00

bf0e82047f

try make more like before

lx added 1 commit 2022-09-13 09:52:39 +00:00

add2b54743

fix comment

lx added 1 commit 2022-09-13 10:05:55 +00:00

db96af2609

Add comment on cancellation

lx added 1 commit 2022-09-13 10:08:44 +00:00

9362d26890

fill_buffer do something only if buf is empty

lx added 1 commit 2022-09-13 10:13:05 +00:00

8ab6256c3b

No longer need to derive Clone on message types

lx added 1 commit 2022-09-13 10:20:58 +00:00

18d5abc981

add precision to protocol description

lx added 1 commit 2022-09-13 10:25:44 +00:00

c00676feba

Uniformize flag naming

lx added 1 commit 2022-09-13 10:28:16 +00:00

b509e6057f

Missing cleanup

lx force-pushed stream-body from 3f4a4f59cf to 395f942fc7 2022-09-13 10:37:59 +00:00 Compare

lx added 1 commit 2022-09-13 10:49:06 +00:00

298e956a19

undo needless change

lx changed title from WIP: add streaming body to requests and responses to add streaming body to requests and responses 2022-09-13 10:56:46 +00:00

lx merged commit 8ac109e3a8 into main 2022-09-13 10:56:54 +00:00

lx referenced this issue from a commit 2022-09-13 10:56:54 +00:00

Merge pull request 'add streaming body to requests and responses' (#3) from stream-body into main

Sign in to join this conversation.

Reviewers

No reviewers

Labels

Clear labels

No items

No Label

Milestone

Clear milestone

No items

No Milestone

Assignees

Clear assignees

No Assignees

1 Participants

Notifications

Subscribe

Due Date

The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: lx/netapp#3

No description provided.