add chunked mixed encoding support and deprecate direct decode with pest parser

[loulecrivain]

No description provided.

[loulecrivain]

cc @yuyuyureka would appreciate your opinion / review on the skeleton implementation, as it is my first time building stream adapters. also on the general okayness of the implem.

given we need it to be retry-able by the client in case of error in stream.

[yuyuyureka]

The general approach of the regex delimiter codec is good. There's not much code to review inside this PR (only ~50L). Does this compile with various feature flag combination like without async-streaming feature / --no-default-features? Does the re-delimiter-codec need to be an optional dependency only for the async-streaming feature?

Inside the re-delimiter-codec itself, there could be more docstrings to explain the usage and what regex to actually put into REDelimiterCodec::new() with an example of what splitting it would achieve (Should the regex match only the delimiter? or the full message? will the matched part be contained within the stream message?).

[loulecrivain]

Does this compile with various feature flag combination like without async-streaming feature / --no-default-features? Does the re-delimiter-codec need to be an optional dependency only for the async-streaming feature?

good catch Ill make sure to check

Inside the re-delimiter-codec itself, there could be more docstrings to explain the usage and what regex to actually put into REDelimiterCodec::new() with an example of what splitting it would achieve (Should the regex match only the delimiter? or the full message? will the matched part be contained within the stream message?).

hmmm yes do agree could use a bit more documentation

[loulecrivain]

1st point resolved

[loulecrivain]

2nd point resolved
wobcom/re-delimiter-codec@208895c

[loulecrivain]

all review comments addressed, I'm gonna continue with the actual implementation. thanks! :)

will drop tokio_stream when the new implentation works