Data::Stream::Bulk::Chunked - combine streams into larger chunks
version 0.11
use Data::Stream::Bulk::Chunked;
Data::Stream::Bulk::Chunked->new(
stream => $s,
chunk_size => 10000,
);
This is a stream which wraps an existing stream to give more items in a single
block. This can simplify application code which does its own processing one
block at a time, and where processing larger blocks is more efficient.
- stream
-
The stream to chunk. Required.
- chunk_size
-
The minimum number of items to return in a block. Defaults to 1 (which does
nothing).
- get_more
-
See the Data::Stream::Bulk::DoneFlag manpage.
Returns at least chunk_size items. Note that this isn't guaranteed to return
exactly chunk_size items - it just returns multiple full blocks from the
backend. Also, the final block returned may have less than chunk_size items.
Yuval Kogman <nothingmuch@woobling.org>
This software is copyright (c) 2012 by Yuval Kogman.
This is free software; you can redistribute it and/or modify it under
the same terms as the Perl 5 programming language system itself.
|