Codecs

BinPickle supports codecs to compress buffer content. These are similar in spirit to numcodecs, but automatically handle some cases such as splitting arrays into blocks and can reduce copying in some situations.

Codec API

class binpickle.codecs.Codec

Base class for a codec.

NAME

the name for this codec, used by get_codec() and in index entries.

Type

str

encode(buf)

Encode a buffer.

Parameters

buf (bytes-like) – the buffer to encode.

Returns

the encoded data

Return type

bytes-like

abstract encode_to(buf, out)

Encode a buffer to a binary output stream.

Parameters

  • buf (bytes-like) – the buffer to encode.

  • out (file-like) – the output stream. Must have a write method taking a bytes.

decode(buf)

Decode a buffer.

Parameters

buf (bytes-like) – the buffer to decode.

Returns

the decoded data

Return type

bytes-like

abstract decode_to(buf, out)

Decode a buffer into a bytearray.

Parameters

  • buf (bytes-like) – the buffer to decode.

  • out (bytearray) – the bytearray to receive the output. This method will resize the bytearray as needed to accomodate the output.

abstract config()

Get a JSON-serializable configuration for this codec. It should be able to be passed as **kwargs to the constructor.

Codec Implementations

Null codec

class binpickle.codecs.Null

Null codec (passthrough).

encode(buf)

Encode a buffer.

Parameters

buf (bytes-like) – the buffer to encode.

Returns

the encoded data

Return type

bytes-like

encode_to(buf, out)

Encode a buffer to a binary output stream.

Parameters

  • buf (bytes-like) – the buffer to encode.

  • out (file-like) – the output stream. Must have a write method taking a bytes.

decode(buf, length=None)

Decode a buffer.

Parameters

buf (bytes-like) – the buffer to decode.

Returns

the decoded data

Return type

bytes-like

decode_to(buf, out)

Decode a buffer into a bytearray.

Parameters

  • buf (bytes-like) – the buffer to decode.

  • out (bytearray) – the bytearray to receive the output. This method will resize the bytearray as needed to accomodate the output.

config()

Get a JSON-serializable configuration for this codec. It should be able to be passed as **kwargs to the constructor.

Blosc codec

class binpickle.codecs.Blosc(name='blosclz', level=9, shuffle=1, blocksize=1073741824)

Blosc codec.

encode_to(buf, out)

Encode a buffer to a binary output stream.

Parameters

  • buf (bytes-like) – the buffer to encode.

  • out (file-like) – the output stream. Must have a write method taking a bytes.

decode_to(buf, out)

Decode a buffer into a bytearray.

Parameters

  • buf (bytes-like) – the buffer to decode.

  • out (bytearray) – the bytearray to receive the output. This method will resize the bytearray as needed to accomodate the output.

config()

Get a JSON-serializable configuration for this codec. It should be able to be passed as **kwargs to the constructor.

Gzip codec

class binpickle.codecs.GZ(level=9)

Zlib (gzip-compatible) codec.

encode(buf)

Encode a buffer.

Parameters

buf (bytes-like) – the buffer to encode.

Returns

the encoded data

Return type

bytes-like

encode_to(buf, out)

Encode a buffer to a binary output stream.

Parameters

  • buf (bytes-like) – the buffer to encode.

  • out (file-like) – the output stream. Must have a write method taking a bytes.

decode(buf)

Decode a buffer.

Parameters

buf (bytes-like) – the buffer to decode.

Returns

the decoded data

Return type

bytes-like

decode_to(buf, out)

Decode a buffer into a bytearray.

Parameters

  • buf (bytes-like) – the buffer to decode.

  • out (bytearray) – the bytearray to receive the output. This method will resize the bytearray as needed to accomodate the output.

config()

Get a JSON-serializable configuration for this codec. It should be able to be passed as **kwargs to the constructor.