Operate on raw bytes instead of base64-encoded strings.
Issue was introduced in a977465a

Signed-off-by: Leon Klingele <git@leonklingele.de>