1.Snappy-java项目地址
https://github.com/xerial/snappy-java
2.Snappy-java两种压缩方式
使用Snappy.compress进行压缩
String dataString = "The quick brown fox jumps over the lazy dog";
byte[] compressed = Snappy.compress(dataString.getBytes("UTF-8"));
byte[] uncompressed = Snappy.uncompress(compressed);
String result = new String(uncompressed, "UTF-8");
System.out.println(result);
使用SnappyInputStream进行压缩
public static byte[] compressSnappy(byte[] data) throws IOException {
ByteArrayInputStream is = new ByteArrayInputStream(data);
ByteArrayOutputStream os = new ByteArrayOutputStream();
SnappyOutputStream sos = new SnappyOutputStream(os);
int count;
byte temp[] = new byte[BUFFER];
try {
while ((count = is.read(temp)) != -1) {
sos.write(temp, 0, count);
}
sos.flush();
byte[] output = os.toByteArray();
return output;
} finally {
sos.close();
is.close();
}
}
3.两种压缩方式的区别
/**
* 输出如下:
* Snappy.compress 压缩结果:2b a8 54 68 65 20 71 75 69 63 6b 20 62 72 6f 77 6e 20 66 6f 78 20 6a 75 6d 70 73 20 6f 76 65 72 20 74 68 65 20 6c 61 7a 79 20 64 6f 67
* SnappyInputStream压缩结果:82 53 4e 41 50 50 59 00 00 00 00 01 00 00 00 01 00 00 00 2d 2b a8 54 68 65 20 71 75 69 63 6b 20 62 72 6f 77 6e 20 66 6f 78 20 6a 75 6d 70 73 20 6f 76 65 72 20 74 68 65 20 6c 61 7a 79 20 64 6f 67
* |---------------------magic header(16bytes)-----|size(4bytes)|----compressed data-----
*/
@Test
public void testSnappyCompress() throws Exception {
String dataString = "The quick brown fox jumps over the lazy dog";
byte[] compressedData = Snappy.compress(dataString.getBytes());
System.out.println("Snappy.compress 压缩结果:" + bytes2hex(compressedData));
byte[] compressedData2 = compressSnappy(dataString.getBytes());
System.out.println("SnappyInputStream压缩结果:" + bytes2hex(compressedData2));
}
/**
* 将byte数组按16进制的方式输出
*/
public static String bytes2hex(byte[] bytes) {
StringBuilder sb = new StringBuilder();
String tmp = null;
for (byte b : bytes) {
// 将每个字节与0xFF进行与运算,然后转化为10进制,然后借助于Integer再转化为16进制
tmp = Integer.toHexString(0xFF & b);
if (tmp.length() == 1) {
tmp = "0" + tmp;
}
sb.append(tmp).append(" ");
}
return sb.toString();
}
区别如下:
通过Snappy.compress()进行压缩,压缩后的数据没有magic header
通过SnappyInputStream进行压缩,压缩后的数据有固定的header