zlib庫壓縮和解壓字符串STL string的實(shí)例詳解
zlib庫壓縮和解壓字符串STL string的實(shí)例詳解
場景
1.一般在使用文本json傳輸數(shù)據(jù), 數(shù)據(jù)量特別大時(shí),傳輸?shù)倪^程就特別耗時(shí), 因?yàn)閹捇蛘遱ocket的緩存是有限制的, 數(shù)據(jù)量越大, 傳輸時(shí)間就越長. 網(wǎng)站一般使用gzip來壓縮成二進(jìn)制.
說明
1.zlib庫可以實(shí)現(xiàn)gzip和zip方式的壓縮, 這里只介紹zip方式的二進(jìn)制壓縮, 壓縮比還是比較可觀的, 一般寫客戶端程序已足夠.
2.修改了一下zpipe.c的實(shí)現(xiàn), 其實(shí)就是把讀文件改為讀字符串, 寫文件改為寫字符串即可.
例子
// test_zlib.cpp : 定義控制臺(tái)應(yīng)用程序的入口點(diǎn)。 // #include "stdafx.h" #include <string> #include <iostream> #include <memory> #include <assert.h> #include "zlib.h" // E:\software\Lib\compress\zlib-1.2.5\src\examples // zpipe.c #define CHUNK 16384 /* Compress from file source to file dest until EOF on source. def() returns Z_OK on success, Z_MEM_ERROR if memory could not be allocated for processing, Z_STREAM_ERROR if an invalid compression level is supplied, Z_VERSION_ERROR if the version of zlib.h and the version of the library linked do not match, or Z_ERRNO if there is an error reading or writing the files. */ int CompressString(const char* in_str,size_t in_len, std::string& out_str, int level) { if(!in_str) return Z_DATA_ERROR; int ret, flush; unsigned have; z_stream strm; unsigned char out[CHUNK]; /* allocate deflate state */ strm.zalloc = Z_NULL; strm.zfree = Z_NULL; strm.opaque = Z_NULL; ret = deflateInit(&strm, level); if (ret != Z_OK) return ret; std::shared_ptr<z_stream> sp_strm(&strm,[](z_stream* strm){ (void)deflateEnd(strm); }); const char* end = in_str+in_len; size_t pos_index = 0; size_t distance = 0; /* compress until end of file */ do { distance = end - in_str; strm.avail_in = (distance>=CHUNK)?CHUNK:distance; strm.next_in = (Bytef*)in_str; // next pos in_str+= strm.avail_in; flush = (in_str == end) ? Z_FINISH : Z_NO_FLUSH; /* run deflate() on input until output buffer not full, finish compression if all of source has been read in */ do { strm.avail_out = CHUNK; strm.next_out = out; ret = deflate(&strm, flush); /* no bad return value */ if(ret == Z_STREAM_ERROR) break; have = CHUNK - strm.avail_out; out_str.append((const char*)out,have); } while (strm.avail_out == 0); if(strm.avail_in != 0); /* all input will be used */ break; /* done when last data in file processed */ } while (flush != Z_FINISH); if(ret != Z_STREAM_END) /* stream will be complete */ return Z_STREAM_ERROR; /* clean up and return */ return Z_OK; } /* Decompress from file source to file dest until stream ends or EOF. inf() returns Z_OK on success, Z_MEM_ERROR if memory could not be allocated for processing, Z_DATA_ERROR if the deflate data is invalid or incomplete, Z_VERSION_ERROR if the version of zlib.h and the version of the library linked do not match, or Z_ERRNO if there is an error reading or writing the files. */ int DecompressString(const char* in_str,size_t in_len, std::string& out_str) { if(!in_str) return Z_DATA_ERROR; int ret; unsigned have; z_stream strm; unsigned char out[CHUNK]; /* allocate inflate state */ strm.zalloc = Z_NULL; strm.zfree = Z_NULL; strm.opaque = Z_NULL; strm.avail_in = 0; strm.next_in = Z_NULL; ret = inflateInit(&strm); if (ret != Z_OK) return ret; std::shared_ptr<z_stream> sp_strm(&strm,[](z_stream* strm){ (void)inflateEnd(strm); }); const char* end = in_str+in_len; size_t pos_index = 0; size_t distance = 0; int flush = 0; /* decompress until deflate stream ends or end of file */ do { distance = end - in_str; strm.avail_in = (distance>=CHUNK)?CHUNK:distance; strm.next_in = (Bytef*)in_str; // next pos in_str+= strm.avail_in; flush = (in_str == end) ? Z_FINISH : Z_NO_FLUSH; /* run inflate() on input until output buffer not full */ do { strm.avail_out = CHUNK; strm.next_out = out; ret = inflate(&strm, Z_NO_FLUSH); if(ret == Z_STREAM_ERROR) /* state not clobbered */ break; switch (ret) { case Z_NEED_DICT: ret = Z_DATA_ERROR; /* and fall through */ case Z_DATA_ERROR: case Z_MEM_ERROR: return ret; } have = CHUNK - strm.avail_out; out_str.append((const char*)out,have); } while (strm.avail_out == 0); /* done when inflate() says it's done */ } while (flush != Z_FINISH); /* clean up and return */ return ret == Z_STREAM_END ? Z_OK : Z_DATA_ERROR; } int _tmain(int argc, _TCHAR* argv[]) { const char* buf = "01010101010101010101010000000000000000000000000000011111111111111" "01010101010101010101010000000000000000000000000000011111111111111" "01010101010101010101010000000000000000000000000000011111111111111" "01010101010101010101010000000000000000000000000000011111111111111" "01010101010101010101010000000000000000000000000000011111111111111" "01010101010101010101010000000000000000000000000000011111111111111" "01010101010101010101010000000000000000000000000000011111111111111" "01010101010101010101010000000000000000000000000000011111111111111" "01010101010101010101010000000000000000000000000000011111111111111" "01010101010101010101010000000000000000000000000000011111111111111" "qwertyuiop[]"; std::cout << "========= CompressString ===========" << std::endl; std::cout << "Source Buffer Size: " << strlen(buf) << std::endl; std::string out_compress; assert(CompressString(buf,strlen(buf),out_compress,Z_DEFAULT_COMPRESSION) == Z_OK); std::cout << "Compress Buffer Size: " << out_compress.size() << std::endl; std::cout << "========= DecompressString ===========" << std::endl; std::string out_decompress; assert(DecompressString(out_compress.c_str(),out_compress.size(),out_decompress) == Z_OK); std::cout << "Decompress Buffer Size: " << out_decompress.size() << std::endl; assert(!out_decompress.compare(buf)); return 0; }
輸出:
========= CompressString =========== Source Buffer Size: 662 Compress Buffer Size: 38 ========= DecompressString =========== Decompress Buffer Size: 662
參考
C++ Code Snippet - Compressing STL Strings with zlib
如有疑問請(qǐng)留言或者到本站社區(qū)交流討論,感謝閱讀,希望能幫助到大家,謝謝大家對(duì)本站的支持!
相關(guān)文章
詳解如何實(shí)現(xiàn)C++虛函數(shù)調(diào)用匯編代碼
多態(tài)是C++中最重要的特性之一,對(duì)虛函數(shù)的調(diào)用在C++代碼中是隨處可見的,本篇文章我們?cè)敿?xì)探討一下,感興趣的朋友快來看看吧2021-11-11C語言調(diào)用SQLite數(shù)據(jù)庫實(shí)現(xiàn)數(shù)據(jù)增刪改查
SQLite是一種輕量級(jí)的關(guān)系型數(shù)據(jù)庫管理系統(tǒng),是一個(gè)開源的、零配置的、服務(wù)器端的、自包含的、零管理的、事務(wù)性的SQL數(shù)據(jù)庫引擎,本文主要介紹了如何調(diào)用SQLite數(shù)據(jù)庫實(shí)現(xiàn)數(shù)據(jù)增刪改查,需要的可以參考一下2023-08-08Matlab實(shí)現(xiàn)數(shù)據(jù)的動(dòng)態(tài)顯示方法
這篇文章主要為大家詳細(xì)介紹了Matlab使用Plot函數(shù)實(shí)現(xiàn)數(shù)據(jù)動(dòng)態(tài)顯示方法,文中示例代碼介紹的非常詳細(xì),具有一定的參考價(jià)值,感興趣的小伙伴們可以參考一下2018-06-06c++與python實(shí)現(xiàn)二分查找的原理及實(shí)現(xiàn)
本文介紹了c++與python實(shí)現(xiàn)二分查找的原理及實(shí)現(xiàn),二分查找指首先將數(shù)組中間值和目標(biāo)值進(jìn)行比較,如果相等則返回;如果不相等,則選擇中間值左邊的一半或者右邊的一半進(jìn)行比較;不斷重復(fù)直到檢索完畢,下文相關(guān)資料需要的朋友可以參考一下2022-03-03C++?Qt開發(fā)之運(yùn)用QJSON模塊解析數(shù)據(jù)
JSON(JavaScript?Object?Notation)是一種輕量級(jí)的數(shù)據(jù)交換格式,它易于人閱讀和編寫,也易于機(jī)器解析和生成,本文主要介紹了Qt如何運(yùn)用QJson組件的實(shí)現(xiàn)對(duì)JSON文本的靈活解析功能,需要的可以參考下2024-01-01