Editing Xz
Jump to navigation
Jump to search
Warning: You are not logged in. Your IP address will be publicly visible if you make any edits. If you log in or create an account, your edits will be attributed to your username, along with other benefits.
The edit can be undone. Please check the comparison below to verify that this is what you want to do, and then save the changes below to finish undoing the edit.
| Latest revision | Your text | ||
| Line 1: | Line 1: | ||
| − | + | <code>[[wikipedia:XZ_Utils|xz]]</code><ref>https://man.cx/xz</ref> [[compress]] or decompress (<code>unxz</code>) .xz and .lzma files but xz compresses by default to xz format. | |
| − | <code>[[wikipedia:XZ_Utils|xz | ||
| − | |||
| − | |||
xz support multi-threaded compression (<code>-T</code> flag)<ref>https://man.cx/xz</ref> since 2014, version 5.2.0. <ref>https://git.tukaani.org/?p=xz.git;a=blob;f=NEWS;hb=HEAD</ref>, as of 2019 threaded decompression hasn’t been implemented yet. <ref>https://man.cx/xz</ref>. Number of threads can be less that defined is file is not big enough for threading with the given settings or if using more threads would exceed the memory usage limit. <ref>https://man.cx/xz</ref> | xz support multi-threaded compression (<code>-T</code> flag)<ref>https://man.cx/xz</ref> since 2014, version 5.2.0. <ref>https://git.tukaani.org/?p=xz.git;a=blob;f=NEWS;hb=HEAD</ref>, as of 2019 threaded decompression hasn’t been implemented yet. <ref>https://man.cx/xz</ref>. Number of threads can be less that defined is file is not big enough for threading with the given settings or if using more threads would exceed the memory usage limit. <ref>https://man.cx/xz</ref> | ||
| Line 9: | Line 6: | ||
== Options == | == Options == | ||
| − | :<code> | + | :<code>--keep</code> Once the target file has been successfully closed, the source file is removed unless --keep was specified |
| − | |||
| − | |||
== Commands == | == Commands == | ||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
* <code>xz --info-memory</code> | * <code>xz --info-memory</code> | ||
<pre> | <pre> | ||
| Line 28: | Line 18: | ||
* Use <code>--verbose</code> option twice to get extra information about compression, such us number of threads to use or memory required. It can impact xz performance. | * Use <code>--verbose</code> option twice to get extra information about compression, such us number of threads to use or memory required. It can impact xz performance. | ||
| − | <code>xz | + | <code>xz -T0 --verbose --verbose file_to_compress</code> |
<pre> | <pre> | ||
xz: Filter chain: --lzma2=dict=8MiB,lc=3,lp=0,pb=2,mode=normal,nice=64,mf=bt4,depth=0 | xz: Filter chain: --lzma2=dict=8MiB,lc=3,lp=0,pb=2,mode=normal,nice=64,mf=bt4,depth=0 | ||
| Line 37: | Line 27: | ||
</pre> | </pre> | ||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
== Examples == | == Examples == | ||
| − | * Test integrity: <code> | + | * Test integrity:<code>xz -tv linux-3.18.19.tar.xz</code> |
* Compress data from <code>[[stdin]]</code>: <code>echo "DATA TO COMPRESS" | xz --verbose > file.xz</code> | * Compress data from <code>[[stdin]]</code>: <code>echo "DATA TO COMPRESS" | xz --verbose > file.xz</code> | ||
* Compress all files in directory and subdirectory except already compresed (<code>.xz</code>) using all CPUs (<code>-T0</code>): | * Compress all files in directory and subdirectory except already compresed (<code>.xz</code>) using all CPUs (<code>-T0</code>): | ||
| − | :<code> | + | :<code> find . -type f -not -name \*.xz -exec xz -T0 --verbose \{\} \;</code> |
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
== Activities == | == Activities == | ||
# Compress your data using gzip and xz and compare sizes | # Compress your data using gzip and xz and compare sizes | ||
# Compare sizes of Linux Kernel source code depending of compression tools used: https://mirrors.edge.kernel.org/pub/linux/kernel/v5.x/ | # Compare sizes of Linux Kernel source code depending of compression tools used: https://mirrors.edge.kernel.org/pub/linux/kernel/v5.x/ | ||
| − | # Compress your file using single thread <code>xz</code> and compress same file using all your available threads <code> | + | # Compress your file using single thread <code>xz</code> and compress same file using all your available threads <code>xz -T0</code> |
| − | # Compress your file with <code>xz -T0</code> and verify that you are using all your | + | # Compress your file with <code>xz -T0</code> and verify that you are using all your threads with [[htop]] |
| − | |||
| − | |||
| − | |||
| − | |||
| − | |||
== See also == | == See also == | ||
* {{xz}} | * {{xz}} | ||
| − | * | + | * <code>[[zstd]]</code><ref>https://en.wikipedia.org/wiki/Zstandard</ref> compression utility released in 2015 which includes parallel (multi-threaded) implementations of both compression and decompression |
| − | * {{ | + | * {{cp}} |
* [[Intel QAT]] (QuickAssist Technology): https://software.intel.com/en-us/articles/how-intel-quickassist-technology-accelerates-nfv-use-cases | * [[Intel QAT]] (QuickAssist Technology): https://software.intel.com/en-us/articles/how-intel-quickassist-technology-accelerates-nfv-use-cases | ||
[[Category:compression]] | [[Category:compression]] | ||
Advertising:
