Image Credits:erhui1979

Facebook open sources Zstandard compression algorithm and MyRocks storage engine

Today, Facebook is releasing its Zstandard compression algorithm into the wild as open source. The lossless compression technology is aimed at replacing existing libraries like zlib that are powered by the outdated Deflate compression algorithm. In addition to Zstandard, Facebook is also dropping its MyRocks storage engine as open source. MyRocks is currently being used by Facebook to improve the storage efficiency of its MySQL databases.

Both releases occurred in coordination with Facebook’s @Scale conference in San Jose. The conference supports engineers working to solve large-scale engineering challenges by bringing them together, side-by-side, with other companies in the industry dedicated to increasing the prevalence of open-source technology. Both Zstandard and MyRocks will enable developers to build platforms that can efficiently scale to large and diverse user bases.

One of the greatest fears of engineers looking to update and replace critical infrastructure is that the new libraries could bring an entire service down. Jay Parikh, vice president of infrastructure engineering at Facebook, is proud of the fact that both Zstandard and MyRocks were tested at scale across the company before being released to the community.

“Everyone here uses all of the products,” added Parikh.

In the six months that Facebook has been testing Zstandard, the company noted impressive results. With the same compression ratio of zlib, Zstandard was five times faster. In a case where the compression time was held constant, files were 10 percent smaller.

MyRocks has also produced some serious storage efficiencies. When compared to compressed InnoDB, MyRocks was able to store the same amount of data on half the server space.

“Making it open source makes the community better,” added Parikh. “It will be adopted more quickly as open source than had if was created as the proprietary technology of a single company.”

Techcrunch event

Disrupt 2026: The tech ecosystem, all in one room

Your next round. Your next hire. Your next breakout opportunity. Find it at TechCrunch Disrupt 2026, where 10,000+ founders, investors, and tech leaders gather for three days of 250+ tactical sessions, powerful introductions, and market-defining innovation. Register now to save up to $400.

Save up to $300 or 30% to TechCrunch Founder Summit

1,000+ founders and investors come together at TechCrunch Founder Summit 2026 for a full day focused on growth, execution, and real-world scaling. Learn from founders and investors who have shaped the industry. Connect with peers navigating similar growth stages. Walk away with tactics you can apply immediately

Offer ends March 13.

San Francisco, CA | October 13-15, 2026

Facebook hopes that their open source solutions can become new industry standards.

Topics

, , , , , , ,
Loading the next article
Error loading the next article