Free Software Foundation!

Join now

Gizzard

From Free Software Directory
Revision as of 09:28, 12 April 2011 by WikiSysop (Talk | contribs)

(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to: navigation,
[edit]

Gizzard

http://github.com/stevej/gizzard
Many modern web sites need fast access to an amount of information so large that it cannot be efficiently stored on a single computer. A good way to deal with this problem is to “shard†that information; that is, store it across multiple computers instead of on just one. Sharding strategies often involve two techniques: partitioning and replication. With partitioning, the data is divided into small chunks and stored across many computers. Each of these chunks is small enough that the computer that stores it can efficiently manipulate and query the data. With the other technique of replication, multiple copies of the data are stored across several machines. Since each copy runs on its own machine and can respond to queries, the system can efficiently respond to tons of queries for the same data by adding more copies. Replication also makes the system resilient to failure because if any one copy is broken or corrupt, the system can use another copy for the same task. The problem is: sharding is difficult. Determining smart partitioning schemes for particular kinds of data requires a lot of thought. And even more difficult is ensuring that all of the copies of the data are consistent despite unreliable communication and occasional computer failures.

Documentation

see README file.


Download

Download External-link-icon.png version 0.1 (beta)
released on 28 May 2010

Categories




Licensing

LicenseVerified byVerified onNotes
Apache2.0Kelly Hopkins3 August 2010



Leaders and contributors

Contact(s)Role
"Email stevej@fruitless.org" Steve Jenson Maintainer


Resources and communication

Software prerequisites

This entry (in part or in whole) was last reviewed on 3 August 2010.



Entry
















Permission is granted to copy, distribute and/or modify this document under the terms of the GNU Free Documentation License, Version 1.3 or any later version published by the Free Software Foundation; with no Invariant Sections, no Front-Cover Texts, and no Back-Cover Texts. A copy of the license is included in the page “GNU Free Documentation License”.

The copyright and license notices on this page only apply to the text on this page. Any software or copyright-licenses or other similar notices described in this text has its own copyright notice and license, which can usually be found in the distribution or license text itself.


Personal tools
Namespaces

Variants
Actions
Navigation
Contribute