Bug#659640: ITP: wp-mirror -- Utility for building mirrors of Wikipedias
Package: wnpp
Severity: wishlist
Owner: "Dr. Kent L. Miller" <wpmirrordev@gmail.com>
* Package name : wp-mirror
Version : 0.3.0
Upstream Author : Dr. Kent L. Millr <wpmirrordev@gmail.com>
* URL : http://www.nongnu.org/wp-mirror/
* License : GPLv3
Programming Lang: Common Lisp (CLISP 2.48)
Description : Utility for building mirrors of Wikipedias
Wp-mirror is a free utility for building and maintaining a set of
mirrors of Wikipedias (aka a Wikipedia farm). The WikiMedia Foundation
offers Wikipedias in nearly 300 languages. The user specifies the set
of languages to be mirrored (`simple' is the default, Simple English
means shorter sentences).
Disk requirements for the `simple' wiki (as of 2011) are: 2G to store
the database (latest revisions only for articles, templates, image
descriptions, and primary meta-pages), and a further 40G to store the
images. This can easily fit on a laptop PC, and takes 100ks (a day) to
build.
Disk requirements for the `en' wiki (as of 2011) are: 150G to store the
database (latest revisions as above), and about 2T to store the images.
This requires a desktop PC with at least two large hard disk drives, and
one may expect 5Ms (two months) to build.
Wp-mirror is non-interactive and usually runs in background as a weekly
cron job, updating the mirrors whenever WikiMedia Foundation posts new
dump files.
If the user runs more than one instance of wp-mirror concurrently, the
later ones monitor the progress of the first. If a suitable windowing
system is present, progress bars are rendered using graphics in a
separate window, and otherwise using ASCII characters in a console.
Reply to: