The Internet Archive stores a total of 22 petabytes, adds four petabytes per year, and uses ~7K processes crawling the web to capture 1.5B items per week (Nathan Mattise/Ars Technica)

Nathan Mattise / Ars Technica:
The Internet Archive stores a total of 22 petabytes, adds four petabytes per year, and uses ~7K processes crawling the web to capture 1.5B items per week  —  Wayback Machine director Mark Graham outlines the scale of everyone's favorite archive.  —  AUSTIN, Texas—As much as subscription services …

from Techmeme https://ift.tt/2zXUsPI