Posts Tagged ‘costseq2’

What will drive computer performance after Moore’s law?

November 11, 2020

What will drive computer performance after Moore’s law?

June 6, 2020

The Lost Picture Show: Hollywood Archivists Can’t Outpace Obsolescence – IEEE Spectrum

January 18, 2018

The Lost Picture Show: Hollywood Archivists Can’t Outpace Obsolescence Lots of useful stats on the costs of data storage for movies: $1k/Tb for 20yr store. 1 big budget film is ~350Pb & $20k/yr to store (1hr TV episode is $12k). Maj archives have >10k hrs.

Sam Gustman, associate dean of the USC Libraries, says that the Warner archives are now part of 50 petabytes of archived data at USC, which also includes nearly 54,000 video interviews with Holocaust survivors gathered by the USC Shoah Foundation. For 20 years of storage, including power, supervision, and data migration every 3 years, USC charges $1,000 per terabyte, or $1,000,000 per petabyte. That works out to a relatively affordable $2.5 million per year for its current 50-PB holdings. It’s not a money-making business, Gustman adds.

Meanwhile, the motion-picture studios are churning out content at an ever-increasing rate. The head of digital archiving at one major studio, who asked not to be identified, told me that it costs about $20,000 a year to digitally store one feature film and related assets such as deleted scenes and trailers. All told, the digital components of a big-budget feature can total 350 TB. Storing a single episode of a high-end hour-long TV program can cost $12,000 per year. Major studios like Disney, NBCUniversal, Sony, and Warner each have archives of tens of thousands of TV episodes and features, and they’re adding new titles all the time.

Meanwhile, the use of higher-resolution digital cameras and 3D cameras has caused the amount of potentially archivable material to skyrocket. “We went from standard definition to HD and then from HD to UHD,” Peter Schade, NBCUniversal’s vice president of content management, said in an interview. Pixel resolutions have gone from 2K to 4K and soon, 8K, he adds. Codecs—the software used to compress and decompress digital video files—keep changing, as do the hardware and software for playback. “And the rate of change has escalated,” Schade says. “}}

Computers That Can Run Backwards

December 29, 2017

Computers That Can Run Backwards Discusses the relationship between adiabatic, reversible & quantum #computing to energy expenditure per bit. Introduces Koomey’s law that “computations per unit of energy have been doubling about every 1.6 years.”

Koomey’s law, a relative of Moore’s law, says that over the first 70 years of electronic computing (as represented above by typical computers of the time), computations per unit of energy have been doubling about every 1.6 years. Had this not been happening, each doubling of components would have doubled the heat to be dissipated and would have shut down Moore’s law long ago. Koomey’s law is also good news for mobile computing, which relies heavily on battery power.”

The future of DNA sequencing

November 14, 2017

The Future of DNA Seq. Apps v Tech. QT: “Platforms for…#sequencing have changed dramatically…Yet the trajectories of other technologies…Internet, digital
photography…suggest…real disrupters will be the resulting applications, not the new tech”

Killer applications –
Over the years, the platforms for DNA sequencing have changed dramatically (see ”). Yet the trajectories of other technologies for which there is a seemingly insatiable demand — smartphones, the Internet, digital photography — suggest that the real disrupters will be the resulting applications, not the new technologies.


Big Data: Astronomical or Genomical?

March 3, 2017

#BigData: Astronomical or Genomical? Est. current storage in EB/yr: Astro .1, omics .1, Twitter .001, YouTube .1-1

“Data storage requirements for all four domains are projected to be enormous. Today, the largest astronomy data center devotes ~100 petabytes to storage, and the completion of the Square Kilometre Array (SKA) project is expected to lead to a storage demand of 1 exabyte per year. YouTube currently requires from 100 petabytes to 1 exabyte for storage and may be projected to require between 1 and 2 exabytes additional storage per year by 2025. Twitter’s storage needs today are estimated at 0.5 petabytes per year, which may increase to 1.5 petabytes in the next ten years. (Our estimates here ignore the “replication factor” that multiplies storage needs by ~4, for redundancy.) For genomics, we have determined more than 100 petabytes of storage are currently used by only 20 of the largest institutions ().”

The European Bioinformatics Institute in 2016: Data growth and integration

February 9, 2016

.@emblEBI in ’16 via @ewanbirney Seq DB growth stable w/ yearly doubling (post ~’08 spike) & EGA now faster than ENA

cite the data growth stats here:

Fig 2
– amt prvt data incr as for ncbi + arrays are falling now less than masspec – after a huge incr from ’07 to ’12 , now stab. at12-mo doubling

The Take-Home Message

September 26, 2015

H1B visa statistics

July 23, 2015

Moore’s law is not that easy to follow anymore

July 16, 2015