Posts Tagged ‘bigdata’

Public v. Private Polling – PredictWise

November 27, 2016

Public v Private Polling
http://PredictWise.com/blog/2016/11/public-v-private-polling Meta-prediction from extrapolating group characteristics limited; need raw individual data

Big Data’s Mathematical Mysteries | Quanta Magazine

December 18, 2015

#BigData’s Mathematical Mysteries https://www.quantamagazine.org/20151203-big-datas-mathematical-mysteries/ Nice description of unsupervised analysis as ink diffusing from drops

QT:{{"
“In the last 15 years or so, researchers have created a number of tools to probe the geometry of these hidden structures. For example, you might build a model of the surface by first zooming in at many different points. At each point, you would place a drop of virtual ink on the surface and watch how it spread out. Depending on how the surface is curved at each point, the ink would diffuse in some directions but not in others. If you were to connect all the drops of ink, you would get a pretty good picture of what the surface looks like as a whole. And with this information in hand, you would no longer have just a collection of data points. Now you would start to see the connections on the surface, the interesting loops, folds and kinks. This would give you a map for how to explore it.”
"}}

Most Hyped Tech: Big Data Out, IoT In

July 24, 2015

http://www.datanami.com/2014/08/20/hyped-tech-big-data-iot/

Core services: Reward bioinformaticians

May 9, 2015

QT:{{"The research system does not recognize bioinformaticians for doing what the scientific community needs most. “People realize the importance, but currently there are no real solutions,” says Xiaole Liu, a bioinformatician at the Dana-Farber Cancer Institute in Boston, Massachusetts, and at Tongji University in Shanghai, China. This is why it can take more than six months to fill positions at a core, why many of biology’s brightest are leaving science for technology companies, and why conventional biologists wait nine months to get help to dissect their data.
"}}

Reward bioinformaticians [for collaboration] http://www.nature.com/news/core-services-reward-bioinformaticians-1.17251 Despite #bigdata boom, biomedical analysis could be made more appealing

My public notes from the Yale Day of Data (#ydod2014, i0dataday)

September 30, 2014

https://linkstream2.gerstein.info/tag/i0dataday
http://elischolar.library.yale.edu/dayofdata/2014/
https://storify.com/markgerstein/tweets-related-to-the-yale-day-of-data-2014-ydod20

The Institute for Data Intensive Engineering and Science – The Data-Scope

September 30, 2014

Coppi mentions: JHU’s Data-scope (http://idies.jhu.edu/datascope ), which has a specialized architecture for astronomical computation #ydod2014

4 PB / yr

What Big Data means to me — Bourne 21 (2): 194 — Journal of the American Medical Informatics Association

September 30, 2014

Bourne mentions “What Big Data means to me”
(http://jamia.bmj.com/content/21/2/194.extract ) in connection with the creation of a digital ecosystem #ydod2014

The Parable of Google Flu: Traps in Big Data Analysis

September 29, 2014

Parable of #Google Flu: Traps in #BigData Analysis http://www.sciencemag.org/content/343/6176/1203.summary Replicating results is hard, w/ an ever-changing search algorithm

Mentions http://www.google.com/trends/correlate

For Big-Data Scientists, ‘Janitor Work’ Is Key Hurdle to Insights

September 29, 2014

For #BigData Scientists, Janitor Work Is Key http://www.nytimes.com/2014/08/18/technology/for-big-data-scientists-hurdle-to-insights-is-janitor-work.html Is a #datascientist a digital maid or a data priest? Perhaps a hybrid.

O’Neil talk

Divining reality from the hype

September 1, 2014

Divining reality from the hype http://www.economist.com/blogs/babbage/2014/08/difference-engine-2 ’14 @Gartner_inc hypecycle chart for tech trends; #DataScience going up;#BigData, down