Greg Ver Steeg


Greg  Ver Steeg

Greg Ver Steeg, Ph.D.

Research Assistant Professor, University of Southern California

Powerful (unsupervised) learning requires abstraction. My main research focus is to formalize this idea in a practical and principled way using information theory.


As intelligent beings in a complex world, we are constantly faced with the challenge of making sense of it all through simplification and abstraction. Our abstract representations of the world seem to be most useful when they "carve nature at its joints" or "perceive and bring together in one idea the scattered particulars" (as Socrates puts it). The motivation of this research program is to formalize this idea in a practical and general way. While information theory contains tempting concepts to quantify "information", traditional measures don't capture the notion of abstraction. Information theory was developed to describe lossless communication between two parties. From this point of view, the main focus has been on perfect reconstruction, or memorization, of input data. I propose to focus on a different characterization of multivariate information about the world that can be decomposed modularly and hierarchically. Besides introducing a notion of abstraction, we would like our characterization of information to allow us to efficiently optimize representations to be as informative as possible. We have been using these ideas to search for abstract representations that help us understand complex data like neurophysiology of Alzheimer's patients, gene expression of cancer patients, and human behavior. Ultimately, I hope these ideas will lead to a better understanding of intelligence.

Other ongoing research efforts

gregv at