Contact

Dr. Yevgeny Seldin

Adresse: Spemannstr. 38
72076 Tübingen
Raum Nummer: 215
Fax: 07071 601 552

 

Bild von Seldin, Yevgeny, Dr.

Yevgeny Seldin

Position: Wissenschaftler  Abteilung: 

Affiliations:

  • Research Scientist, Max Planck Insitute for Intelligent Systems (Oct 2009 - present)
  • Honorary Research Associate, Department of Computer Science, University College London (Aug 2011 - present)

 

Education:

I did my Ph.D. at the Hebrew University of Jerusalem under supervision of Prof. Naftali Tishby.

 

Research Interests:
Machine Learning, Reinforcement Learning, Information Theory.

My current research is focused on data-dependent analysis of reinforcement learning (via application of PAC-Bayesian analysis).

I am also taking part in CompLACS research project.

 

Tutorials:

 

Events that I organized:


Teaching:

  • Teaching Assistant (frontal) in Introduction to Machine Learning course at The Hebrew University of Jerusalem. Fall 2007 and 2008.
  • Teaching Assistant (frontal) in Introduction to Linear Systems course at The Hebrew University of Jerusalem. Spring 2006, 2007, 2008, and 2009.

 

A quick guide to my main publications:

  • PAC-Bayesian analysis of martingales and its application to multiarmed bandits with side information: Please, see our PAC-Bayesian Inequalities for Martingales draft for general PAC-Bayesian inequalities for martingales (joint work with François Laviolette, Nicolò Cesa-Bianchi, John Shawe-Taylor, and Peter Auer, accepted to IEEE Transactions on Information Theory). These inequalities make it possible to control the concentration of weighted averages of multiple (possibly uncountably many) simultaneously evolving and interdependent martingales. We apply these inequalities to multiarmed bandits with side information in PAC-Bayesian Analysis of Contextual Bandits NIPS-2011 paper (joint work with Peter Auer, François Laviolette, John Shawe-Taylor, and Ronald Ortner). Our analysis allows to provide the algorithm large amount of side information, let the algorithm to decide which side information is relevant for the task, and penalize the algorithm only for the side information that it is using de facto. We also provide an algorithm for multiarmed bandits with side information with computational complexity that is independent of the amount of side information and linear in the number of actions.
  • PAC-Bayesian analysis of co-clustering, matrix tri-factorization and graphical models: This series of works is best summarized in our JMLR paper PAC-Bayesian Analysis of Co-clustering and Beyond (joint work with Naftali Tishby). We derive generalization bounds and regularized optimization algorithms for co-clustering and matrix tri-factorization. The obtained generalization bounds for co-clustering suggest that co-clustering should optimize a trade-off between empirical data fit and the mutual information that clusters preserve on row and column variables. To the best of our knowledge, this is the first known generalization analysis of co-clustering and matrix tri-factorization and the first time regularization terms are derived for these problems. Our approach to formulating unsupervised learning problems as prediction problems can be extended to virtually any unsupervised learning task and our generalization bounds can be further extended to tree-shaped graphical models.
  • Multilevel models for image processing: We were one of the first to apply multilevel unsupervised learning in image analysis, where the first level identified a "dictionary" of common textures within a collection of images and the second level used this dictionary to perform joint unsupervised segmentation of the images. See our Unsupervised Clustering of Images using their Joint Segmentation by Yevgeny Seldin, Sonia Starik and Michael Werman.
  • Unsupervised sequence segmentation by mixtures of variable memory Markov sources: We designed an algorithm for unsupervised segmentation of sequences into alternating variable memory Markov sources (implemented as Prediction Suffix Trees). The algorithm was shown to be successful in identification of domains in protein sequences. See our Bioinformatics publication Markovian domain fingerprinting: statistical segmentation of protein sequences by Gill Bejerano, Yevgeny Seldin, Hanah Margalit and Naftali Tishby for the summary of the biological results and ICML-2001 paper Unsupervised Sequence Segmentation by a Mixture of Switching Variable Memory Markov Sources by Yevgeny Seldin, Gill Bejerano, and Naftali Tishby for more details about the algorithm.

Präferenzen: 
Referenzen pro Seite: Jahr: Medium:

  
Zeige Zusammenfassung

Artikel (3):

Seldin Y, Laviolette F, Cesa-Bianchi N, Shawe-Taylor J und Auer P (Dezember-2012) PAC-Bayesian Inequalities for Martingales IEEE Transactions on Information Theory 58(12) 7086-7093.
Seldin Y und Tishby N (Dezember-2010) PAC-Bayesian Analysis of Co-clustering and Beyond Journal of Machine Learning Research 11 3595-3646.
pdf
Bejerano G, Seldin Y, Margalit H und Tishby N (2001) Markovian domain fingerprinting: statistical segmentation of protein sequences Bioinformatics 17(10) 927-934.
pdf

Beiträge zu Tagungsbänden (11):

Seldin Y, Cesa-Bianchi N, Auer P, Laviolette F und Shawe-Taylor J (April-2012) PAC-Bayes-Bernstein Inequality for Martingales and its Application to Multiarmed Bandits, Workshop on On-line Trading of Exploration and Exploitation 2, International Machine Learning Society, Madison, WI, USA, 98-111, Series: JMLR Workshop and Conference Proceedings ; 26.
pdf
Seldin Y, Auer P, Laviolette F, Shawe-Taylor J und Ortner R (Januar-2012) PAC-Bayesian Analysis of Contextual Bandits In: Advances in Neural Information Processing Systems 24, , Twenty-Fifth Annual Conference on Neural Information Processing Systems (NIPS 2011), Curran, Red Hook, NY, USA, 1683-1691.
pdfpdf
Peters J, Mülling K, Seldin Y und Altun Y (Juli-2010) Reinforcement Learning with Bounded Information Loss, 30th International Workshop on Bayesian Inference and Maximum Entropy Methods in Science and Engineering (MaxEnt 2010), American Institute of Physics, Woodbury, NY, USA, 365-372, Series: AIP Conference Proceedings ; 1305.
Seldin Y (Juni-2010) A PAC-Bayesian Analysis of Co-clustering, Graph Clustering, and Pairwise Clustering, ICML 2010 Workshop on Social Analytics: Learning from human interactions, 1-5.
pdf
Seldin Y und Tishby N (März-2010) PAC-Bayesian Bounds for Discrete Density Estimation and Co-clustering Analysis, Workshop "Foundations and New Trends of PAC Bayesian Learning", 1-2.
pdf
Seldin Y und Tishby N (Dezember-2009) A PAC-Bayesian Approach to Formulation of Clustering Objectives, NIPS 2009 Workshop "Clustering: Science or Art? Towards Principled Approaches", 1-4.
pdf
Seldin Y und Tishby N (April-2009) PAC-Bayesian Generalization Bound for Density Estimation with Application to Co-clustering, Twelfth International Conference on Artificial Intelligence and Statistics (AISTATS 2009), International Machine Learning Society, Madison, WI, USA, 472-479, Series: JMLR Workshop and Conference Proceedings ; 5.
pdf
Seldin Y und Tishby N (Juni-2008) Multi-Classification by Categorical Features via Clustering, 25th International Conference on Machine Learning (ICML 2008), ACM Press, New York, NY, USA, 920-927.
pdf
Seldin Y, Slonim N und Tishby N (September-2007) Information Bottleneck for Non Co-Occurrence Data In: Advances in Neural Information Processing Systems 19, , Twentieth Annual Conference on Neural Information Processing Systems (NIPS 2006), MIT Press, Cambridge, MA, USA, 1241-1248.
pdf
Seldin Y, Starik S und Werman M (2003) Unsupervised Clustering of Images using their Joint Segmentation, 3rd International Workshop on Statistical and Computational Theories of Vision (SCTV 2003), 1-24.
pdf
Seldin Y, Bejerano G und Tishby N (Juli-2001) Unsupervised Sequence Segmentation by a Mixture of Switching Variable Memory Markov Sources In: Machine Learning, , Eighteenth International Conference on Machine Learning (ICML 2001), Morgan Kaufmann, San Francisco, CA, USA, 513-520.
pdf

Technische Berichte (2):

Seldin Y, Laviolette F, Shaw-Taylor J, Peters J und Auer P: PAC-Bayesian Analysis of Martingales and Multiarmed Bandits, Max Planck Institute for Biological Cybernetics, Tübingen, Germany, (Mai-2011).
pdf
Seldin Y: A PAC-Bayesian Analysis of Graph Clustering and Pairwise Clustering, Max Planck Institute for Biological Cybernetics, Tübingen, Germany, (September-2010).
pdf

Abschlussarbeiten (2):

Seldin Y: A PAC-Bayesian Approach to Structure Learning, The Hebrew University of Jerusalem, Israel, (September-2009). PhD thesis
pdf
Seldin Y: On Unsupervised Learning of Mixtures of Markov Sources, The Hebrew University of Jerusalem, Israel, (2001). Diplom thesis
pdf

Vorträge (2):

Seldin Y (März-2010) Invited Lecture: PAC-Bayesian Analysis in Unsupervised Learning, Workshop "Foundations and New Trends of PAC Bayesian Learning", London, UK.
pdf
Seldin Y (Dezember-2009) Invited Lecture: A PAC-Bayesian Approach to Formulation of Clustering Objectives, NIPS 2009 Workshop on "Clustering: Science or Art? Towards Principled Approaches", Whistler, BC, Canada.
pdf

Export als:
BibTeX, XML, pubman, Edoc, RTF
Last updated: Montag, 22.05.2017