Sergios Theodoridis

Comprehensive and up to date. Gets to the mathematical foundations quickly but sometimes lingers too long there. Not a handbook of techniques for the practicing data scientist, but its interesting to iterate through familiar techniques using a Bayesian / Optimization lens.

This is a book I keep coming back to as a reference. Some areas are discussed fairly briefly, but clustering, for instance, is labored in four chapters.