Branimir Todorovic

Learn More
We present a primal sub-gradient method for structured SVM optimization defined with the averaged sum of hinge losses inside each example. Compared with the mini-batch version of the Pegasos algorithm for the structured case, which deals with a single structure from each of multiple examples, our algorithm considers multiple structures from a single example(More)
—The paper proposes a new message passing algorithm for cycle-free factor graphs. The proposed " entropy message passing " (EMP) algorithm may be viewed as sum-product message passing over the entropy semiring, which has previously appeared in automata theory. The primary use of EMP is to compute the entropy of a model. However, EMP can also be used to(More)
Structured learning algorithms usually require inference during the training procedure. Due to their exponential size of output space, the parameter update is performed only on a relatively small collection built from the " best " structures. The k-best MIRA is an example of an online algorithm which seeks optimal parameters by making updates on k(More)
The paper proposes a new recursive algorithm for the exact computation of the linear chain conditional random fields gradient. The algorithm is an instance of the Entropy Message Passing (EMP), introduced in our previous work, and has the purpose to enhance memory efficiency when applied to long observation sequences. Unlike the traditional algorithm based(More)
In this paper we deal with on-line algorithms for blind source separation using second order statistics. We briefly describe separating algorithms based on stochastic gradient, and natural gradient optimization method, and propose an on-line separating algorithm based on the application of the extended Kalman filter. Performance evaluation of the proposed(More)
  • 1