My personal cheatsheet

Various measures

• KL-divergence: something to measure informativeness of a given item based on the conditional and unconditional probabilities of its appearance.
  Used in "Picture Tags and World Knowledge"