SmartKom is a multi-modal dialogue system which combines speech with mimics and gestures. In this paper, we want to deal with one of those phenomena which can be observed in such elaborated systems that we want to call `offtalk', i.e., speech that is not directed to the system (speaking to oneself, speaking aside). We report the classification results of first experiments which use a large prosodic feature vector in combination with part--of--speech information.