To prevent important information about the characteristics of the speaker from being lost as soon as different people use the speaker system, the identification module must be combined with a self-learning technique to improve the self-learning possibilities of the system. A speaker adaptation scheme is introduced for fast short-term and detailed long-term adaptation. These adaptation profiles are then used for an efficient speaker recognition system and enable the speaker adaptation to track different speakers. In the long term, this approach provides an optimal adaptation.