Markov/cell-to-cell mapping technique (CCMT) is a systematic procedure to model the dynamics of both linear and non-linear systems in terms of transitions among cells that partition the system state space. Markov/CCMT has been used for the reliability and safety analysis of control systems, as well as for state/parameter estimation, diagnostics and, accident management in dynamic systems. An overview of the Markov/CCMT is presented and some applications for different engineering systems are briefly reviewed.