Students in many countries have problems with learning of mathematics. Many students do not like mathematics. Teachers and parents are mostly aware that the style of teaching of mathematics and “the atmosphere” around mathematics are the main reasons for this state. For the society it is clear that something must be changed. Maybe methods of teaching, maybe the whole system? Copernicus Science Centre in Warsaw 18 years ago proposed the idea of Young Explorer's Club (YEC) as the environment where students can discover knowledge by making experiments. Learning by experimenting, by own activity of learners makes the whole educational process more interesting and less frustrating for students. This also applies to mathematics education. Experiences from mathematical Young Explorer's Clubs established at the Centre for Creative Mathematics Learning at the Faculty of Mathematics University of Bialystok as the possible way to more effective mathematics education will be presented in the paper. Experimenting and using functional strategy of teaching of mathematics is the basic form of activity in the Clubs.