Narrated Abu Huraira:

Allah’s Apostle (p.b.u.h) said, “When the Imam is delivering the Khutba, and you ask your companion to keep quiet and listen, then no doubt you have done an evil act.” Volume 2, Book 13, Number 56