I have heard numerous times that taking note on Friday Jummah sermon is discouraged. I do not really understand the reason why? People who claim its not allowed because it will be a type of innovation.

What did I just innovate? I have attended Jummah throughout the years. I have even dosed off during the listening to the Jummah because of which I didn't know what was said. However, for couple of times, I took notes when listening to the Jummah sermon and I found that it boosted my concentration towards the Jummah sermon and for the first couple of times I actually remembered what was said in sermon.

So I wonder, is taking note really a type of innovation/Bidah?

Clear reference from Quran and Sunnah would be appreciated.