it's a bit hard to translate from the textbook but i will try my best. Like you said there is a disagreement between scientists about the minimum number , actually there is 15 different opinions all mentioned by El Hafyz in his book "El Fath" , the preponderant opinion is that the friday prayer " salaat el jumuah" is correct to be conducted for 2 or more , because of this narrative "الاثنان فما فوقهما جماعة" which means anything above 2 is jamaat. El shookany said : "jumuah prayer is a jamaat prayer and there will be no exception unless there is a proof , and there is no proof, there is no proven narrative talking about the minimum number of people in salaat el jumaah."
I hope this help .
according to the text referenced a jamaat is 2 or more, so apply the knowledge which has been granted to you, the imam conveys to a jamaat if it's just him and 1other then he is conveying to 1 single person not 2 or more which is constituted as a jamaat. so it is logical that there must be at least 2 other than the imam, is it starting to make scents. Applying knowledge in it's simplistic form "with out external attachments/ interference" leads to the acquiring of wisdom...
Like any library, Islam Stack Exchange offers great information, but does not offer personalized advice or legal verdicts, and does not take the place of seeking such advice from your Mufti, Imam, or other trustworthy Counselor.