Whether covering a women's face is *wajib* has been debated for a long time. Since the side that assures that it is *wajib* has already been covered, I'll cover here the side that says it is not. I will be referring to the writings of [Sheikh Al-Albani][1], who is considered by many as the most prominent Sunni scholar in modern times to have come to criticize covering the face as being obligatory.

When it comes to the ayah in the question (Al Nur 24:31), the part that is in dispute is this:

> وليضربن بخمرهن على جيوبهن

The two crucial words are خمرهن (khumurihin) and جيوبهن (jiyubihin). According to Al-Albani, the first word is the plural of خمار (khimar) which he translates as *head* covering and the second word is the plural of جيب (jayb) which is the collar line (the area where a shirt/dress is cut off to expose the neck). So in this translation the ayah does *not* instruct Muslim women to cover their faces, but only their heads (as in their hair).

Then we have Al-Ahzab 33:59

> O Prophet! Tell your wives and your daughters and the women of the
> believers to draw their cloaks (veils) all over their bodies (i.e.
> screen themselves completely except the eyes or one eye to see the
> way). That will be better, that they should be known (as free
> respectable women) so as not to be annoyed. And Allaah is Ever
> Oft‑Forgiving, Most Merciful

The point of contention is the translation of the verb يدنين (yudneen), that many translate  (as in the above translation) as "to cover the face (with a veil)". Al-Albani postulates that the verb actually means "to bring closer" and does not specify the face. And the word جلابيبهن (jalabeebihin) is the plural of جلباب (julbab), which means "covering" without any specifics as to what it covers.

A third ayah, Al Ahzab 33:53

>  O you who have believed, do not enter the houses of the Prophet
> except when you are permitted for a meal, without awaiting its
> readiness. But when you are invited, then enter; and when you have
> eaten, disperse without seeking to remain for conversation. Indeed,
> that [behavior] was troubling the Prophet, and he is shy of
> [dismissing] you. But Allah is not shy of the truth. And when you ask
> [his wives] for something, ask them from behind a partition. That is
> purer for your hearts and their hearts. And it is not [conceivable or
> lawful] for you to harm the Messenger of Allah or to marry his wives
> after him, ever. Indeed, that would be in the sight of Allah an
> enormity.

The word حجاب (hijab) here means *screen*, and the ayah itself only concerns itself to conduct when entering a house (the prophet's house in particular) and not for day to day veiling. 

Furthermore, Al-Albani cites many hadith, such as:

> It was narrated that Jabir said: "I attended the prayer with the
> Messenger of Allah () on the day of 'Eid. He started with the prayer
> before the Khutbah, with no Adhan and no Iqamah. When he finished the
> prayer, he stood leaning on Bilal, and he praised and glorified Allah
> (SWT) and exhorted the people, reminding them and urging them to obey
> Allah (SWT). Then he moved away and went to the women, and Bilal was
> with him. He commanded them to fear Allah (SWT) and exhorted them and
> reminded them. He praised and glorified Allah, then he urged them to
> obey Allah, then he said: 'Give charity, for most of you are the fuel
> of Hell.' A lowly woman with dark cheeks said: 'Why, O Messenger of
> Allah?' He said: 'You complain a great deal and are ungrateful to your
> husbands.' They started taking off their necklaces, earrings and
> rings, throwing them into Bilal's garment, giving them in charity."
>
> (Sahih) [Sunan Al-Nasa'ai][2]

It is apparent here that since the narrator was able to describe the woman's cheeks that her face was *uncovered* in public. Something that was not commented on negatively.

> Yahya related to me from Malik from Yahya ibn Said from Amra bint Abd
> ar-Rahman that A'isha, the wife of the Prophet, may Allah bless him
> and grant him peace, said, "The Messenger of Allah, may Allah bless
> him and grant him peace, used to pray subh and the women would leave
> wrapped in their garments and they could not yet be recognised in the
> darkness."
> 
> [Muwatta Malik][3]

Al-Albani deduces that since it was the darkness (and only the darkness) that lead to the women becoming unrecognizable, then it comes to reason that they are recognizable in the light, which means that their faces were known and seen.

One more hadith is this one, although it's authenticity is disputed:

> Narrated Aisha, Ummul Mu'minin:
> Asma, daughter of AbuBakr, entered upon the Apostle of Allah ()
> wearing thin clothes. The Apostle of Allah () turned his attention
> from her. He said: O Asma', when a woman reaches the age of
> menstruation, it does not suit her that she displays her parts of body
> except this and this, and he pointed to her face and hands. Abu Dawud
> said: This is a mursal tradition (i.e. the narrator who transmitted it
> from 'Aishah is missing) Khalid b. Duraik did not see 'Aishah.
>
> [Sunan Abu Dawud][4]

This hadith has *direct* instruction on what *not* to cover. *But*, this hadith is weak according to Abu Dawud (see his commentary at the end of the quote), and most scholars. However, both Al-Albani and Al-Bayhaqi have disputed this classification.

The following pages (Arabic) have more on Al Albani's writings in the subject:

http://www.nationalkuwait.com/vb/showthread.php?t=69797

http://www.ikhwan.net/forum/showthread.php?18491-%D1%D3%C7%E1%C9-%C7%E1%D4%ED%CE-%C7%E1%C3%E1%C8%C7%E4%ED-%DD%ED-%CC%E6%C7%D2-%DF%D4%DD-%C7%E1%E6%CC%E5-%E6-%C7%E1%ED%CF%ED%E4


  [1]: http://en.wikipedia.org/wiki/Al-Albani
  [2]: http://sunnah.com/urn/1115830
  [3]: http://sunnah.com/malik/1/4
  [4]: http://sunnah.com/abudawud/34/85