The Quran as the word of God sets rules and guidance for us in all
aspects of life. The hadith doesn't seem to me to be the same, so
based on the Quran how far should we go?
Well, from the Quran, we know the best Hadith is the Book Allah revealed, as Allah himself says:
Allah has sent down the best/aHsan Hadith: a consistent Book wherein is reiteration. The skins shiver therefrom of those who fear their Lord; then their skins and their hearts relax at the remembrance of Allah . That is the guidance of Allah by which He guides whom He wills. And one whom Allah leaves astray - for him there is no guide. (Quran 39:23)
Allah tells us the Book is for judgment and detailed:
"Say: "Shall I seek for judge other than God? - when He is the One who has sent to you the Book, explained in detail/Mufassalan." They know full well, to whom We have given the Book, that it has been sent down from your Lord in truth. Never be then of those who doubt" (Quran 6:114)
It is protected from falsehood as it comes from the Wise and Praiseworthy:
"...And indeed, it is surely a mighty Book. Falsehood shall not come to it from before it nor from behind it; a revelation from the Wise, the Praiseworthy" (Quran 41:41-41)
The Quran was the noble speech of the Messenger:
"it is indeed the speech of a noble Messenger" (Quran 69:40)
Allah would have punished the Messenger for saying other things:
"And if he had made up about Us some sayings, We would have seized him by the right hand; Then We would have cut from him the aorta." (Quran 69:44-46)
And there are numerous other ayat.
Now the issue with Hadith's authority and authenticity has been a hot topic of dispute among Muslims since the early generations. A 9th century scholar named al-Shafii, recorded his debates with Muslims who totally rejected Hadiths in his book al-Jami al-Ilm and some in Kitab al-Umm. He was one of the early proponents of Hadiths and had an opposition from Muslims who were labeled as 'Ahlul Kalam' i.e. People of Kalamullah/Speech of Allah (Quran). They believed/believe the Quran is the primary and only revelation from Allah and the Prophet didn't receive anything else.
I think there's no problem in taking authentically proven Hadiths as historical accounts, but when it comes to laws, then Quran should be the primary source. This is the safest, as it's in obedience to both Allah and his Messenger, and no Muslim will dispute the Quran.