Before the revelation the prophet pbuh was not known for having followed any of the pagan believes and for rejecting them and rejecting even accepting their deities or to swear by their names. He is said to have been following the (true) religion of Ibrahim this can be found in the long sahih narrations of al-Bukhari here and here and that of Sahih Muslim... here an extract from it:

A RAPID REVIEW OF MUHAMMAD'S BIOGRAPHY BEFORE COMMISSIONING OF THE PROPHETHOOD:

Prophet Muhammad (Peace be upon him) was, in his youth, a combination of the best social attributes. He was an exemplary man of weighty mind and faultless insight. He was favoured with intelligence, originality of thought and accurate choice of the means leading to accurate goals. His long silence helped favourably in his habit of meditation and deep investigation into the truth. His vivid mind and pure nature were helpfully instrumental in assimilating and comprehending ways of life and people, individual and community-wise. He shunned superstitious practices but took an active part in constructive and useful dealings, otherwise, he would have recourse to his self-consecrated solitude. He kept himself aloof from drinking wine, eating meat slaughtered on stone altars, or attending idolatrous festivals. He held the idols in extreme aversion and most abhorrence. He could never tolerate someone swearing by Al-Lat and Al-'Uzza. Allâh's providence, no doubts, detached him from all abominable or evil practices. Even when he tried to obey his instinct to enjoy some life pleasures or follow some irrespectable traditions, Allâh’s providence intervened to curb any lapse in this course.
Ibn Al-Atheer reported Muhammad (Peace be upon him) as saying: “I have never tried to do what my people do except for two times. Every time Allâh intervened and checked me from doing so and I never did that again. Once I told my fellow-shepherd to take care of my sheep when we were in the upper part of Makkah. I wanted to go down to Makkah and entertain myself as the young men did. I went down to the first house of Makkah where I heard music. I entered and asked: "What is this?" Someone answered: "It is a wedding party." I sat down and listened but soon went into deep sleep. I was awakened by the heat of the sun. I went back to my fellow-shepherd and told him of what had happened to me. I have never tried it again.”

Al-Bukhari reported on the authority of Jabir bin 'Abdullah that he said: “While the people were rebuilding Al-Ka'bah, the Prophet Muhammad (Peace be upon him) went with 'Abbas to carry some stones. 'Abbas said: "Put your loincloth round your neck to protect you from the stones." (As he did that) the Prophet (Peace be upon him) fell to the ground and his eyes turned skyward. Later on he woke up and shouted: ‘My loincloth... my loincloth.’ He wrapped himself in his loincloth.” In another report: “His loins were never seen afterwards.”

The authorities agree in ascribing to the youth of Muhammad (Peace be upon him) modesty of deportment, virtuous behaviour and graceful manners. He proved himself to be the ideal of manhood, and to possess a spotless character. He was the most obliging to his compatriots, the most honest in his talk and the mildest in temper. He was the most gentle-hearted, chaste, hospitable and always impressed people by his piety-inspiring countenance. He was the most truthful and the best to keep covenant. His fellow-citizens, by common consent, gave him the title of Al-'Ameen (trustworthy). The Mother of believers, Khadijah (May Allah be pleased with her) once said: He unites uterine relations, he helps the poor and the needy, he entertains the guests and endures hardships in the path of truthfulness.

IN THE SHADE OF THE MESSAGE AND PROPHETHOOD

IN THE CAVE HIRA:

When Prophet Muhammad (Peace be upon him) was nearly forty, he had been wont to pass long hours in retirement meditating and speculating over all aspects of creation around him. This meditative temperament helped to widen the mental gap between him and his compatriots. He used to provide himself with Sawiq (barley porridge) and water and then directly head for the hills and ravines in the neighbourhood of Makkah. One of these in particular was his favourite resort — a cave named Hira’, in the Mount An-Nour. It was only two miles from Makkah, a small cave 4 yards long and 1.75 yard wide. He would always go there and invite wayfarers to share him his modest provision. He used to devote most of his time, and Ramadan in particular, to worship and meditation on the universe around him. His heart was restless about the moral evils and idolatry that were rampant among his people; he was as yet helpless because no definite course, or specific approach had been available for him to follow and rectify the ill practices around him. This solitude attended with this sort of contemplative approach must be understood in its Divine perspective. It was a preliminary stage to the period of grave responsibilities that he was to shoulder very soon.
Privacy and detachment from the impurities of life were two indispensable prerequisites for the Prophet’s soul to come into close communion with the Unseen Power that lies behind all aspects of existence in this infinite universe. It was a rich period of privacy which lasted for three years and ushered in a new era, of indissoluble contact with that Power.

Before the revelation the prophet pbuh was not known for having followed any of the pagan believes and for rejecting them and rejecting even accepting their deities or to swear by their names. He is said to have been following the (true) religion of Ibrahim this can be found in the long sahih narrations of al-Bukhari here and here and that of Sahih Muslim... here an extract from it:

A RAPID REVIEW OF MUHAMMAD'S BIOGRAPHY BEFORE COMMISSIONING OF THE PROPHETHOOD:

Prophet Muhammad (Peace be upon him) was, in his youth, a combination of the best social attributes. He was an exemplary man of weighty mind and faultless insight. He was favoured with intelligence, originality of thought and accurate choice of the means leading to accurate goals. His long silence helped favourably in his habit of meditation and deep investigation into the truth. His vivid mind and pure nature were helpfully instrumental in assimilating and comprehending ways of life and people, individual and community-wise. He shunned superstitious practices but took an active part in constructive and useful dealings, otherwise, he would have recourse to his self-consecrated solitude. He kept himself aloof from drinking wine, eating meat slaughtered on stone altars, or attending idolatrous festivals. He held the idols in extreme aversion and most abhorrence. He could never tolerate someone swearing by Al-Lat and Al-'Uzza. Allâh's providence, no doubts, detached him from all abominable or evil practices. Even when he tried to obey his instinct to enjoy some life pleasures or follow some irrespectable traditions, Allâh’s providence intervened to curb any lapse in this course.
Ibn Al-Atheer reported Muhammad (Peace be upon him) as saying: “I have never tried to do what my people do except for two times. Every time Allâh intervened and checked me from doing so and I never did that again. Once I told my fellow-shepherd to take care of my sheep when we were in the upper part of Makkah. I wanted to go down to Makkah and entertain myself as the young men did. I went down to the first house of Makkah where I heard music. I entered and asked: "What is this?" Someone answered: "It is a wedding party." I sat down and listened but soon went into deep sleep. I was awakened by the heat of the sun. I went back to my fellow-shepherd and told him of what had happened to me. I have never tried it again.”

Al-Bukhari reported on the authority of Jabir bin 'Abdullah that he said: “While the people were rebuilding Al-Ka'bah, the Prophet Muhammad (Peace be upon him) went with 'Abbas to carry some stones. 'Abbas said: "Put your loincloth round your neck to protect you from the stones." (As he did that) the Prophet (Peace be upon him) fell to the ground and his eyes turned skyward. Later on he woke up and shouted: ‘My loincloth... my loincloth.’ He wrapped himself in his loincloth.” In another report: “His loins were never seen afterwards.”

The authorities agree in ascribing to the youth of Muhammad (Peace be upon him) modesty of deportment, virtuous behaviour and graceful manners. He proved himself to be the ideal of manhood, and to possess a spotless character. He was the most obliging to his compatriots, the most honest in his talk and the mildest in temper. He was the most gentle-hearted, chaste, hospitable and always impressed people by his piety-inspiring countenance. He was the most truthful and the best to keep covenant. His fellow-citizens, by common consent, gave him the title of Al-'Ameen (trustworthy). The Mother of believers, Khadijah (May Allah be pleased with her) once said: He unites uterine relations, he helps the poor and the needy, he entertains the guests and endures hardships in the path of truthfulness.

IN THE SHADE OF THE MESSAGE AND PROPHETHOOD

IN THE CAVE HIRA:

When Prophet Muhammad (Peace be upon him) was nearly forty, he had been wont to pass long hours in retirement meditating and speculating over all aspects of creation around him. This meditative temperament helped to widen the mental gap between him and his compatriots. He used to provide himself with Sawiq (barley porridge) and water and then directly head for the hills and ravines in the neighbourhood of Makkah. One of these in particular was his favourite resort — a cave named Hira’, in the Mount An-Nour. It was only two miles from Makkah, a small cave 4 yards long and 1.75 yard wide. He would always go there and invite wayfarers to share him his modest provision. He used to devote most of his time, and Ramadan in particular, to worship and meditation on the universe around him. His heart was restless about the moral evils and idolatry that were rampant among his people; he was as yet helpless because no definite course, or specific approach had been available for him to follow and rectify the ill practices around him. This solitude attended with this sort of contemplative approach must be understood in its Divine perspective. It was a preliminary stage to the period of grave responsibilities that he was to shoulder very soon.
Privacy and detachment from the impurities of life were two indispensable prerequisites for the Prophet’s soul to come into close communion with the Unseen Power that lies behind all aspects of existence in this infinite universe. It was a rich period of privacy which lasted for three years and ushered in a new era, of indissoluble contact with that Power.