Should i stay or should i go?

so ok i met this guy about 3 weeks ago.. basically he laid it all out for me.. he is 24 and back when he was in his teenage years he messed up alot and ended up in prison 2 times for 2 months a piece, and even got in trouble for armed robbery at a fast food joint... he said this was all like 6+ years ago. he also used to be addicted to meth but has been clean for 4 years. He has a daughter who is 3 he was with his babies mom for 7 years and 3 months ago she dumped him cuz she wanted to be single.. and he said he supported her all the way through college and after she dumped him he left her the apartment and is now staying at his moms apartment on the floor since his mom, sisters, and uncle lives there too.. he says he wants his own place but he cant live alone.. he works and says he has 2 cars but their broken so he is always borrowing his sisters cars to come see me.. basically we hung out 4 times only once did he take me to a movie.. the rest we just stayed at my place. he wants me to meet his kid and family.. heres the problem even though i had my issues with drugs and legalities in the past i have moved on.. i am working on my degree in school, and work 2 jobs, and also have a 10 month old son.. i just feel like he would drag me down.. am i asking too much for wanting a guy who can take me out, and that has a car, his own place, and a lucrative job? should i just cut him loose especially since hes broke all the time?