Should i stay or should i go?are we important enough to him?

ive been in a difficult relationship with my man for 7 years now,we have 2 beautiful boys now 2 and 3 yrs old,we have had lots of break-ups over the years mainly due to family interfearence,after the last break-up i had with him i went off with someone else,hopeing to make a happier life for myself and my boys,my boys dad then moved about 300 miles away,however my heart still belonged to him and i had to leave that person for fairness in this,ive got back with the father again but he lives miles away now,ive put the effort into seeing him twice leaving me with very little money,he arranged to come and see me but cancelled at the last minute saying his job forgot to give him the time off(agency)but he can come and see me real soon after hes got a car,but only for 1 day!hes also expecting me to move to where he is coz he doesnt like the town im living in and refuses to move back,his kids are missing him real bad to,i tried to explain to his 3 yr old son that daddy wasnt coming to see him that day as was arranged and now he keeps sayin that daddy hates him,i feel so let down for my son and myself and im frightened of being just used!am i being to demanding?