Dropping the dreamfeed?

Well it's not technically a dreamfeed as he wakes himself for a feed around 10pm but I feel it's more habit than hunger as he will easily go 4hrs during the day between feeds yet he wakes for this feed only 3hrs after he has gone to bed. He has 4 good breastfeeds during the day (plus the 10pm one) and 3x solid meals of good amounts.

I would actually prefer him to wake for a feed in the early hours than this one as at least then I can go out for the evening and not worry about having to be home to feed him at 10pm plus I'm looking at going back to work part-time soon and wouldn't get home until 11.30pm so would have to express.

So how do I go about dropping this feed? We have tried getting Hubby to go into resettle him but he just sobs his little heart out and trys to clamber out of hubby arms to get to me and so I give in and feed him. Do I just need to toughen up and perservere??