We used the Premier Inn, Holes Bay, when attending a friends Wedding - loads of other Ferry travellers over-nighting when we last stayed. Usual PI arrangement, with Pub Restaurant alongside.
It's a walk into Town, or the Quay & not far from Poole Speedway. Poole Quay is Tuesdays, I think Speedway is usually Wednesdays.