I only need accommodation for part of my trip
You'll enjoy the museums and cafes in Taitung City Centre. You might want to make time for a stop at Taitung Night Market or Tiehuacun.