I only need accommodation for part of my trip
You'll enjoy the museums and historical sites in Gamlebyen. You might want to make time for a stop at Old Town Model Train Center or Østre Fredrikstad church.