Josh, What model trim contoller do you have? Sounds like you might have a dual axis controller and harness for single axis use. Should have 10 wires for single axis and 14 for dual axis - none doubled up.

On current single axis models - #3 (yellow) should go to red (+) on the servo and #4 (also yellow) should go to black (-) on the servo.

Greg