Transposed instruments and custom key signature

Hi! How do you do custom key signature on transposed instrument? When I try to change the key signature to something custom it still transposes to something non custom

Welcome to the forum, @sotadnima. Are you using a non-12-EDO tonality system, or are you only modifying the key signature to be a custom combination of flats and sharps? If you’re doing the latter, Dorico should be clever enough to transpose the key signature for transposing instruments on its own. If you’re doing the former, however, Dorico will only be able to do it if the pitch deltas of the accidentals in the tonality system are amenable to transposing by the (12-EDO) interval described by the instruments.

Probably the simplest way to diagnose what might be going on would be for you to attach a small chunk of the project here so we can take a look.