yes in most cases this is fine and preferable.
thinking out loud
But actually if the compressor is nuanced or finely tuned with the threshold setting and is capable it will behave drastically different with what you put into it even on silent. You can get it to react with any sound and you are right in thinking a short sound with a simpler dynamic is great to trigger it accordingly through out a track. Ghost track sidechaining.
But you can be super technical about it. Like if you use a lighter maybe even reverbed hipassed sound, you will notice the sub floor of an individual sound, or the underside of a two component dynamic with quick reacting hi and physically felt lo, is the thing that ‘moves’ the sidechain. Whereas the hi part of the sound will be the one to trigger it first (ofcourse) but stay with me here lol… if you put a quickly triggering hi sound with a slow reacting sub part - its a completely different shape than the square-ish shape we got from the ghost track sidechaining. It’s like an ellipzoid or triangle and it changes the reaction of the compressor accordingly. Also the slightly hi ‘tinged’ rimshot sound will force the threshold to be quite open which again changes the dynamics. So its good to trigger with a short rimshot because the decay is short and neat, but the lo part can be severely or ruffly cut short - again that can sound dynamic too.
On a complex level you could go through having regularly sidechained a track with ghost hits and then go to town and side -shape some bits one more time.
I use similar approach to cut and shape reverb tails of sounds. That way you can throw tons of stuff in and balance it more. (Tho I just like overly reverbed stuff so it doesn’t sound managed in my tracks but it is compared to how much reverb there really is lol).