に限って

only when; of all people

→ に
phrase Rare #32,895
only when; of all people Often emphasizes that something happens at an inconvenient or unexpected time, as in “only when...” or “of all times.” With a person, it can mean that person is especially unlikely to do something: 彼女に限って means “she, of all people.”
JA: 忙しい日に限って、急な仕事が入る。
EN: It’s always on busy days that unexpected work comes up.

あなたがいないときに限ってあなたが欲しい

It’s only when you’re not around that I want you.

シャワーをしているに限ってなんでいつも電話がかかるんだ

Why is it that the phone always rings whenever I’m in the shower?

寝れないに限って時計カチカチいう音が気になるものだ

It’s always when you can’t sleep at night that the ticking of the clock starts to bother you.

急いでるに限って・・・

It’s always when I’m in a hurry...

— 鏡 (1975)

彼女に限ってそんなことはない

She would never do such a thing.