Supervised NT-Xent loss (Khosla et al. 2020), let's first look at the self-supervised version of NT-Xent loss. NT-Xent is coined by Chen et al. 2020 in the SimCLR paper and is short for "normalized temperature scaled cross entropy loss‣”. It is a modification of the multi-class N-pair loss with addition of the temperature parameter (𝜏) to scale the cosine similarities. Chen et al. found that an appropriate temperature parameter can help the model learn from hard negatives. 여기서 temperature parameter 을 의미하며, 이 파라미터로 스케일링을 해 줘서 temperature-scaled