Temperature-Adaptive Transformed Teacher Matching
This paper introduces a sample-wise inverse-temperature update for TTM by locally minimizing the Kullback-Leibler divergence between the temperature-scaled teacher distribution and the student's prediction and derives closed-form first and second derivatives with respect to the inverse temperature.