You're trying to sort sets, and Python isn't sure how to order them. Take your scores out of the sets, and then you can sort as expected.
dict(sorted(hashmap.items(), key=lambda x: tuple(x[1])[0]))
That's pretty ugly though, you may want to do the cleanup in a separate step.
与恶龙缠斗过久,自身亦成为恶龙;凝视深渊过久,深渊将回以凝视…