With four minutes to spare, Lex finished his first version of the castle for the tavern, and wiped the sweat off his brow. It was not the heat that made him sweat, although the fires were so hot that they started to destabilise space!
Just like how Lex could use brute force to break space, if he used a bit of his space affinity or spatial laws to target the space, the accumulated heat in the forge reached such an intensity, not just in terms of temperature but also spirituality, that the Midnight realm was unable to tolerate it.
Lex had to actively strengthen the space around them to continue the forging process. Lex had thought that the small amount of diverted attention would have made the castle weaker by the smallest amount, yet it was while he supported space and simultaneously forged that he had an epiphany.
He suddenly gained a tremendous amount of insight into how the various aspects of forging a treasure affected one another, and so he immediately summoned Fenrir.