Same as we may see with Mischa, Hannibal have very strong connections that even if they should't, they cross conventional standards for love (platonic, that with family, obsession and romantic love). And i think it was similar, it was the only person who provided him comfort after such a big trauma he lived through.