It's hard to tell what exactly happened with this little context. Doing something bad, it hurting, people who used to be there being gone - not to mention the odd statement that she was supposed to remember and.. grow? Grow what?

It could be anything. Especially when Inigo is well aware at this point of how varied all the worlds out there that this place pulls from are.

He hums at least, to acknowledge he's listening, even if he needs a moment longer to think about this before he answers. "Do you worry about the bad thing you did..?"