"I didn't think you were the type to care about what other people thought." And he doesn't think he's wrong either. Shinjirou speaks his mind; it's one of the things Jade enjoys about him.

Which means there's more to this. Someone he doesn't want to find out, perhaps? Of course, he could be wrong, so he doesn't push the point.

"Still, if it's such a big concern, I suppose I could continue keeping you locked up in here."