Loki must be able to read minds because he smirks. 
We find them later on, trapped together in that cage doing the most questionable of things and Fury just jettisons them out because he can’t look away.