You've entered an area that is off limits to you. Guards will kick you out if you're spotted, as represented by the vision cones in front of them. You can also gain suspicion if you loiter in the area too long.