Every so often as I walked down the street, I'd encounter a group of Jewish schoolchildren heading the opposite direction, led and followed by teenagers with large military rifles.