Giants have pulled Josh Brown from this weekend's game