Disappointment as select committee recommends taking vote from prisoners