The Ministry of Justice says there will be an investigation.
Nicholas Casley was 59 and from Mullion in Cornwall.
He'd appeared at Truro Crown Court last week, where he pleaded guilty to a total of 14 charges - including 2 for having sex with a child.
He was due to be sentenced today (Thursday 19th July)
The Justice Secretary David Gauke is currently involved with improvements at the troubled prison, after an Inspector raised serious concerns about a number of issues - including self harm and suicide.
Misconduct inquiry into suspended chief constable suspended
Good time for dolphins in Torbay
Devoncast - traffic, trees and Toby Buckland
Shoplifting and violent crime up in Devon and Cornwall
Riviera Airshow fit to fly
How Torbay Hospital bosses are tackling 'risks'
