The first castle at Raglan was a Norman motte and bailey which survived until the early 15th century when it came into the hands of Sir William ap Thomas, a Welsh knight who had fought at Agincourt (1415). About 1435 he began building the Great Tower, an unusual hexagonal keep, surrounded by its own moat. The yellow stone from which it was built gave it its name, the Yellow Tower of Gwent.