The monastery is built in part at the top of the cliff, in part halfway down. At the top, there is a three-chambered chapel. Below, the walls of the canyon form one of the four walls of the structures. There are caves within the monastic complex, khachkars, and carvings. St Mark's Church was built by the Princes Zakare and Ivane Zakarian in 1187. The other buildings were built by Abbot Samuel in 1206.
The bottom monument complexes of Horomayri are stretched in the same way as the main church of St. Virgin in the convent of Bardzrakash St. Gregory for the same reasons - highly constrained terrain.