Toward the end of the Mamluk period, there is evidence from the chief rabbi of Jerusalem, David ben Shlomo Ibn Zimra (1479-1573), who wrote that the city’s Jews regularly went to the Temple Mount in order to view the entire temple ruins and pray there. He added that “we have not heard or seen anyone object to this.”
Source: F.M. Loewenberg. Middle East Quarterly. Summer 2013, pp. 37-48. http://www.meforum.org/3556/temple-mount