Two of the existing Latin Schools in Amsterdam were joined together in 1666 in the former Aalmoezeniershuis (almhouse) on Singel 451-457. In 1897 the premises were rebuilt and acquired their current dimensions. A number of years ago the building was renovated again. Not much is left of the old Aalmoezeniershuis, only the archway can be identified, incorporated in the modernized facade.

Two of John Adams's sons, John Quincy and his younger brother Charles, went to the Latin School in 1780. Their stay was of short duration. The two brothers did not settle in, partly because they did not speak Dutch. When a teacher threatened to punish one of the children because he felt the boy was not trying, Adams took both boys out of school. He arranged for them to be privately taught in Leiden and to follow lectures at the local university.