You need two permanent residents(or citizens) as witness and bring your single & birth certificate to the Court between old port and chinatown. Tell them your prefer marriage date/time and after about 2 weeks, they will mail you the confirmed date/time/room and then you can get married with your lover at the specified time, but still need to bring the 2 witnesses