There's notarization service available in the Tainan City courthouse. I think it's only available in the morning. They can notarize documents in English and it was accepted by the government in the US. Very friendly and quick.
Also there is the info you need to get your marriage registered by the court.