Will anyone find out about my appointment?

In short: no. Only in the case where your health or safety is at risk will knowledge of your appointment be shared with anyone else.