I haven't sent out the survey to the customer but still there seems to a rating on the ticket. How is this possible?

If you have enabled the satisfaction surveys, the customers would also have the ability to rate the closed ticket from the customer portal itself.

Please check whether it is enabled in Admin -> Workflows -> Customer satisfaction and toggle the survey off if you do not want this to go out to customers.