Hello,
Yes,if you want to connect any client with NTP server you need to put server IP in the client side.
Like if you want to make your windows NTP client you will put the IP address of the server or if you are using any NTP client app .
Further i have attached some screen shots for your assistance.
Thank you .
Regards,
Ahmed Rehan