Currently, Nyaa.si provides no way to notify users of new comments. I have written a server-side (HTTP) script which parses the comments and constructs an RSS feed (actually an Atom feed, but people seems to uses them interchangeably).

The script is hosted on https://nyaacomments.tk and the source code is available on GitHub.

Usage instructions are available at the hosted URL.