Do I get notified when queries are created or responded to?

No, and we suspect your inbox thanks us for that.

But you can easily filter the list of queries so you see only the queries that the site has responded to.