You will need to include all the other IDs, but in your case I can see how this would be painful (especially if you start dealing with Facebook or Reddit level of comments).
In your case, a custom GQL resolver may be the answer, you can find our custom resolver documentation here: https://strapi.io/documentation/v3.x/plugins/graphql.html#customize-the-graphql-schema