Should media be deleted with entry?

When an entry is deleted, shouldn’t any media attached to it be deleted also?

I’m using the AWS plugin and when I delete an entry(through the API or admin panel) the media is not deleted with the entry.