This is likely an issue common in many AI tools. In Japanese, people are mentioned by their names, without any indication of gender. When translating from Japanese to English, this app defaults to the male pronoun, which not only makes for incorrect translations half the time, but also perpetuates gender imbalances. Maybe using “s/he” could be a solution? Or asking the user to select a gender? Or using non-gender specific pronouns?PS. Awhile ago I read this book called “Weapons of Math Destruction: How Big Data Increases Inequality and Threatens Democracy (2016)”, in which the author exposes ways that big data and algorithms can unintentionally do harm in society by perpetuating stereotypes or leading to false conclusions based on flawed input. A good read for anyone including app developers and people who work with AI.