No, Siri does not only listen to your voice. While Siri can be trained to respond more accurately to your voice using “Hey Siri” setup, it may still respond to other voices. This voice recognition process is designed for convenience, but it is not as secure as biometric authentication methods like Face ID or Touch ID.