Why did Jesus have to die?

Why couldn't God forgive humanity without Jesus' death? Why was Jesus' crucifixion needed in order to forgive sins? These are common questions from Muslims and atheists, who think that Christianity is nonsensical because it requires death to bring forgiveness. These questions go right to the heart of what the Gospel of Jesus Christ is all about.