It's easy to leave a challenge, and and any challenger can exit a challenge, if they wish, at any time. First, open the challenge screen, and tap on the challenge info button at the top right of the challenge path:

On the challenge info screen, scroll down to the bottom, and tap the "Leave the challenge" link.
​

When prompted, confirm your selection. Voila!