I like how Sorcerer works, too. You as the imposed-upon player can decide yes or no, but their success against you are penalty dice if/when you do something opposed to what they want.