Hunter's Keep and Secrets

After I dine with the sisters, they become all reclusive and I need to lure them out with a Secret. That’s cool, I like that. Once I’ve done that, though, I still have the Secret, and can lure them out again and again. That seems like a bug - shouldn’t it spend the Secret when I lure them out?[li]