I wouldn't shy away from your boss or make any upfront comments that could leave her embarrassed. That might make a negative impact on your professional relationship with your her. Just let her be flirty, but never flirt back and remain professional. She will either lose interest or not. Either way is good. Either the situation is diffused or you end up getting "special treatment" from your boss without anything in return.