Could mean multiple bards trying to sleep the same person. i.e. one bard's successful attempt suffers a duration penalty due to the other bard's failed attempts.

Failed blackjack/etc. give something that sounds specifically physical ("physical sleep protection"). I was just wondering if that would impact bard sleep duration.