Nope; all or nothing.

So basically you're increasing the damage of hurl, which is a skill that does weak damage and you don't use for damage purposes. On the other hand, possibly a bit of free damage on a skill you want to use anyway.