Windwalk has 2 affects when used, only one of them is fly. When you were previously affected by fly it was not overwritten by using wildwalk, so you only gained the other affect.

So in this situation, when fly drops off, you are still under the other windwalk affect but not flight.