It’s a valid and moderately common construction. This is called the generic (or indefinite) form of you. It’s primarily used as a colloquial or less formal substitute for one.

But yes, you do have to infer whom you is referencing from the context, so I could see why some might find it more confusing.