Those are the seed pods the seeds are inside - there will be 100's of them, they are papery and loose viability within days of maturing as in this species the seed coat is paper thin and often ruptures on maturity. This means the seed dries out very quickly. Remove the pods or not - it won't hurt / affect the vine or its flowering.