I understand a little Portuguese and French, and I can read a lot more than that.
My Spanish was fluent, I even got mistaken for a native (often) when I lived in Spain, but that was years ago. When mono-lingual American’s ask if I speak Spanish, I tell them “Yes.” When native speakers ask about my Spanish, I say “No,” or “Only a little.”
At my current Japanese level, I would only claim, “I’m learning.” I can’t understand more than a few sentences when I watch TV, it takes a long time to read and only at the most basic level, and I have to stop and think about everything I see and hear. When I achieve some fluency, I might claim, “I speak a little.” Only when I become very comfortable speaking, hearing, and reading will I answer, “Yes, I speak Japanese.”
But I learned never to accept a compliment, so to Japanese people who ask, I will always answer, "いいえ、全然！”