We use this expression to say something does not suit us or is not right for us.
Don't you like those trousers?
I tried them on, but they're just not me. Yellow is not my colour.
If you were a lawyer you could earn a fortune.
Maybe, but that's just not me. I couldn't stand the stress of a job like that.