Personally, I'm a fan of honesty. I would say if you decide to go out with him then be up front about the casual relationship with nothing serious in mind. If he wants something more serious then don't do it. Be honest with yourself as well.
How can you not like him but still be considering dating him? If you don't like him, you don't like him.