Should I proceed in dating this person?

Met this guy on a construction project at work, he is an IT contractor. The first day we met, I had to assist him while he did his install which resulted in us chatting for about 3 hours while he worked on the server (keep in mind, he speaks mostly portguese and I can only understand it not so much speak it, so we had to use a translator a lot of the time). He had to come back the following week to check something and that’s the day he messaged me saying he hoped it wasn’t inappropriate, but he wanted to take me out on a date. I asked him honestly how we planned to communicate, because english is his first language but I can understand/partly communicate in Portuguese. He said it wasn’t important to him and he really liked my personality and getting to know me.

Well for the next 2 and a half weeks he would message occasionally checking in, but also saying he wanted to see me but what so busy with work because his schedule was all over the place. Somewhere into the 2nd week since meeting, I kind of just said forget him because he clearly wasn’t serious or that interested.Fast forward to this past Friday, I end up seeing him at work again. He tells me that I stopped writing him and was sad I wasn’t interested. I countered back that I had written him last and was sick of him saying he wanted to go out, but never did. He asked if I was free later and said he wanted to take me out. We ended up going to a bar in my neighborhood and walking and talking for another few hours.

He told me from the first day he met me, he thought there was something different about me and was so excited to come back to the project the second day. Even said he told his friend about me and said he had never met someone he connected with so well, especially considering we don’t speak the same language. We also talked about lives, family, etc. It was a good talk. I invited him back to my place, just to have somewhere to talk that was more quiet and hang out, but somehow it turned into us sleeping together. I didn’t exactly plan it or want to initially, but it did happen. I didn’t love the fact that I felt like it was definitely initiated by him, and talked to him about it afterward. He said he didn’t want me to think that sex is all he wanted and he really enjoyed our time together.We’ve been texting since then, but still very sporadically.

Now, I am confused. Because 1)I don’t know if with the language barrier, his busy schedule, and various other reasons if there is a real future 2)I don’t know if I actually like him or just like that he likes me and 3)that sex thing through me for a loop and i don’t think I liked how insistent he was. I did however have a lot of fun with him and wondering if I should just keep it casual and more of an I see you when I see you type thing, although he did tell me he wants to be serious with me. Guess I’m just wondering what we think this is and should I keep seeing him.