Yes, it is totally fine.
We have customers that are located in many parts of the world, and often their website is not in English. That is no problem at all. Generally speaking the text link we would provide would be an English link, but it can be placed on any website you wish.