Automatic question-answering is a classical problem in natural language processing, which aims at designing systems that can automatically answer a question, in the same way as human does. The need to query information content available in various formats including structured and unstructured data has become increasingly important. Thus, Question Answering Systems (QAS) are essential to satisfy this need. QAS aim at satisfying users who are looking to answer a specific question in natural language.Moreover, it is a representative of open domain QA systems, where the answer selection process leans on syntactic and semantic similarities between the question and the answering text snippets. Such approach is specifically oriented to languages with fine grained syntactic and morphologic features that help to guide the correct QA match. Furthermore, word and sentence embedding have become an essential part of any Deep-Learning-based natural language processing systems as they encode words and sentences in fixed-length dense vectors to drastically improve the processing of textual data. The paper will concentrate on incorporating the sentence embedding with its various techniques like Infersent, ElMo and BERT in the construction of Question Answering systems, and also it can be used in game play.