Robots.txt is used by a website to communicate to search engine robots and crawlers about which area of the website shouldn’t be processed or scanned. In this section of the Admin Panel the user can define the path to exclude. By default, all the unfriendly URLs starting with /eshop/ will be disallowed.