To stay away from undesirable articles from the look for indexes, webmasters can instruct spiders not to crawl specific documents or directories in the standard robots.txt file in the root directory in the area. On top of that, a page may be explicitly excluded from the search engine's database through https://news.rafeeg.ae