Robots.txt: Like a stoplight, a robots.txt file presents online search engine spiders or crawlers route. You’ll use this file to permit spiders to crawl your website. It's also possible to utilize it to prevent them from visiting URLs like your compensated landing webpages. But How would you make this come https://www.youtube.com/watch?v=RSlwOZLlUGg