Robots txt

Usage

You can use the Robots.txt package by going to the SEO Toolkit section. Here you'll find a Robots.txt node where you can add your configuration of the robots.txt file.

If you do not see the SEO Toolkit Section, then make sure to give your group access to that section.

After hitting save, your robots.txt file can now be found at the root of your domain. So if your domain is https://test.com, then it'll be located at https://test.com/robots.txt.