App specific Robots.txt to prevent crawling based on toml or other config

Questions / Help
1

Hi,

Is there any guide or suggestion as to set robots.txt based on either the toml config or other means?

My specific use case is: I have separate toml file for each stage of environment (dev, staging, prod, etc) I would like to prevent crawling based on each of these environments, but have not figured out a good way to do this yet.

I would appreciate any idea I can try!

2

This topic was automatically closed 7 days after the last reply. New replies are no longer allowed.