App specific Robots.txt to prevent crawling based on toml or other config


Is there any guide or suggestion as to set robots.txt based on either the toml config or other means?

My specific use case is: I have separate toml file for each stage of environment (dev, staging, prod, etc) I would like to prevent crawling based on each of these environments, but have not figured out a good way to do this yet.

I would appreciate any idea I can try!

This topic was automatically closed 7 days after the last reply. New replies are no longer allowed.