[aida] How to serve a robots.txt

Herbert König herbertkoenig at gmx.net
Thu Sep 13 11:44:20 CEST 2012


Hi,

how do I serve a robots.txt to tell web crawlers which links to
follow?

How do I give it the correct URL?

Thanks,

Herbert                          mailto:herbertkoenig at gmx.net



More information about the Aida mailing list