block googlebot
I have a googlebot that is indexing one of my applications. The bot is causing a large number of hits. It doesn't seem to know what to do with the dynamic pages/reports. It caused 355,000 hits in one month, for 1 application.
I have tried putting a robots.txt file in the Apache htdocs home. That didn't not work.
Does anyone know how to stop googlebot from indexing applications/pages? I want to make it server wide.