how to get robots.txt at the root of IIS while running site studio
We are running site studio for our www website. We noticed that we are getting a lot of unwanted (maybe harmful search bots) crawling our site. We want to put a robots.txt file at the root of IIS to deny or limit what the bots do. When we put the robots.txt file at the root of IIS it doesn't get noticed because the Oracle ISAPI filter grabs all the traffic coming in including the bots and bypasses the robots.txt file.
Has anyone figured out a way around this so we can limit the bots on our site?
Thanks