Indexing and Search Engines
807567Apr 23 2009 — edited Apr 25 2009I am running Sun One Web Server 6.1 on Windows.
We have Directory indexing set to NONE so that we can control access to resources within our Web Application.
However, I also have a Ultraseek Search Engine that needs permission to crawl our site and Index the content. Is there a way to allow a single IP address full access to the content without letting the whole world see everything?
If I set indexing to None than my search engine is locked out too.
Any insight or help will be greatly appreciated!!
Thanks,
Deborah