User manual MACROMEDIA COLDFUSION 5-ADVANCED ADMINISTRATION

[. . . ] Advanced ColdFusion Administration ColdFusion® 5 Macromedia® Incorporated Copyright Notice © 1999­2001 Macromedia Inc. This manual, as well as the software described in it, is furnished under license and may be used or copied only in accordance with the terms of such license. The content of this manual is furnished for informational use only, is subject to change without notice, and should not be construed as a commitment by Macromedia, Inc. assumes no responsibility or liability for any errors or inaccuracies that may appear in this book. [. . . ] Each connection implies a separate thread. Note Verity Spider's dynamic flow control makes the most use of all available connections when indexing Web sites. If you are indexing multiple sites, you may want to increase this number. Note that increasing the number of connections may not always help because of such dependencies as your network connection and the capabilities of the remote hosts. -delay Syntax: -delay num_milliseconds Type: Web crawling only. Details Specifies the minimum time between HTTP requests in milliseconds. The default value is 0 milliseconds for no delay. -header Syntax: -header string Type: Web crawling only Specifies an HTTP header to be added to the spidering request. For example: -header "Referer: http://www. verity. com/" Verity Spider sends some predefined headers, such as Accept and User-Agent among others, by default. Special headers are sometimes necessary to correctly index a site. 160 Chapter 8 Verity Spider For example, previous versions of Verity Spider did not support the "Host" header, which is needed for Virtual Host indexing. Also, a "Proxy-authentication" header was needed to pass a username and password to a proxy server. In Verity Spider V3. 7, the "Host" header is supported by default, and the -proxyauth option is available for proxy server authentication. Therefore the -header option is maintained only for backwards compatibility and possible future enhancements. Note Misuse of this option will cause spider failure. In the event that this happens, re-run the indexing task with modified -header values. -hostcache Syntax: -hostcache num_hostnames Specifies the number of hostnames to cache to avoid DNS lookups. Without this option, the host cache will continue to grow. The default value is 256. -noflowctrl Type: Web crawling only. Disables round-robin indexing of Web sites with network flow control. By default, Verity Spider uses round-robin indexing of Web sites to avoid overwhelming a Web server and to improve indexing performance. Verity Spider connects to each Web server in a round-robin manner, using up to the value for -connections. This means one URL is fetched from each Web server in turn. Note Using -noflowctrl may result in a significant drop in performance. -noproxy Syntax: -noproxy name_1 [name_n] . . . Used in conjunction with -proxy, -noproxy specifies that the Verity Spider directly access the hosts whose names match those specified. By default, when -proxy is specified, the Verity Spider first tries to access every host with the proxy information. [. . . ] With this in mind, if you have a Web server that uses many concurrent connections to a database, either use AVG_REQ_TIME rather than ROUND_TRIP_TIME as your load type, or include a database call in getsimpleload. jsp to make this load type's results more indicative of actual conditions. Output variables During processing, getsimpleload. jsp generates three significant output variables that are sent in response to the probe agent's HTTP query. · CCLOADVALUE CCLOADVALUE is the load calculated by getsimpleload. jsp using one of the available load metrics. The load value identifies how busy the server is as a percentage of its total capacity. · CCLOADMAX CCLOADMAX is the maximum acceptable time (in milliseconds) for a request to complete and marks the "busy threshold" for this server. [. . . ]