Using vspider.exe to search Virtual Hosts on Apache

[UniWebDude]

Hi there,

We are running apache v2, CFMX 7 standard on windows 2003 server.

I want to create spiders that index at the various virtual hosts we run on the
apache server.

The servers main name is spider.ucc.ac.uk (thats what localhost points to).

It also runs our external website [url]www.ucc.ac.uk[/url]
Another site extranet.ucc.ac.uk
And things like [url]www.cote.org.uk[/url]

So far I have not suceeded in getting this to work (and I have downloaded the
style sets update for cfmx7).

My command text file for extranet looks like this :

-style C:\CFusionMX7\verity\Data\stylesets\ColdFusionVspi der
-collection c:\CFusionMX7\verity\collections\spider_extranet
-start d:\\extranet\\http\\index.html
-cgiok
-abspath
-prefixmap mappathex.txt
-loglevel trace

and the prefixmap text file like this :

-----------------start of mappath.txt----------------------------
#SourceField SourcePrefix DestField DestPrefix Flag
VdkVgwKey d:\extranet\http URL [url]http://extranet.ucc.ac.uk/[/url] /
-----------------end of mappath.txt----------------------------


Can anyone tell me what I am doing wrong as this does not work.

Cheers,

Matt

[UniWebDude]

Anyone ? I can't believe nobody else has this issue....

[chwagssd]

I am having trouble too, but what I suggest is that you look at your -start
command, as I have gotten it to work with the following arguments (although it
skips some pages, which is why I am visiting this forum)

vspider.exe -style C:\CFusionMX7\verity\Data\stylesets\ColdFusionVspi der
-collection C:\CFusionMX7\verity\collections\invivospider -start
[url]http://localhost/future/prod.cfm[/url]


Notice how there are only single \ except for http:// . Try to change it to
something simple like this. Also, see
[url]http://www.macromedia.com/cfusion/knowledgebase/index.cfm?id=50f419a[/url] and make
sure that you have set the path variable. If you do get it to run, you have to
register it in the Coldfusion Administrator... good luck, I have the same setup
as you. Oh, and about the virtual host thing, I don't think that matters. Just
setup a different collection for each site. When you are finished, if your
collection were named "invivospider", you could check the results with the
following code:

<cfsearch collection="invivoscribe" name="results" criteria="">
<cfdump var="#results#">