php web spider

[thl]

Hi
I have a device (a wireless access point) wich is configurable using
its internal web server. I did a little php script that opens a socket
to the statistics page and shows me only the data I'm interested to. The
device has a lot of other pages (mainly configuration and statistics
data wicht can be accessed using an HTTP GET. Is there some way
(software, read-to-use scripts) to generate a list of all the pages
served by the web server with all the fields of the forms included ?
something like:

/config/network.htm
ethip value="" maxlength="15"
gateway value="1.2.3.4" maxlength="15"
subnet value="255.255.255.0" maxlength="15"

and so on ? in this way I can use php to "scan" the device and have a
full range of HTTP request for setting up the device very quickly with
no human need.

thanks

thl

[Sebastian Lauwers]

thl wrote:

> Hi
> I have a device (a wireless access point) wich is configurable using
> its internal web server. I did a little php script that opens a socket
> to the statistics page and shows me only the data I'm interested to. The
> device has a lot of other pages (mainly configuration and statistics
> data wicht can be accessed using an HTTP GET. Is there some way
> (software, read-to-use scripts) to generate a list of all the pages
> served by the web server with all the fields of the forms included ?
> something like:
>
> /config/network.htm
> ethip value="" maxlength="15"
> gateway value="1.2.3.4" maxlength="15"
> subnet value="255.255.255.0" maxlength="15"
>
> and so on ? in this way I can use php to "scan" the device and have a
> full range of HTTP request for setting up the device very quickly with
> no human need.
>
> thanks
>
> thl
>

preg_match_all() will help you find the things you're searching in the pages

[url]http://www.php.net/manual/en/function.preg-match-all.php[/url]

you'll also need a good deal of regexp! so good luck...

On those pages are there links to the other pages? I suppose so, so
you'll need parse_url()

[url]http://www.php.net/manual/en/function.parse-url.php[/url]

Hope this helps,
Best regards,
Sebastian

--
The most likely way for the world to be destroyed,
most experts agree, is by accident.
That's where we come in; we're computer professionals.
We cause accidents.
--Nathaniel Borenstein