Request regarding extracting data from a website

[itsme220]

I need to extract data from a website and formulate in excel file

example

http://dev.mydomain.com/Master/dbcheck.aspx?infoID=237
http://dev.mydomain.com/Master/dbcheck.aspx?infoID=100
http://dev.mydomain.com/Master/dbcheck.aspx?infoID=650
http://dev.mydomain.com/Master/dbcheck.aspx?infoID=980

The InfoID will change from 1 to 999
so I need to extract data from nearly 1000 pages.

Is there any tools or simple coding I can do to extract?

Thanks

 

[davidktw]

I need to extract data from a website and formulate in excel file

example

http://dev.mydomain.com/Master/dbcheck.aspx?infoID=237
http://dev.mydomain.com/Master/dbcheck.aspx?infoID=100
http://dev.mydomain.com/Master/dbcheck.aspx?infoID=650
http://dev.mydomain.com/Master/dbcheck.aspx?infoID=980

The InfoID will change from 1 to 999
so I need to extract data from nearly 1000 pages.

Is there any tools or simple coding I can do to extract?

Thanks

Assuming no post processing

# for i in `seq 1 999`; do curl "http://dev.mydomain.com/Master/dbcheck.aspx?infoID=$i"; done

If you have a script to do whatever you need

# for i in `seq 1 999`; do ./yourscript.sh "http://dev.mydomain.com/Master/dbcheck.aspx?infoID=$i"; done

 

[Swiftbladez]

For JS you can use tools like Puppeteer or if more lightweight cheerio works as well.

 

[Alibarbar]

if you know python can use beautiful soup

Module can dl from is bs4