WmZilla - Webmaster and Marketplace

The Next Generation Webmaster and Trade Forum

Database Support for Data Extraction and Updating

Realmussu

New member

0

0%

Status

Offline

Posts

31

Likes

0

Rep

0

Bits

165

3

Months of Service

0%
Hello, I am developing a web scraping bot to improve myself. On the site I am scraping, there are stock numbers that I want to include. Here is what I want to do: if the product name in the database is the same, do not write it again but update the stock number. To achieve this, I have set the time limit to 0 and established a connection to the database. I have also included the necessary libraries and started extracting data from a specific URL. I iterate through the results, retrieve relevant information such as product name, code, price, stock, and image, and then update the database accordingly. If the record is successful, I save the image to a local folder.
 

249

6,622

6,642

Top