Job Description

Responsibilities

• We need a C# .NET console application that scrapes product data from e-commerce category pages
• The application should take category URLs as input and extract key product info (right from catalog pages, without opening product url), including: brand, category, price, sizes, itemlink, rating, number of reviews, image links available on category page
• Save to csv file
• Proxy setup via appsetting.json
• Each proxy should handle their cookies file
• Caching requests to file (cache key based on current url)
• Note: can be an issue with pagination, so maybe the next page url can be just generated , based on number of results per page and number of pages in general

Requirements

• If you have experience with C# or Nodejs web scraping and can implement this efficiently, feel free to apply!