Generate a CV for this Job!
Based on your profile and this job description, you can create a tailored CV to apply directly.
Node.js/Next.js/Nest.js Developer for Web Image Search API Using Web Scraping
Upwork • , US • Remote
Posted on: 5th March, 2025
Employment Type: CONTRACTOR
Job Description
looking for an experienced Node.js/Next.js/Nest.js developer to build a web-based solution that scrapes the web for images of a given product name and returns 10 high-quality images with the following characteristics:
✅ Unique & valid image links – The URLs should be downloadable and not duplicates.
✅ High-resolution images – The images should be clear and of good quality.
✅ Product-focused – The searched product must be the main focus of the image.
✅ White/transparent background preferred – Prioritize images with a white or transparent background.
✅ Image curation & resizing – If the product appears too small in an image and has empty space around it, resize/crop to ensure consistent product sizes across all results.
Technical Requirements:
The solution must be built using web scraping, leveraging Puppeteer, Cheerio, Playwright, or similar technologies to fetch images directly from websites.
Google Search API or AI-based methods should NOT be used. The system should rely on scraping techniques to gather data while respecting website policies and avoiding IP bans.
The scraper must be optimized to avoid detection and handle rate limits efficiently (e.g., using proxies, user-agent rotation, or request throttling).
The system should return a JSON response containing:
Image URLs
Source website
Resolution (if available)
Image curation & manipulation should be applied to maintain a consistent product size across images using Sharp, ImageMagick, or a similar library.
The implementation must be scalable and handle multiple requests without performance issues.
The project should include basic documentation on how to set up and use the solution.
Ideal Candidate:
Strong Node.js development experience
Proficient in Next.js or Nest.js
Extensive experience with web scraping technologies (e.g., Puppeteer, Playwright, Cheerio, Scrapy)
Familiarity with image processing & resizing (e.g., Sharp, ImageMagick)
Knowledge of handling rate limits, proxies, and avoiding IP bans
Experience with cloud services for deployment (optional, but a plus)
Deliverables:
A working Node.js/Next.js/Nest.js application that meets the above criteria.
Source code uploaded to a Private GitHub repository.
A brief README/documentation on how to set up and run the project.
Important: This project is part of a larger system, so please ensure that your implementation is modular and component/function-based to allow for seamless integration into our broader architecture. Code should be well-structured, reusable, and easy to extend. We prefer using free, commercially usable libraries, but if necessary, we are open to considering one-time payment solutions (no recurring costs)
How to Apply:
If you're interested in this project, please include:
- A brief description of how you would approach this task.
- Any relevant experience or similar projects you've worked on.
- Estimated timeline and cost.
✅ Unique & valid image links – The URLs should be downloadable and not duplicates.
✅ High-resolution images – The images should be clear and of good quality.
✅ Product-focused – The searched product must be the main focus of the image.
✅ White/transparent background preferred – Prioritize images with a white or transparent background.
✅ Image curation & resizing – If the product appears too small in an image and has empty space around it, resize/crop to ensure consistent product sizes across all results.
Technical Requirements:
The solution must be built using web scraping, leveraging Puppeteer, Cheerio, Playwright, or similar technologies to fetch images directly from websites.
Google Search API or AI-based methods should NOT be used. The system should rely on scraping techniques to gather data while respecting website policies and avoiding IP bans.
The scraper must be optimized to avoid detection and handle rate limits efficiently (e.g., using proxies, user-agent rotation, or request throttling).
The system should return a JSON response containing:
Image URLs
Source website
Resolution (if available)
Image curation & manipulation should be applied to maintain a consistent product size across images using Sharp, ImageMagick, or a similar library.
The implementation must be scalable and handle multiple requests without performance issues.
The project should include basic documentation on how to set up and use the solution.
Ideal Candidate:
Strong Node.js development experience
Proficient in Next.js or Nest.js
Extensive experience with web scraping technologies (e.g., Puppeteer, Playwright, Cheerio, Scrapy)
Familiarity with image processing & resizing (e.g., Sharp, ImageMagick)
Knowledge of handling rate limits, proxies, and avoiding IP bans
Experience with cloud services for deployment (optional, but a plus)
Deliverables:
A working Node.js/Next.js/Nest.js application that meets the above criteria.
Source code uploaded to a Private GitHub repository.
A brief README/documentation on how to set up and run the project.
Important: This project is part of a larger system, so please ensure that your implementation is modular and component/function-based to allow for seamless integration into our broader architecture. Code should be well-structured, reusable, and easy to extend. We prefer using free, commercially usable libraries, but if necessary, we are open to considering one-time payment solutions (no recurring costs)
How to Apply:
If you're interested in this project, please include:
- A brief description of how you would approach this task.
- Any relevant experience or similar projects you've worked on.
- Estimated timeline and cost.
Responsibilities
- ✅ High-resolution images – The images should be clear and of good quality
- ✅ Image curation & resizing – If the product appears too small in an image and has empty space around it, resize/crop to ensure consistent product sizes across all results
- The solution must be built using web scraping, leveraging Puppeteer, Cheerio, Playwright, or similar technologies to fetch images directly from websites
- The system should rely on scraping techniques to gather data while respecting website policies and avoiding IP bans
- The scraper must be optimized to avoid detection and handle rate limits efficiently (e.g., using proxies, user-agent rotation, or request throttling)
- A brief README/documentation on how to set up and run the project
- Important: This project is part of a larger system, so please ensure that your implementation is modular and component/function-based to allow for seamless integration into our broader architecture
Requirements
- ✅ Product-focused – The searched product must be the main focus of the image
- Image curation & manipulation should be applied to maintain a consistent product size across images using Sharp, ImageMagick, or a similar library
- The implementation must be scalable and handle multiple requests without performance issues
- The project should include basic documentation on how to set up and use the solution
- Strong Node.js development experience
- Proficient in Next.js or Nest.js
- Extensive experience with web scraping technologies (e.g., Puppeteer, Playwright, Cheerio, Scrapy)
- Familiarity with image processing & resizing (e.g., Sharp, ImageMagick)
- Knowledge of handling rate limits, proxies, and avoiding IP bans
- A working Node.js/Next.js/Nest.js application that meets the above criteria
- Source code uploaded to a Private GitHub repository
- Code should be well-structured, reusable, and easy to extend
- Any relevant experience or similar projects you've worked on
Upwork
Technology
Job Type
CONTRACTOR
Loading...
Loading...
AI Cover Letter Generator
Generate a Tailored Cover Letter!
Our AI will analyze your profile and create a personalized cover letter that highlights your relevant skills and experience.
Related Jobs
HARAMAIN SYSTEMS INC.
1 month ago
Principal/Lead Java Backend Developer - NodeJs
Illinois, US
View Job