An automated crawler that extracts products and categories from Digikala!

Overview

Digikala-Crawler

The purpose of this project is to conduct research and we are not responsible for any misuse of this project.

This is not a very clean piece of code, but it is still readable

⚠️ Ensure you have MongoDB with DB named Digikala before launching the project: Be very careful here!

The following command can be used to launch this project

node index.js
Don't forget to hit the star button if you liked it ⭐️

Pull requests are always welcome!

image.png

image.png

image.png

You might also like...

Free to read e-paper with concise articles and many categories

Free to read e-paper with concise articles and many categories

THE FREE TIMES About The free times is a free-to-read e-paper with concise articles and many categories. My aim is to provide a nice newspaper like ex

Dec 16, 2022

Use Kanban board with filled-in tasks that have categories and time estimations to assign work in group.

javascript-capstone 456movies 456movies is the home of amazing original programs that you can’t find anywhere else. Movies, TV shows, specials and mor

Dec 27, 2022

ENS Collections are categories of ENS names based on specific patterns or predefined lists.

ENS Collections are categories of ENS names based on specific patterns or predefined lists. This repository is an effort towards standardizing their definition in order to increase consistency across platforms.

Dec 15, 2022

📝api: Register Employees and Products

📝api: Register Employees and Products

📝 Register Employees and Products Bem-vindo(a). Este é o desafio da 4° sprint! Opa dev tudo bem?! Este é o grupo03, que através desse repositório vem

Jan 26, 2022

iX is a design system for designers and developers, to consistently create the perfect digital experience for industrial software products.

Siemens Industrial Experience (iX) monorepo iX is an open source design system for designers and developers, to consistently create the perfect digita

Dec 26, 2022

Import flow for Excel (.xlsx) and CSV file with automated column matching and validation.

Import flow for Excel (.xlsx) and CSV file with automated column matching and validation.

RSI react-spreadsheet-import ⚡️ A component used for importing XLS / XLSX / CSV documents built with Chakra UI. Import flow combines: 📥 Uploader ⚙️ P

Dec 24, 2022

This repo contains the templates used in my automated obsidian weekly review video and also an accompanying vault with the folder structure expected and plugins

This repo contains the templates used in my automated obsidian weekly review video and also an accompanying vault with the folder structure expected and plugins

This repo contains the templates used in my automated obsidian weekly review video and also an accompanying vault with the folder structure expected and plugins (periodic note settings etc)

Dec 21, 2022

An E-commerce website that allows to Buy/Sell products, designed to strengthen small vendors to enhance their business

An E-commerce website that allows to Buy/Sell products, designed to strengthen small vendors to  enhance their business

Developed using MERN Stack, an E-commerce website that allows to Buy/Sell products, designed to strengthen small vendors to enhance their business, fu

Jun 25, 2022
Owner
Ali Azizi
Making bugs as a developer 😂 Therefore, I am a bugger rather than a programmer :D
Ali Azizi
Google-reviews-crawler - A simple Playwright crawler that stores Google Maps Place/Business reviews to a JSON file.

google-reviews-crawler A simple Playwright crawler that stores Google Maps Place/Business reviews to a JSON file. Usage Clone the repo, install the de

￸A￸l￸e￸x D￸o￸m￸a￸k￸i￸d￸i￸s 6 Oct 26, 2022
🍺 A public REST API for retrieving information about Systembolaget's products, and which products that are available in which store

?? systembolaget-api A public REST API for retrieving information about Systembolaget's products, and which products that are available in which store

Daniel Cronqvist 9 Nov 22, 2022
A product system made with NestJS. It's a service where you list products, create products or even delete them.

Products-API A product system made with NestJS. It's a service where you list products, create products or even delete them. What I used in this proje

Luiz Sanches 4 May 18, 2022
Extracts favicon of the current page and calculates their murmurhash. Firefox extension source code.

Favicon to Murmurhash Extracts favicon of the current page and calculates their murmurhash. Shows links to shodan search based on favicon murmurhashes

null 16 Dec 17, 2022
Chrome Extension that extracts metroretro.io JSON to your clipboard as an HTML list

retro-clippy Chrome Extension that extracts metroretro.io JSON to your clipboard as an HTML list Installation Clone repo and run yarn to install depen

Sherman Hui 2 Apr 11, 2022
Crawler Crypto using NodeJS for performance with Elasticsearch DB for high efficiency.

Coin crawler - Coingecko version Crawler using NodeJS for performance with Elasticsearch DB for high efficiency. Requirements For development, you wil

Minh.N.Pham 1 Jan 20, 2022
A crawler that crawls the site's internal links, fetching information of interest to any SEO specialist to perform appropriate analysis on the site.

Overview ?? It is a module that crawls sites and extracts basic information on any web page of interest to site owners in general, and SEO specialists

Yazan Zoghbi 2 Apr 22, 2022
a web crawler that crawls website links & fetches SEO Data

Overview ?? It is a module that crawls sites and extracts basic information on any web page of interest to site owners in general, and SEO specialists

Syrian Open Source 7 Dec 15, 2022
A crawler that crawls the site's internal links, fetching information of interest to any SEO specialist to perform appropriate analysis on the site.

Overview ?? It is a module that crawls sites and extracts basic information on any web page of interest to site owners in general, and SEO specialists

Yazan Zoghbi 2 Apr 22, 2022
The Bookstore is a website where the user can display a list of books, add a book by providing a title, an author, and selecting from the categories, and remove a selected book.

Bookstore The Book Store is a website where the user can display a list of books, add a book and remove a selected book. Microverse's Bookstore API wa

Virag Kormoczy 9 Jan 1, 2023