Data scraper and scheduling regular scraping with airflow
Multiprocessing
Parallel processing with Celery
Connecting to kafka and using kafka queue
Last updated 4 years ago