Last updated 3 years ago
Was this helpful?
Data scraper and scheduling regular scraping with airflow
Multiprocessing
Parallel processing with Celery
Connecting to kafka and using kafka queue