Udemy Enroller via FastAPI

Problem

Browser-based workflows often involve repetitive, highly-structured tasks with narrow execution windows. Manually checking, updating parameters, and verifying execution steps across different pages creates severe bottlenecks, reduces overall productivity, and introduces the risk of human error. The system needed a robust, high-availability architecture to coordinate async queues, manage headless browser instances concurrently, handle stateful authentication sessions securely, and respect strict rate-limiting policies across target platforms gracefully. Furthermore, standard cron jobs were insufficient due to the need for distributed worker nodes and real-time execution telemetry to monitor the health and performance of the automation suite across hundreds of daily parallel executions.

Approach

• ◆FastAPI Architecture: We designed and deployed a FastAPI service to act as the core API layer, providing secure REST endpoints for workflow initialization and telemetry aggregation.
• ◆To handle the background processing load without blocking the main thread, we integrated Celery alongside Redis as the message broker, creating robust async task execution queues.
• ◆A comprehensive validation pipeline was engineered to authenticate session state dynamically, verify input constraints, and execute long-running browser tasks via Playwright without requiring any manual intervention.
• ◆We also implemented comprehensive telemetry logging and monitoring to track success rates, handle unexpected session expirations gracefully, respect external rate limits via exponential backoff strategies, and alert stakeholders of any critical failures via automated webhooks.

Results

• ✓90% reduction in manual effort
• ✓20,000+ workflow executions logged in six months
• ✓Significant estimated value created

Gallery

Stack

• Python
• FastAPI
• Celery
• Redis
• GitHub Actions
• Google Analytics

Links

• Live demo
• Source code

Sources / further reading

• Celery Distributed Task Queue
• PostgreSQL Official Documentation
• FastAPI Background Tasks