An interesting web scraper for collecting ASOS data. The scraper is based on Selenium, and the classes adopts the Mixin design pattern. The application is containerized using Docker and deployed on AWS EC2, the scraped data is stored in AWS S3 and AWS RDS. Using Prometheus and Grafana to monitor running indicators.
Stars
2
Forks
1
Watchers
2
Open Issues
0
Overall repository health assessment
No package.json found
This might not be a Node.js project
125
commits
Merge branch 'main' of github.com:Kevin-MrYe/Data_Collection_Pipeline into main
c18bd94View on GitHub