Prototype
2025Public repository: github.com/ayush108108/Real-Time-Financial-News-Sentiment-Crawler.

Financial News Crawler

Async Python pipeline that reads financial news RSS feeds and scores sentiment

Role

Creator

Period

2025

Category

experiment

Overview

A backend-only async pipeline (no UI) that reads financial news RSS feeds, adds transformer-based sentiment scores, stores results in SQLite and exports a JSON file. The code is public on GitHub. It polls when run; it is not a streaming service, and the default Reuters feed URL no longer responds.

Key Highlights

  • Async RSS ingestion with fallbacks when a feed fails
  • Transformer-based sentiment scoring
  • SQLite storage and JSON export
  • Two test files (pytest); coverage not measured

Tech Stack

Python
aiohttp
SQLAlchemy
SQLite
Hugging Face (sentiment)
Pydantic

What I Learned

This project deepened my understanding of Python and aiohttp and reinforced best practices in system design and scalability. I gained valuable insights into building maintainable software and measuring performance.