Building a Mobile Crypto News Aggregator
Crypto news aggregation means juggling multiple real-time data streams: RSS feeds, APIs (CryptoCompare News, CoinGecko, Messari), Twitter/X, and price data. The challenge: collect everything, deduplicate, rank by relevance, and deliver to the user without delay. We've been tackling this since the demand for aggregators first emerged, building reliable mobile solutions for FinTech. Our experience: 5+ years and 15+ launched apps. Significant savings on server resources are achieved through caching and deduplication. Contact us for a consultation to discuss your project.
Data Source Comparison and Selection
| Source | Type | Free Tier Limit | Special Features |
|---|---|---|---|
| CryptoCompare News | REST API | 100k requests/month | Categories and tags |
| Messari | REST API | Trial tier | Analytical content |
| RSS (CoinDesk, Decrypt) | XML | Unlimited | Standard parsing |
CryptoCompare News API — the free tier gives 100k requests per month, supports filtering by categories (Bitcoin, Ethereum, DeFi, NFT) and languages. Messari API offers more analytical content, good for serious financial news, but the full access requires a paid tier. RSS feeds — CoinDesk, Decrypt, The Block — publish RSS; we parse server-side using feedparser (Python) or custom RSS parsers.
How to Avoid News Duplication?
Duplication occurs when the same news arrives from different sources (e.g., CryptoCompare and Messari). We apply server-side deduplication: compare headlines using difflib (Python) or Levenshtein distance. A similarity threshold of 0.85 catches 95% of duplicates. This cleans the feed and reduces client requests. In a recent project for a major crypto analytics platform, we reduced duplicate noise from 80% to under 5% and improved feed delivery speed from 8 seconds to 1.2 seconds by combining this deduplication with a Redis-backed cache.
How to Achieve Real-Time Updates?
News appears constantly. Polling every 60 seconds is a reasonable compromise for most users. WebSocket for real-time updates — if you need sub-second reaction (e.g., breaking news).
| Method | Latency | Server Resources | Complexity |
|---|---|---|---|
| Polling (60s) | up to 60 s | Low | Simple |
| WebSocket | <1 s | High | Medium |
WebSocket is 10x faster than polling for real-time, but requires more server resources. The choice depends on your budget and freshness requirements. If you need a real-time solution, contact us — we'll design the optimal architecture.
class NewsWebSocketClient: ObservableObject {
@Published var latestNews: [NewsItem] = []
private var webSocketTask: URLSessionWebSocketTask?
func connect() {
let url = URL(string: "wss://api.yourservice.com/news/stream")!
var request = URLRequest(url: url)
request.addValue("Bearer \(token)", forHTTPHeaderField: "Authorization")
webSocketTask = URLSession.shared.webSocketTask(with: request)
webSocketTask?.resume()
listen()
}
private func listen() {
webSocketTask?.receive { [weak self] result in
if case .success(.string(let text)) = result,
let item = try? JSONDecoder().decode(NewsItem.self, from: Data(text.utf8)) {
DispatchQueue.main.async {
self?.latestNews.insert(item, at: 0)
if self?.latestNews.count ?? 0 > 200 {
self?.latestNews.removeLast()
}
}
}
self?.listen()
}
}
}
Personalization and Filtering
Users follow specific coins — BTC, ETH, SOL. Client-side filtering by tags works only if all news is already loaded. For large volumes, we use server-side filtering with query parameters. We guarantee the feed loads in 1–2 seconds even with 10,000 cached news items. API cost optimization — we choose the right tier based on traffic volume.
AI Summarization: for each news article, we generate a 2–3 sentence summary via GPT-4o mini on the server during indexing. This is more costly than showing the original lead, but users get the essence without opening the article. The summarization cost is economical — we select the optimal model for your budget.
Headline sentiment analysis (Positive / Neutral / Negative) provides a quick market signal. We use ML Kit Sentiment on Android or NLTagger.sentimentScore on iOS, or specialized crypto sentiment models (CryptoNewsScore).
How to Show Quotes Alongside News?
Displaying the current price of a coin next to a news item is standard for crypto aggregators. CoinGecko free API can fetch prices for 250+ coins with a single request /simple/price?ids=bitcoin,ethereum&vs_currencies=usd,rub. A 30-second cache prevents over-fetching.
// Android: correlate news with price widget
data class NewsWithPrice(
val news: NewsItem,
val relatedCoin: CoinPrice? // null if coin not identified
)
fun enrichNewsWithPrices(
news: List<NewsItem>,
prices: Map<String, CoinPrice>
): List<NewsWithPrice> {
return news.map { item ->
val coin = item.tags.firstOrNull { prices.containsKey(it.lowercase()) }
NewsWithPrice(news = item, relatedCoin = coin?.let { prices[it.lowercase()] })
}
}
Push Notifications for Breaking News
Breaking news alerts — by keywords or coins from the user's watchlist. Firebase Cloud Messaging with topic subscriptions: /topics/bitcoin-news, /topics/ethereum-news. Users subscribe in the app settings. We recommend no more than 3–5 pushes per day to avoid unsubscribes. Background fetch (iOS) or WorkManager (Android) for silent feed updates. We configure notifications to be useful, not intrusive.
Our Work Process
- Analysis — agree on sources, personalization requirements, data volume.
- Design — server architecture, APIs, data schemas.
- Implementation — server aggregation, deduplication, AI summarization, mobile client.
- Testing — load testing with 1000+ news items per day, latency checks.
- Deployment — publish to App Store and Google Play, set up monitoring.
Server Architecture
The aggregator consists of a parser (Python/Scrapy), a message queue (RabbitMQ), and a database (PostgreSQL). The AI summarization microservice processes articles asynchronously during indexing. The server API delivers feeds via REST and WebSocket.What's Included in the Work (Deliverables)
- Server API documentation.
- Access to Firebase, CoinGecko, selected sources.
- Source code under NDA.
- Training of client team on the admin panel.
- 2 weeks of post-launch support.
Timeline Estimates
Basic aggregator with multiple sources and filters — 4–6 weeks. Full system with AI summarization, sentiment, personalization, and push notifications — 10–16 weeks. Timelines vary based on requirements.
We'll evaluate your project for free — contact us for a consultation. Turnkey development ensures transparency and on-time delivery. Discuss your project with our engineer — we'll find the optimal solution.







