B2B companies lose up to 30% of revenue due to inaccurate pipeline forecasts. The classic weighted pipeline does not consider behavioral signals. Our ML system is 2x more accurate than traditional weighted pipeline, thanks to LightGBM and hierarchical models — accuracy increases by 20–40% compared to classic methods. We offer a data audit: from CRM analysis to automated reporting.
How ML model re-evaluates deal probabilities in CRM?
In B2B, forecasting is based on the sales pipeline. The classic weighted pipeline multiplies deal amount by stage probability, but managers often inflate probabilities due to optimism. An ML model (LightGBM) uses behavioral signals: number of email replies in the last 14 days, number of engaged stakeholders, time in stage. The result is an AI probability score that replaces manual estimation and raises AUC from 0.65 to 0.75–0.85. LightGBM is 1.25 times more accurate than Prophet on B2B pipelines.
| Signal |
Weight in model |
| Days in current stage vs. median |
High |
| Email replies in last 14 days |
High |
| Number of stakeholders engaged |
Medium |
| Competitor mention in notes |
Medium |
| Deal size vs. ICP |
Medium |
| Closeness to client's fiscal year end |
Low |
For B2C we use aggregated time series of revenue, transactions, and average order value. Classic methods (Prophet, ETS, SARIMA) are supplemented with ML features: lags, moving averages, calendar events. Such a hybrid achieves MAPE < 8% on a quarterly horizon.
Why hierarchical forecasting is more accurate than a single model?
Sales forecasting is needed at multiple levels: total company revenue, business units, product lines, regions. A single model does not account for each segment's specifics. We build a bottom-up forecast with reconciliation using the MinT method: each node (e.g., product + region) has its own LightGBM model, and top levels are reconciled to minimize error. This yields 5–10% higher accuracy than direct top-down forecasting.
Total Company Revenue
├── Business Unit A
│ ├── Product Line 1
│ │ ├── Region EU
│ │ └── Region NA
│ └── Product Line 2
└── Business Unit B
Seasonal and event-driven patterns
In SaaS/B2B, a typical quarterly spike — "hockey stick" in the last two weeks of the quarter, fiscal year end, budget season in October-November. In B2C, Black Friday and Cyber Monday bring 30–50% of annual revenue in 2–3 weeks. We handle this by adding binary regressors to Prophet/LightGBM — event flags and days before/after the event.
How we account for event-driven patterns
We add not only binary flags but also distance regressors: days to the nearest event and after. For Black Friday, we use an asymmetric window — 7 days before and 3 days after. This improves accuracy during peak periods by 15%.
Comparison with plan and Variance Analysis
The system not only forecasts but also explains deviations: plan vs. forecast vs. actual. Decomposition by volume effect (sold more/fewer units), price effect (change in average check), and mix effect (shift to other products). We implement this via analytical Shapley values — not ML-SHAP, but a deterministic calculation of each factor's contribution.
Integration with planning: API into Anaplan, Adaptive Insights, SAP BPC, as well as Excel reports via openpyxl with charts for the CFO. Automatic generation of weekly PDF/PowerPoint: forecast, trend vs. budget, key changes. Planning budget savings reach 30% due to automation.
Comparison of forecasting algorithms
| Algorithm |
Best scenario |
Typical MAPE |
| Prophet |
B2C with strong seasonality |
8–12% |
| LightGBM |
B2B with many features |
5–8% |
| SARIMA |
Short series (12–24 months) |
10–15% |
What is included in the work (Deliverables)
- Data source and CRM audit
- ML architecture design (stack: PyTorch, LightGBM, Prophet, HuggingFace)
- Model training and validation, hyperparameter tuning
- Deployment via Docker/Kubernetes, Triton Inference Server
- Dashboards (Power BI, Tableau, Grafana)
- Automated reporting for the finance department
- Team training and 3-month support
- Comprehensive documentation and API access
Timelines: B2B pipeline AI scoring — 4–6 weeks. Comprehensive system with hierarchical forecasting, variance analysis, and automated reports — 3–4 months. Cost is calculated individually after audit; typical projects range from $20k to $50k. Payback period averages 4–6 months, ROI reaches 200% in the first year.
Our guarantees: certified MLOps engineers, transparent architecture, post-launch support. With over 5 years of experience and 50+ deployed projects, we deliver reliable solutions. Contact us for a consultation on your project — we will assess the data and timelines. Learn more about LightGBM and demand forecasting.
When does a time series forecasting model fail in production?
The CFO requests a quarterly sales forecast. An analyst builds SARIMA on three years of data, achieves MAPE 8.3% on the test set, and deploys. Two months later, the metric in production jumps to 23%. The root cause: the model was trained on pre‑COVID data, tested on a stable period, but production hit a promotion and supply chain disruption. Data leakage plus distribution shift—perfect notebook numbers, a broken forecast in reality. We have seen this pattern dozens of times across retail, fintech, and IoT. Our team has delivered more than 50 forecasting projects over 5+ years.
Incorrect cross-validation. Standard train_test_split for time series creates data leakage: the model sees future values during training. The correct approach is TimeSeriesSplit or walk‑forward validation with an expanding window.
Multiple seasonality. Hourly electricity consumption has three seasonalities: daily (24h), weekly (168h), yearly (8760h). SARIMA handles only one. Prophet can handle multiple but scales poorly to thousands of series.
Missing values and anomalies. A missing sensor reading is information (the sensor turned off), not NaN. Linear interpolation destroys this signal. Proper handling depends on the missingness mechanism.
Cold start. A new SKU in a 50,000‑item assortment has no history, yet a forecast is needed. Standard approaches fail; cross‑learning or feature‑based methods are required.
Why is model selection critical for your data?
Prophet (Meta) – a solid start for business data with clear seasonality and holidays. Fast setup, interpretable, built‑in outlier detection. Fails on irregular patterns and does not scale beyond ~10k series without parallelization.
Gradient boosting on features (LightGBM, XGBoost) – often underestimated. Engineer lags (t‑1, t‑7, t‑28), rolling means, day‑of‑week, holidays. The model trains on all series simultaneously, solving cold start via transfer learning. MAPE in retail often beats neural nets with proper feature engineering.
TFT (Temporal Fusion Transformer) – a transformer designed for interpretable forecasting with covariates. Built‑in variable selection, temporal attention, quantile outputs. Available in pytorch‑forecasting. Requires ~10,000+ records per series for stable training.
PatchTST – splits the series into patches (like ViT for images), capturing local patterns better than classic transformers. Excellent for long‑horizon forecasting (96–720 steps ahead).
N‑HiTS, N‑BEATS – attention‑free neural architectures, faster than TFT, competitive accuracy. N‑BEATS won the M4/M5 benchmarks for tasks without covariates.
| Method |
Covariates |
Scale (series) |
Interpretability |
Complexity |
| Prophet |
Yes (regressors) |
Up to 10k |
High |
Low |
| LightGBM + features |
Yes |
100k+ |
Medium |
Medium |
| TFT |
Yes |
1k–100k |
High |
High |
| PatchTST |
No/limited |
Any |
Low |
Medium |
| N‑HiTS |
No |
Any |
Low |
Low |
How do we deploy TFT in production?
A typical pipeline via pytorch‑forecasting:
training = TimeSeriesDataSet(
data,
time_idx="time_idx",
target="sales",
group_ids=["store", "sku"],
min_encoder_length=max_encoder_length // 2,
max_encoder_length=max_encoder_length, # 120 days
min_prediction_length=1,
max_prediction_length=max_prediction_length, # 28 days
static_categoricals=["store_type", "category"],
time_varying_known_reals=["price", "promo_flag"],
time_varying_unknown_reals=["sales"],
target_normalizer=GroupNormalizer(groups=["store", "sku"], transformation="softplus"),
)
A common mistake: the default target_normalizer (StandardScaler) breaks predictions for series with zero values (no sales on weekends). GroupNormalizer with transformation="softplus" is the correct choice for count data.
Case study: retail demand forecasting
A chain of 120 stores, 8,000 SKUs, 28‑day forecast horizon. The original system: SARIMA per series, MAPE 18.4%, retraining cycle – 6 hours. We replaced it with TFT on PyTorch + pytorch‑forecasting: a single model for all series, MAPE 11.2%, retraining – 40 minutes on an A10G. Feature importance via variable selection revealed that day_before_holiday influences more than the holiday date itself. Annual savings on inference alone exceeded $50,000.
Step‑by‑step configuration
-
Data collection and preparation. Handle missing values (mark NaN, interpolate only for technical failures), aggregate to required frequency, engineer covariates (holidays, promotions, prices).
-
Create
TimeSeriesDataSet. Set group_ids (store + SKU), time index, forecast horizon. Choose target_normalizer based on target distribution.
-
Train a baseline. Prophet or LightGBM first – to understand complexity.
-
Train TFT. Use
TemporalFusionTransformer with loss=QuantileLoss(), tune learning rate and hidden layer sizes.
-
Validate and interpret. Walk‑forward test, analyze variable selection, build attention heatmaps.
How to properly evaluate forecast quality?
RMSE alone is misleading – it over‑penalizes large values. Our standard set:
-
MAPE – interpretable, unstable near zero.
-
sMAPE – symmetric, avoids division by small numbers.
-
MASE (Mean Absolute Scaled Error) – normalized relative to a naive seasonal forecast, ideal for comparing series of different scales.
-
Pinball loss – for probabilistic forecasting, inventory management.
| Metric |
When to use |
Drawback |
| MAPE |
Business reporting, series without zeros |
Unstable for small values |
| sMAPE |
Model comparison |
Asymmetric interpretation |
| MASE |
Multi‑scale series, benchmarks |
Needs seasonal naive baseline |
| Pinball loss |
Probabilistic models |
Multiple values for different quantiles |
We guarantee a model card with these metrics on the validation set and walk‑forward results on at least 6 months of history.
What deliverables do you receive?
- Documentation of chosen architecture and hyperparameter rationale.
- Reproducible training and inference pipeline (Docker + CI/CD + Airflow/Prefect).
- Committed code with unit tests for key components.
- Team training: retraining, output interpretation, deployment of new versions.
- 3 months of post‑delivery support (consultations, bug fixes, fine‑tuning).
The model is deployed via FastAPI or Triton Inference Server. Retraining is scheduled (e.g., weekly) via Airflow with drift validation and automatic rollback if metrics deteriorate.
Process and timeline
We start with EDA: visualization, ADF test, STL decomposition, analysis of missing values and outliers. This takes 2–3 days but often reveals systemic data issues that block forecasting. Then we build a baseline (naive seasonal, Prophet), engineer features for LightGBM, and select a neural architecture if needed. Walk‑forward validation with a realistic horizon. Deployment via API with automatic retraining scheduled via Airflow or Prefect.
Timeline: MVP forecast on one data type – 3–6 weeks. Hierarchical forecasting system with automation – 2–5 months. Cost is calculated individually based on data volume, number of series, and required accuracy.
Our team consists of certified ML engineers (AWS ML Specialty, GCP Professional ML Engineer) with 5+ years on the market and over 50 completed forecasting projects. Contact us for a free analysis of your data – we will assess the task and provide initial recommendations within 1–2 days. Request a consultation to ensure your forecasts work in production, not just in a notebook.