AdaBoost Weight Calculator

Calculate weak learner influence, update sample weights, simulate boosting rounds, compare binary and multiclass methods, and understand every AdaBoost step clearly and accurately instantly.

Calculation Results

Results appear here after calculation.

Not calculated
Weighted error
Weighted accuracy
Learner weight (alpha)
Normalization constant
Highest sample weight
Lowest sample weight
Effective sample size
Total normalized weight
Enter sample data, then select Calculate.
#SampleActualPredictedStatusCurrent weightMultiplierRaw new weightNormalized weightChangeChange %
No calculated rows.

Weight Distribution

Detailed Output

No results yet.

Calculator Settings

Training Samples

Add actual labels, predictions, and current sample weights.

#Sample nameActual labelPredicted labelCurrent weightRemove
Use four columns: sample name, actual label, predicted label, and weight.
Accepted columns: sample name, actual label, predicted label, weight. Commas or tabs are supported.

Final Ensemble Prediction

Enter each weak learner prediction and alpha. Binary predictions usually use -1 and 1.

#Learner namePredictionAlphaWeighted voteRemove
No ensemble prediction yet.

Boosting-Round History

Commit each calculated round, then reuse updated weights for the next round.

RoundLearnerModeErrorAccuracyAlphaZMin weightMax weightAverage weightESSMisclassified weightMisclassified shareCumulative alpha
No committed rounds.

Formula Used

Weighted error: εₜ = Σ wᵢ I(yᵢ ≠ hₜ(xᵢ)) / Σ wᵢ
Binary learner weight: αₜ = η × ½ ln((1 − εₜ) / εₜ)
SAMME learner weight: αₜ = η × [ln((1 − εₜ) / εₜ) + ln(K − 1)]
Updated weight: wᵢ(new) = wᵢ × exp(−αₜ) when correct, or wᵢ × exp(αₜ) when incorrect
Normalization: Zₜ = Σ wᵢ(new), then wᵢ(normalized) = wᵢ(new) / Zₜ
Effective sample size: ESS = 1 / Σ wᵢ²

How to Use

  1. Select binary AdaBoost or multiclass SAMME.
  2. Enter actual labels, predictions, and current weights.
  3. Choose automatic or manual weighted error.
  4. Set learning rate, clipping, precision, and normalization.
  5. Select Calculate to update every sample weight.
  6. Commit a round to build a boosting history.
  7. Use the ensemble section for final weighted predictions.

Worked Example

SampleActualPredictedInitial weightClassification
A110.20Correct
B1-10.20Incorrect
C-1-10.20Correct
D-1-10.20Correct
E110.20Correct

The weighted error is 0.20. Binary alpha is approximately 0.693147. The misclassified sample gains greater relative importance.

Frequently Asked Questions

What does alpha represent?

Alpha measures a weak learner’s influence. Larger positive values create stronger ensemble votes.

Why are misclassified samples increased?

AdaBoost focuses later learners on difficult observations. Their relative weights therefore become larger.

What happens when error equals 0.5?

A binary learner performs like random guessing. Its calculated influence approaches zero.

Can alpha become negative?

Yes. This occurs when binary weighted error exceeds one-half.

Why clip weighted error?

Clipping prevents logarithms of zero. It also limits extreme numerical values.

What is SAMME?

SAMME extends discrete AdaBoost to multiclass classification. It includes the class-count correction term.

Must weights sum to one?

Normalized weights usually sum to one. The weighted error ratio still works with positive unnormalized weights.

What does effective sample size show?

ESS estimates how concentrated the weight distribution is. Smaller values indicate stronger concentration.

Can I simulate several rounds?

Yes. Commit a round, change predictions, and reuse updated weights.

Related Calculators

Decision Tree Entropy CalculatorInformation Gain CalculatorGini Impurity CalculatorDecision Tree Split CalculatorRandom Forest Voting CalculatorGradient Boosting Prediction CalculatorXGBoost Gain CalculatorBagging Sample CalculatorDecision Tree Splitting QuizGini Impurity Quiz

Important Note: All the Calculators listed in this site are for educational purpose only and we do not guarentee the accuracy of results. Please do consult with other sources as well.