SolverForge Performance

Benchmarks

Compare SolverForge against open-source and published solver baselines on routing and scheduling workloads. Results are grouped by domain, dataset, instance, and time limit so each standing reflects like-for-like solver races.

Results updated: 17 Jul 21:30

Current Slice

8 solvers, 304 instances, 912 scored cases.

Rankings compare solver results within the same domain, dataset, instance, and time limit. Hard-feasible answers rank ahead of invalid or infeasible answers; lower cost wins within each scored case.

Reset
Top solver SolverForge 876 feasible · 195 top results
Cases scored 912 4,848 solver entries in this slice
Next solver Ortools 785 feasible · 392 top results
Full feasibility 1 Solvers hard-feasible on every scored entry

Solver Standings

Current Standings

Candidate
SolverForge
876 feasible 96% · 195 best results · 2.76 avg rank
Ortools
785 feasible 86% · 392 best results · 2.78 avg rank
Timefold
716 feasible 79% · 109 best results · 3.95 avg rank
SolverForge Python
500 feasible 55% · 35 best results · 4.32 avg rank
Pyvrp
300 feasible 100% · 142 best results · 1.76 avg rank
Vroom
299 feasible 100% · 1 best results · 3.54 avg rank
Pyhygese
297 feasible 99% · 158 best results · 1.56 avg rank
Rustvrp
290 feasible 97% · 0 best results · 4.96 avg rank

Field Quality

Feasibility by Solver

Solver Rows Hard feasible Quality ratio Avg runtime
Ortools 912
86% 		1.077 20.97s
Pyhygese 300
99% 		1.017 23.77s
Pyvrp 300
100% 		1.021 24.29s
Rustvrp 300
97% 		1.076 23.77s
SolverForge 912
96% 		1.055 23.94s
SolverForge Python 912
55% 		1.068 28.02s
Timefold 912
79% 		1.422 24.82s
Vroom 300
100% 		1.045 19.78s

Over Time

Performance Trend

60s

Feasibility Trend

Select a single domain and dataset to view trends over comparable runs.

Solution Quality lower is better

Select a single domain and dataset to view trends over comparable runs.

Time-Limit View

Time-limit Results

Limit Solver Feasible Best results Podiums Avg rank Rows
1s SolverForge 283 83 246 2.11 304
1s Ortools 261 127 178 2.46 304
1s SolverForge Python 124 10 84 4.06 304
1s Timefold 117 7 79 4.25 304
1s Pyvrp 100 10 83 2.56 100
1s Vroom 100 1 34 3.93 100
1s Pyhygese 98 82 98 1.27 100
1s Rustvrp 90 0 2 5.98 100
10s Timefold 295 45 150 4.10 304
10s SolverForge 289 52 201 2.88 304
10s Ortools 262 136 166 2.84 304
10s SolverForge Python 167 14 100 4.35 304
10s Pyvrp 100 59 100 1.46 100
10s Rustvrp 100 0 17 4.63 100
10s Pyhygese 99 42 99 1.68 100
10s Vroom 99 0 65 3.43 100
60s SolverForge 304 60 192 3.30 304
60s Timefold 304 57 202 3.49 304
60s Ortools 262 129 163 3.03 304
60s SolverForge Python 209 11 88 4.55 304
60s Pyvrp 100 73 100 1.27 100
60s Pyhygese 100 34 99 1.73 100
60s Vroom 100 0 71 3.26 100
60s Rustvrp 100 0 21 4.28 100

Recent Activity

Imported Runs

3 runs
Employee Scheduling Candidate · Completed · 504 rows
CVRP Candidate · Completed · 2,400 rows
Job Shop Scheduling Candidate · Completed · 1,944 rows

Solver Details

Versions

Ortools 9.15.6755 3 runs · 3 sources
Pyhygese 0.0.0.10 1 run
Pyvrp 0.13.3 1 run
Rustvrp 1.25.0 1 run
SolverForge 0.17.2 2 runs · 2 sources
SolverForge 0.18.0 1 run
SolverForge Python 0.5.0 2 runs
SolverForge Python 0.6.1 1 run
Timefold 2.1.0 3 runs · 3 sources
Vroom 1.15.0 1 run