Compare commits

Home / Compare 8134257f .. dfcf7b34

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.774-35.799=-5.025
σ0.046-0.107=-0.061
min30.753-35.749=-4.996
max30.905-36.103=-5.198
mean413.000-411.000=2.000
σ0.000
min413.000-411.000=2.000
max413.000-411.000=2.000
mean0.080-0.077=0.003
σ0.003-0.004=-0.001
min0.077-0.073=0.003
max0.086-0.083=0.004
cache=y
dps=1
iters=10
policies=100
mean21.059-26.064=-5.005
σ0.003-0.003=0.000
min21.055-26.060=-5.005
max21.065-26.068=-5.003
mean413.000-411.000=2.000
σ0.000
min413.000-411.000=2.000
max413.000-411.000=2.000
mean0.062-0.060=0.003
σ0.003-0.003=0.001
min0.058-0.056=0.001
max0.066-0.065=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.235-1755.923=-4.687
σ0.363-0.365=-0.002
min1750.666-1755.352=-4.687
max1751.828-1756.511=-4.684
mean1649.950-1667.750=-17.800
σ620.036-636.073=-16.037
min681.000-665.000=16.000
max2643.000-2632.000=11.000
mean2.765-2.808=-0.043
σ0.157-0.092=0.065
min2.265-2.582=-0.317
max2.985-2.998=-0.013

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.196-274.828=-1.631
σ0.011-0.006=0.004
min273.178-274.822=-1.644
max273.204-274.835=-1.631
mean2643.000-2632.000=11.000
σ0.000
min2643.000-2632.000=11.000
max2643.000-2632.000=11.000
mean0.388-0.391=-0.004
σ0.006-0.011=-0.004
min0.377-0.383=-0.006
max0.393-0.406=-0.012
iters=5
new-facts=1
prior-facts=6402
mean1933.635-1939.998=-6.363
σ0.012-0.008=0.005
min1933.621-1939.987=-6.366
max1933.650-1940.005=-6.355
mean2643.000-2632.000=11.000
σ0.000
min2643.000-2632.000=11.000
max2643.000-2632.000=11.000
mean3.042-3.077=-0.035
σ0.172-0.105=0.067
min2.812-2.950=-0.138
max3.243-3.203=0.040
iters=5
new-facts=6402
prior-facts=1
mean4754.023-4758.864=-4.841
σ1.035-0.907=0.128
min4752.979-4758.333=-5.354
max4755.762-4760.477=-4.715
mean2643.000-2632.000=11.000
σ0.000
min2643.000-2632.000=11.000
max2643.000-2632.000=11.000
mean8.646-8.169=0.477
σ0.796-0.671=0.125
min7.640-7.688=-0.048
max9.746-9.344=0.403
iters=5
new-facts=6402
prior-facts=6402
mean4944.455-4953.836=-9.382
σ0.280-0.193=0.087
min4943.969-4953.567=-9.597
max4944.693-4954.058=-9.365
mean2997.400-2988.800=8.600
σ309.438-353.616=-44.178
min2643.000-2632.000=11.000
max3304.000-3505.000=-201.000
mean8.872-8.476=0.396
σ0.603-0.126=0.477
min8.388-8.363=0.025
max9.879-8.647=1.232

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.246-1.308=-0.062
σ0.452-0.372=0.080
min0.942-0.950=-0.008
max2.022-1.775=0.247

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.206-464.854=-1.648
σ572.660-572.657=0.003
min176.871-178.523=-1.652
max1322.196-1323.839=-1.643
mean77.500-79.500=-2.000
σ7.000
min74.000-76.000=-2.000
max88.000-90.000=-2.000
mean2643.000-2632.000=11.000
σ0.000
min2643.000-2632.000=11.000
max2643.000-2632.000=11.000
mean0.547-0.579=-0.033
σ0.536-0.592=-0.056
min0.274-0.279=-0.005
max1.351-1.467=-0.117
policies=20
mean1768.955-1785.482=-16.527
σ0.329-0.345=-0.016
min1768.742-1785.258=-16.516
max1769.445-1785.993=-16.548
mean740.000-760.000=-20.000
σ0.000
min740.000-760.000=-20.000
max740.000-760.000=-20.000
mean2643.000-2632.000=11.000
σ0.000
min2643.000-2632.000=11.000
max2643.000-2632.000=11.000
mean2.738-2.794=-0.057
σ0.021-0.015=0.006
min2.716-2.779=-0.062
max2.763-2.813=-0.050
policies=200
mean17696.272-17861.412=-165.140
σ0.517-0.535=-0.018
min17695.989-17861.062=-165.072
max17697.046-17862.197=-165.151
mean7400.000-7600.000=-200.000
σ0.000
min7400.000-7600.000=-200.000
max7400.000-7600.000=-200.000
mean2643.000-2632.000=11.000
σ0.000
min2643.000-2632.000=11.000
max2643.000-2632.000=11.000
mean27.514-28.289=-0.775
σ0.147-0.196=-0.050
min27.357-28.075=-0.718
max27.688-28.523=-0.835