Compare commits

Home / Compare f4883e2a .. cc8223d4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.778-70.774=0.004
σ0.048-0.048=-0.001
min70.745-70.745=-0.001
max70.910-70.909=0.001
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.160-0.158=0.002
σ0.004-0.004=-0.000
min0.153-0.151=0.002
max0.166-0.164=0.002
cache=y
dps=1
iters=10
policies=100
mean21.489-21.490=-0.001
σ0.003-0.002=0.000
min21.485-21.487=-0.002
max21.492-21.494=-0.002
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.063-0.065=-0.002
σ0.003-0.002=0.001
min0.059-0.063=-0.004
max0.068-0.070=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.529-1754.526=0.002
σ0.361-0.362=-0.001
min1753.953-1753.953=0.001
max1755.130-1755.120=0.011
mean1667.400-1651.650=15.750
σ648.456-624.603=23.853
min639.000-622.000=17.000
max2838.000-2646.000=192.000
mean2.803-2.755=0.048
σ0.148-0.240=-0.092
min2.377-2.168=0.210
max3.056-3.103=-0.046

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.602-273.607=-0.005
σ0.010-0.006=0.004
min273.589-273.600=-0.011
max273.612-273.615=-0.003
mean2838.000-2646.000=192.000
σ0.000
min2838.000-2646.000=192.000
max2838.000-2646.000=192.000
mean0.384-0.384=0.000
σ0.005-0.006=-0.001
min0.380-0.380=-0.000
max0.391-0.394=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1933.998-1934.000=-0.002
σ0.008-0.005=0.003
min1933.988-1933.993=-0.005
max1934.009-1934.007=0.002
mean2838.000-2646.000=192.000
σ0.000
min2838.000-2646.000=192.000
max2838.000-2646.000=192.000
mean3.003-2.915=0.089
σ0.062-0.322=-0.260
min2.936-2.356=0.579
max3.090-3.170=-0.080
iters=5
new-facts=6402
prior-facts=1
mean4754.843-4754.761=0.082
σ0.784-0.835=-0.051
min4754.442-4754.298=0.144
max4756.244-4756.247=-0.003
mean2838.000-2646.000=192.000
σ0.000
min2838.000-2646.000=192.000
max2838.000-2646.000=192.000
mean7.911-8.439=-0.528
σ0.286-0.514=-0.228
min7.697-7.608=0.089
max8.410-8.914=-0.504
iters=5
new-facts=6402
prior-facts=6402
mean4945.217-4945.153=0.063
σ0.015-0.145=-0.129
min4945.197-4944.897=0.300
max4945.232-4945.247=-0.015
mean3038.200-2995.000=43.200
σ272.930-266.206=6.724
min2838.000-2646.000=192.000
max3469.000-3325.000=144.000
mean8.483-8.533=-0.050
σ0.116-0.139=-0.024
min8.369-8.405=-0.035
max8.664-8.719=-0.055

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.041-1.152=-0.111
σ0.121-0.212=-0.092
min0.930-0.931=-0.001
max1.224-1.474=-0.250

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.846-472.840=0.005
σ574.926-574.946=-0.020
min185.369-185.363=0.007
max1335.235-1335.260=-0.024
mean88.250
σ8.500
min84.000
max101.000
mean2838.000-2646.000=192.000
σ0.000
min2838.000-2646.000=192.000
max2838.000-2646.000=192.000
mean0.450-0.559=-0.109
σ0.299-0.543=-0.244
min0.299-0.286=0.013
max0.899-1.374=-0.476
policies=20
mean1854.024-1853.965=0.059
σ0.366-0.378=-0.011
min1853.760-1853.712=0.048
max1854.559-1854.524=0.035
mean840.000
σ0.000
min840.000
max840.000
mean2838.000-2646.000=192.000
σ0.000
min2838.000-2646.000=192.000
max2838.000-2646.000=192.000
mean2.946-2.870=0.076
σ0.004-0.013=-0.009
min2.941-2.857=0.084
max2.949-2.887=0.062
policies=200
mean18546.599-18546.537=0.063
σ0.516-0.615=-0.098
min18546.201-18546.155=0.046
max18547.333-18547.454=-0.121
mean8400.000
σ0.000
min8400.000
max8400.000
mean2838.000-2646.000=192.000
σ0.000
min2838.000-2646.000=192.000
max2838.000-2646.000=192.000
mean29.117-28.796=0.321
σ0.561-0.068=0.494
min28.784-28.725=0.059
max29.957-28.887=1.070