Compare commits

Home / Compare 1645a3cd .. 1ab4c8a7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.951-35.952=-0.001
σ0.102-0.103=-0.001
min35.907-35.903=0.003
max36.241-36.244=-0.003
mean412.000-412.800=-0.800
σ0.000-0.422=-0.422
min412.000
max412.000-413.000=-1.000
mean0.077-0.079=-0.002
σ0.005-0.004=0.001
min0.071-0.074=-0.003
max0.084-0.086=-0.003
cache=y
dps=1
iters=10
policies=100
mean26.201-26.201=-0.000
σ0.003-0.004=-0.001
min26.197-26.194=0.002
max26.206-26.208=-0.002
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.060-0.063=-0.002
σ0.004-0.004=0.000
min0.056-0.060=-0.004
max0.070-0.071=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.300-1756.294=0.006
σ0.368-0.369=-0.001
min1755.725-1755.725=0.000
max1756.892-1756.872=0.020
mean1656.400-1655.400=1.000
σ632.669-628.784=3.885
min610.000-617.000=-7.000
max2726.000-2719.000=7.000
mean2.365-2.392=-0.027
σ0.086-0.163=-0.077
min2.148-2.264=-0.116
max2.550-2.859=-0.309

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.817-278.819=-0.002
σ0.005-0.007=-0.002
min278.808-278.809=-0.001
max278.821-278.827=-0.007
mean2726.000-2719.000=7.000
σ0.000
min2726.000-2719.000=7.000
max2726.000-2719.000=7.000
mean0.411-0.412=-0.001
σ0.006-0.005=0.001
min0.407-0.407=-0.001
max0.421-0.419=0.003
iters=5
new-facts=1
prior-facts=6402
mean2268.877-2268.877=-0.000
σ0.016-0.020=-0.005
min2268.849-2268.847=0.002
max2268.887-2268.898=-0.011
mean2726.000-2719.000=7.000
σ0.000
min2726.000-2719.000=7.000
max2726.000-2719.000=7.000
mean2.970-3.140=-0.170
σ0.063-0.144=-0.081
min2.904-2.929=-0.025
max3.043-3.307=-0.264
iters=5
new-facts=6402
prior-facts=1
mean4954.230-4953.999=0.231
σ0.799-1.003=-0.204
min4953.728-4953.231=0.497
max4955.645-4955.707=-0.062
mean2726.000-2719.000=7.000
σ0.000
min2726.000-2719.000=7.000
max2726.000-2719.000=7.000
mean8.074-8.001=0.072
σ0.254-0.257=-0.002
min7.822-7.684=0.138
max8.372-8.319=0.053
iters=5
new-facts=6402
prior-facts=6402
mean5168.789-5168.795=-0.005
σ0.080-0.089=-0.009
min5168.723-5168.722=0.001
max5168.879-5168.908=-0.029
mean3471.200-3316.600=154.600
σ470.644-400.182=70.462
min2845.000-2922.000=-77.000
max4111.000-3722.000=389.000
mean9.333-9.572=-0.238
σ0.276-0.397=-0.121
min8.896-9.130=-0.234
max9.630-10.201=-0.570

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.995-1.036=-0.041
σ0.066-0.140=-0.074
min0.939-0.941=-0.002
max1.072-1.262=-0.189

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean459.808-459.807=0.001
σ571.583-571.585=-0.003
min174.009-174.005=0.004
max1317.182-1317.185=-0.003
mean79.500
σ7.000
min76.000
max90.000
mean2726.000-2719.000=7.000
σ0.000
min2726.000-2719.000=7.000
max2726.000-2719.000=7.000
mean0.549-0.522=0.027
σ0.554-0.519=0.036
min0.269-0.254=0.015
max1.381-1.300=0.081
policies=20
mean1740.326-1740.285=0.041
σ0.320-0.261=0.059
min1740.122-1740.106=0.016
max1740.804-1740.673=0.131
mean760.000
σ0.000
min760.000
max760.000
mean2726.000-2719.000=7.000
σ0.000
min2726.000-2719.000=7.000
max2726.000-2719.000=7.000
mean2.692-2.702=-0.010
σ0.015-0.010=0.004
min2.679-2.689=-0.010
max2.707-2.713=-0.006
policies=200
mean17410.072-17410.065=0.007
σ0.540-0.443=0.097
min17409.739-17409.701=0.038
max17410.871-17410.709=0.162
mean7600.000
σ0.000
min7600.000
max7600.000
mean2726.000-2719.000=7.000
σ0.000
min2726.000-2719.000=7.000
max2726.000-2719.000=7.000
mean27.085-27.100=-0.015
σ0.085-0.042=0.043
min26.960-27.046=-0.086
max27.145-27.144=0.001