Compare commits

Home / Compare 2e5abb73 .. 68e85579

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.380-70.379=0.001
σ0.046-0.047=-0.001
min70.355-70.352=0.002
max70.507-70.510=-0.002
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.158-0.158=-0.001
σ0.004-0.005=-0.001
min0.151-0.151=0.000
max0.165-0.167=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.144-21.144=0.000
σ0.003-0.002=0.000
min21.140-21.140=-0.000
max21.147-21.147=0.000
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.062-0.064=-0.002
σ0.004-0.003=0.001
min0.059-0.059=0.000
max0.071-0.069=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.386-1752.387=-0.001
σ0.365-0.364=0.000
min1751.824-1751.819=0.005
max1752.974-1752.970=0.004
mean1662.500-1655.700=6.800
σ628.969-632.457=-3.488
min685.000-621.000=64.000
max2791.000-2759.000=32.000
mean2.800-2.759=0.041
σ0.193-0.199=-0.006
min2.271-2.379=-0.108
max3.114-3.034=0.081

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.126-270.125=0.001
σ0.004-0.006=-0.002
min270.121-270.114=0.007
max270.133-270.129=0.003
mean2791.000-2759.000=32.000
σ0.000
min2791.000-2759.000=32.000
max2791.000-2759.000=32.000
mean0.380-0.382=-0.002
σ0.004-0.006=-0.002
min0.377-0.378=-0.001
max0.387-0.393=-0.006
iters=5
new-facts=1
prior-facts=6402
mean1930.585-1930.574=0.011
σ0.015-0.022=-0.006
min1930.559-1930.548=0.011
max1930.600-1930.603=-0.004
mean2791.000-2759.000=32.000
σ0.000
min2791.000-2759.000=32.000
max2791.000-2759.000=32.000
mean2.559-2.499=0.060
σ0.132-0.169=-0.036
min2.390-2.250=0.140
max2.724-2.699=0.025
iters=5
new-facts=6402
prior-facts=1
mean4751.019-4751.117=-0.098
σ0.851-0.810=0.041
min4750.273-4750.656=-0.383
max4752.480-4752.555=-0.075
mean2791.000-2759.000=32.000
σ0.000
min2791.000-2759.000=32.000
max2791.000-2759.000=32.000
mean8.060-8.184=-0.124
σ0.308-0.380=-0.072
min7.670-7.699=-0.029
max8.425-8.649=-0.224
iters=5
new-facts=6402
prior-facts=6402
mean4941.451-4941.379=0.072
σ0.207-0.102=0.105
min4941.104-4941.267=-0.163
max4941.610-4941.465=0.145
mean3057.600-3042.600=15.000
σ330.268-339.472=-9.204
min2791.000-2759.000=32.000
max3558.000-3545.000=13.000
mean8.377-8.386=-0.008
σ0.086-0.104=-0.019
min8.316-8.288=0.029
max8.529-8.564=-0.035

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.068-1.046=0.022
σ0.106-0.163=-0.057
min0.938-0.943=-0.005
max1.234-1.321=-0.087

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.361-466.363=-0.002
σ575.932-575.928=0.004
min178.387-178.386=0.001
max1330.260-1330.255=0.005
mean84.000
σ8.000
min80.000
max96.000
mean2791.000-2759.000=32.000
σ0.000
min2791.000-2759.000=32.000
max2791.000-2759.000=32.000
mean0.440-0.552=-0.112
σ0.303-0.529=-0.226
min0.283-0.282=0.002
max0.895-1.345=-0.450
policies=20
mean1784.279-1784.217=0.062
σ0.339-0.354=-0.016
min1784.076-1783.988=0.088
max1784.783-1784.744=0.039
mean800.000
σ0.000
min800.000
max800.000
mean2791.000-2759.000=32.000
σ0.000
min2791.000-2759.000=32.000
max2791.000-2759.000=32.000
mean2.861-2.765=0.096
σ0.115-0.013=0.102
min2.777-2.754=0.023
max3.025-2.777=0.248
policies=200
mean17848.817-17848.879=-0.062
σ0.344-0.430=-0.086
min17848.582-17848.622=-0.040
max17849.328-17849.521=-0.194
mean8000.000
σ0.000
min8000.000
max8000.000
mean2791.000-2759.000=32.000
σ0.000
min2791.000-2759.000=32.000
max2791.000-2759.000=32.000
mean27.999-27.984=0.015
σ0.119-0.149=-0.029
min27.912-27.856=0.056
max28.174-28.196=-0.022