Compare commits

Home / Compare 8ebdbf88 .. 2c406901

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.380-31.037=39.343
σ0.046-0.051=-0.005
min70.352-30.997=39.355
max70.509-31.178=39.331
mean413.000
σ0.000
min413.000
max413.000
mean0.160-0.064=0.096
σ0.003-0.009=-0.006
min0.157-0.043=0.114
max0.166-0.078=0.088
cache=y
dps=1
iters=10
policies=100
mean21.143-21.143=0.001
σ0.002-0.003=-0.001
min21.141-21.138=0.003
max21.147-21.148=-0.001
mean413.000
σ0.000
min413.000
max413.000
mean0.062-0.063=-0.001
σ0.004-0.004=-0.001
min0.057-0.057=0.000
max0.067-0.072=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.389-1751.415=0.974
σ0.361-0.361=-0.001
min1751.819-1750.846=0.973
max1752.977-1751.993=0.984
mean1658.000-1636.850=21.150
σ636.058-614.961=21.097
min623.000-626.000=-3.000
max2800.000-2469.000=331.000
mean2.762-2.887=-0.125
σ0.223-0.096=0.128
min2.156-2.672=-0.516
max3.003-3.045=-0.043

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.126-266.783=3.343
σ0.003-0.007=-0.003
min270.122-266.775=3.347
max270.131-266.793=3.338
mean2800.000-2469.000=331.000
σ0.000
min2800.000-2469.000=331.000
max2800.000-2469.000=331.000
mean0.379-0.373=0.006
σ0.001-0.001=-0.000
min0.377-0.372=0.006
max0.380-0.374=0.005
iters=5
new-facts=1
prior-facts=6402
mean1930.580-1927.209=3.371
σ0.025-0.013=0.011
min1930.541-1927.190=3.351
max1930.600-1927.222=3.379
mean2800.000-2469.000=331.000
σ0.000
min2800.000-2469.000=331.000
max2800.000-2469.000=331.000
mean2.549-3.127=-0.578
σ0.314-0.205=0.109
min2.299-2.961=-0.661
max3.090-3.475=-0.385
iters=5
new-facts=6402
prior-facts=1
mean4750.972-4747.737=3.235
σ0.965-0.798=0.167
min4750.081-4747.334=2.747
max4752.624-4749.164=3.460
mean2800.000-2469.000=331.000
σ0.000
min2800.000-2469.000=331.000
max2800.000-2469.000=331.000
mean8.480-8.203=0.277
σ0.283-0.572=-0.289
min8.228-7.695=0.533
max8.962-8.929=0.032
iters=5
new-facts=6402
prior-facts=6402
mean4941.535-4938.098=3.437
σ0.090-0.118=-0.028
min4941.457-4937.917=3.540
max4941.635-4938.248=3.387
mean3027.000-2937.800=89.200
σ222.770-403.295=-180.525
min2800.000-2481.000=319.000
max3322.000-3469.000=-147.000
mean8.524-8.475=0.049
σ0.204-0.157=0.048
min8.342-8.318=0.024
max8.823-8.700=0.123

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.991-1.796=-0.804
σ0.144-0.094=0.050
min0.923-1.645=-0.722
max1.249-1.903=-0.654

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.355-465.112=1.243
σ575.921-575.754=0.167
min178.390-177.233=1.157
max1330.237-1328.743=1.494
mean84.000-79.750=4.250
σ8.000-7.500=0.500
min80.000-76.000=4.000
max96.000-91.000=5.000
mean2800.000-2469.000=331.000
σ0.000
min2800.000-2469.000=331.000
max2800.000-2469.000=331.000
mean0.435-0.555=-0.120
σ0.303-0.549=-0.247
min0.283-0.278=0.005
max0.889-1.379=-0.490
policies=20
mean1784.227-1772.580=11.647
σ0.356-0.336=0.020
min1783.986-1772.354=11.632
max1784.753-1773.078=11.674
mean800.000-760.000=40.000
σ0.000
min800.000-760.000=40.000
max800.000-760.000=40.000
mean2800.000-2469.000=331.000
σ0.000
min2800.000-2469.000=331.000
max2800.000-2469.000=331.000
mean2.847-2.750=0.097
σ0.132-0.014=0.118
min2.752-2.733=0.019
max3.034-2.765=0.268
policies=200
mean17848.644-17732.594=116.050
σ0.469-0.371=0.098
min17848.367-17732.285=116.082
max17849.346-17733.132=116.214
mean8000.000-7600.000=400.000
σ0.000
min8000.000-7600.000=400.000
max8000.000-7600.000=400.000
mean2800.000-2469.000=331.000
σ0.000
min2800.000-2469.000=331.000
max2800.000-2469.000=331.000
mean28.063-27.676=0.387
σ0.222-0.161=0.061
min27.857-27.519=0.338
max28.264-27.872=0.393