Compare commits

Home / Compare 57e2ce4c .. ae293974

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.708-70.707=0.001
σ0.046-0.046=-0.000
min70.672-70.672=-0.000
max70.834-70.835=-0.000
mean416.000-412.000=4.000
σ0.000
min416.000-412.000=4.000
max416.000-412.000=4.000
mean0.162-0.159=0.003
σ0.004-0.005=-0.001
min0.155-0.151=0.003
max0.168-0.165=0.004
cache=y
dps=1
iters=10
policies=100
mean21.411-21.412=-0.001
σ0.001-0.003=-0.001
min21.409-21.407=0.002
max21.413-21.414=-0.001
mean416.000-412.000=4.000
σ0.000
min416.000-412.000=4.000
max416.000-412.000=4.000
mean0.065-0.066=-0.000
σ0.003-0.003=0.000
min0.063-0.064=-0.001
max0.072-0.073=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.933-1754.929=0.004
σ0.360-0.361=-0.001
min1754.367-1754.361=0.006
max1755.512-1755.515=-0.004
mean1638.900-1657.950=-19.050
σ629.467-622.637=6.830
min624.000-639.000=-15.000
max2786.000-2500.000=286.000
mean2.803-2.754=0.049
σ0.214-0.199=0.015
min2.262-2.306=-0.043
max3.122-3.140=-0.018

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.790-272.794=-0.003
σ0.006-0.004=0.002
min272.784-272.789=-0.005
max272.799-272.798=0.000
mean2786.000-2500.000=286.000
σ0.000
min2786.000-2500.000=286.000
max2786.000-2500.000=286.000
mean0.380-0.382=-0.002
σ0.010-0.009=0.001
min0.373-0.377=-0.004
max0.398-0.398=-0.000
iters=5
new-facts=1
prior-facts=6402
mean1933.221-1933.223=-0.002
σ0.021-0.019=0.002
min1933.200-1933.204=-0.004
max1933.251-1933.246=0.005
mean2786.000-2500.000=286.000
σ0.000
min2786.000-2500.000=286.000
max2786.000-2500.000=286.000
mean3.069-3.141=-0.072
σ0.134-0.143=-0.009
min2.857-2.997=-0.140
max3.207-3.358=-0.151
iters=5
new-facts=6402
prior-facts=1
mean4756.955-4756.966=-0.011
σ7.544-7.557=-0.014
min4753.479-4753.496=-0.017
max4770.449-4770.484=-0.036
mean2786.000-2500.000=286.000
σ0.000
min2786.000-2500.000=286.000
max2786.000-2500.000=286.000
mean8.523-8.532=-0.009
σ0.235-0.277=-0.042
min8.264-8.221=0.044
max8.835-8.876=-0.041
iters=5
new-facts=6402
prior-facts=6402
mean4944.446-4944.448=-0.002
σ0.023-0.019=0.004
min4944.423-4944.425=-0.002
max4944.472-4944.477=-0.005
mean3038.800-2943.400=95.400
σ301.161-374.375=-73.214
min2786.000-2500.000=286.000
max3486.000-3463.000=23.000
mean8.423-8.430=-0.007
σ0.088-0.142=-0.054
min8.344-8.291=0.053
max8.556-8.657=-0.101

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.012-1.661=-0.648
σ0.153-0.113=0.040
min0.913-1.531=-0.618
max1.266-1.799=-0.533

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.339-468.319=0.020
σ574.258-574.257=0.002
min181.205-181.187=0.019
max1329.727-1329.704=0.023
mean88.250
σ8.500
min84.000
max101.000
mean2786.000-2500.000=286.000
σ0.000
min2786.000-2500.000=286.000
max2786.000-2500.000=286.000
mean0.443-0.565=-0.123
σ0.303-0.560=-0.258
min0.288-0.280=0.008
max0.897-1.406=-0.510
policies=20
mean1812.238-1812.182=0.057
σ0.333-0.384=-0.051
min1812.008-1811.919=0.090
max1812.724-1812.748=-0.024
mean840.000
σ0.000
min840.000
max840.000
mean2786.000-2500.000=286.000
σ0.000
min2786.000-2500.000=286.000
max2786.000-2500.000=286.000
mean2.871-2.820=0.051
σ0.104-0.014=0.090
min2.813-2.807=0.006
max3.026-2.838=0.188
policies=200
mean18129.188-18129.204=-0.016
σ0.515-0.438=0.077
min18128.887-18128.907=-0.020
max18129.959-18129.855=0.104
mean8400.000
σ0.000
min8400.000
max8400.000
mean2786.000-2500.000=286.000
σ0.000
min2786.000-2500.000=286.000
max2786.000-2500.000=286.000
mean28.434-28.345=0.089
σ0.194-0.078=0.115
min28.205-28.255=-0.050
max28.626-28.446=0.181