Compare commits

Home / Compare 501fed9e .. 93d2dc45

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.041-31.040=0.001
σ0.049-0.050=-0.002
min31.001-30.998=0.003
max31.176-31.178=-0.003
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.079-0.077=0.001
σ0.003-0.005=-0.002
min0.076-0.071=0.005
max0.084-0.085=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.143-21.143=0.000
σ0.002-0.002=-0.000
min21.140-21.138=0.002
max21.146-21.146=0.000
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.064-0.064=0.000
σ0.004-0.003=0.001
min0.059-0.062=-0.004
max0.070-0.071=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.410-1751.411=-0.001
σ0.362-0.360=0.002
min1750.840-1750.841=-0.001
max1752.001-1751.997=0.005
mean1662.700-1642.850=19.850
σ637.344-617.043=20.301
min624.000-629.000=-5.000
max2814.000-2478.000=336.000
mean2.744-2.792=-0.048
σ0.212-0.171=0.040
min2.160-2.254=-0.094
max3.056-3.051=0.005

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean266.784-259.029=7.755
σ0.007-17.344=-17.338
min266.777-228.003=38.774
max266.794-266.791=0.003
mean2814.000-2478.000=336.000
σ0.000
min2814.000-2478.000=336.000
max2814.000-2478.000=336.000
mean0.368-0.355=0.013
σ0.004-0.025=-0.021
min0.365-0.310=0.055
max0.375-0.367=0.009
iters=5
new-facts=1
prior-facts=6402
mean1927.217-1927.209=0.009
σ0.011-0.008=0.003
min1927.208-1927.198=0.010
max1927.235-1927.220=0.015
mean2814.000-2478.000=336.000
σ0.000
min2814.000-2478.000=336.000
max2814.000-2478.000=336.000
mean2.976-3.024=-0.048
σ0.067-0.147=-0.080
min2.875-2.864=0.012
max3.061-3.225=-0.164
iters=5
new-facts=6402
prior-facts=1
mean4747.749-4747.634=0.115
σ0.798-0.888=-0.090
min4747.279-4746.840=0.439
max4749.168-4749.161=0.007
mean2814.000-2478.000=336.000
σ0.000
min2814.000-2478.000=336.000
max2814.000-2478.000=336.000
mean8.262-8.374=-0.112
σ0.754-0.524=0.229
min7.649-7.635=0.014
max9.396-8.919=0.477
iters=5
new-facts=6402
prior-facts=6402
mean4938.162-4938.171=-0.009
σ0.081-0.085=-0.004
min4938.098-4938.104=-0.006
max4938.252-4938.266=-0.015
mean3064.000-3020.000=44.000
σ316.465-261.278=55.187
min2814.000-2631.000=183.000
max3544.000-3330.000=214.000
mean8.563-8.675=-0.112
σ0.355-0.292=0.064
min8.359-8.367=-0.008
max9.191-9.028=0.162

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.081-1.830=-0.749
σ0.122-0.076=0.046
min0.929-1.704=-0.775
max1.271-1.897=-0.626

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.119-465.111=0.008
σ575.753-575.752=0.002
min177.238-177.233=0.005
max1328.749-1328.738=0.011
mean79.750
σ7.500
min76.000
max91.000
mean2814.000-2478.000=336.000
σ0.000
min2814.000-2478.000=336.000
max2814.000-2478.000=336.000
mean0.437-0.543=-0.106
σ0.307-0.523=-0.217
min0.280-0.274=0.006
max0.897-1.328=-0.431
policies=20
mean1772.611-1772.572=0.039
σ0.322-0.333=-0.011
min1772.370-1772.350=0.020
max1773.073-1773.066=0.007
mean760.000
σ0.000
min760.000
max760.000
mean2814.000-2478.000=336.000
σ0.000
min2814.000-2478.000=336.000
max2814.000-2478.000=336.000
mean2.847-2.732=0.115
σ0.111-0.021=0.090
min2.743-2.717=0.026
max3.005-2.764=0.241
policies=200
mean17732.473-17732.503=-0.030
σ0.532-0.480=0.052
min17732.038-17732.218=-0.179
max17733.250-17733.222=0.028
mean7600.000
σ0.000
min7600.000
max7600.000
mean2814.000-2478.000=336.000
σ0.000
min2814.000-2478.000=336.000
max2814.000-2478.000=336.000
mean27.715-27.706=0.010
σ0.132-0.123=0.010
min27.602-27.610=-0.008
max27.887-27.882=0.005