Compare commits

Home / Compare e4ff880c .. faf4a3bb

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.958-30.769=0.189
σ0.049-0.046=0.003
min30.923-30.729=0.194
max31.093-30.895=0.198
mean416.000
σ0.000
min416.000
max416.000
mean0.077-0.077=-0.001
σ0.003-0.005=-0.001
min0.071-0.071=0.000
max0.084-0.086=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.059-21.059=-0.000
σ0.002-0.003=-0.001
min21.055-21.053=0.001
max21.063-21.063=-0.000
mean416.000
σ0.000
min416.000
max416.000
mean0.060-0.059=0.001
σ0.003-0.003=-0.001
min0.057-0.057=-0.000
max0.065-0.066=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.412-1751.419=-0.007
σ0.361-0.361=0.001
min1750.844-1750.850=-0.006
max1751.997-1752.003=-0.006
mean1663.750-1652.900=10.850
σ623.955-615.983=7.972
min661.000-660.000=1.000
max2510.000-2486.000=24.000
mean2.851-2.779=0.072
σ0.107-0.216=-0.109
min2.578-2.182=0.396
max3.032-3.110=-0.079

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.404-275.757=-2.353
σ0.010-0.008=0.002
min273.395-275.747=-2.352
max273.414-275.765=-2.351
mean2510.000-2486.000=24.000
σ0.000
min2510.000-2486.000=24.000
max2510.000-2486.000=24.000
mean0.387-0.402=-0.015
σ0.008-0.009=-0.001
min0.378-0.394=-0.017
max0.395-0.413=-0.018
iters=5
new-facts=1
prior-facts=6402
mean1933.839-2168.278=-234.440
σ0.008-0.018=-0.010
min1933.828-2168.255=-234.428
max1933.848-2168.297=-234.449
mean2510.000-2486.000=24.000
σ0.000
min2510.000-2486.000=24.000
max2510.000-2486.000=24.000
mean3.186-2.962=0.223
σ0.161-0.136=0.026
min3.028-2.789=0.239
max3.386-3.117=0.269
iters=5
new-facts=6402
prior-facts=1
mean4754.222-5048.111=-293.888
σ0.953-0.914=0.039
min4753.461-5047.537=-294.075
max4755.888-5049.732=-293.845
mean2510.000-2486.000=24.000
σ0.000
min2510.000-2486.000=24.000
max2510.000-2486.000=24.000
mean8.508-8.755=-0.247
σ0.631-0.466=0.165
min7.637-8.051=-0.415
max9.050-9.296=-0.246
iters=5
new-facts=6402
prior-facts=6402
mean4944.790-5179.083=-234.293
σ0.081-0.288=-0.207
min4944.724-5178.580=-233.856
max4944.879-5179.317=-234.438
mean2969.000-3268.200=-299.200
σ430.705-375.998=54.706
min2510.000-2735.000=-225.000
max3557.000-3719.000=-162.000
mean8.456-9.575=-1.118
σ0.120-0.573=-0.453
min8.362-8.614=-0.252
max8.664-10.041=-1.377

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.646-1.718=-0.073
σ0.154-0.154=0.000
min1.400-1.447=-0.047
max1.819-1.810=0.009

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.336-463.568=-0.232
σ572.196-572.653=-0.456
min177.234-177.240=-0.006
max1321.630-1322.547=-0.916
mean79.750
σ7.500
min76.000
max91.000
mean2510.000-2486.000=24.000
σ0.000
min2510.000-2486.000=24.000
max2510.000-2486.000=24.000
mean0.559-0.551=0.008
σ0.552-0.543=0.009
min0.279-0.278=0.002
max1.387-1.366=0.021
policies=20
mean1772.587-1772.637=-0.050
σ0.335-0.326=0.009
min1772.366-1772.417=-0.051
max1773.084-1773.121=-0.036
mean760.000
σ0.000
min760.000
max760.000
mean2510.000-2486.000=24.000
σ0.000
min2510.000-2486.000=24.000
max2510.000-2486.000=24.000
mean2.744-2.733=0.011
σ0.021-0.029=-0.008
min2.726-2.703=0.022
max2.769-2.771=-0.002
policies=200
mean17732.369-17732.906=-0.537
σ0.578-0.538=0.040
min17732.008-17732.479=-0.471
max17733.230-17733.690=-0.460
mean7600.000
σ0.000
min7600.000
max7600.000
mean2510.000-2486.000=24.000
σ0.000
min2510.000-2486.000=24.000
max2510.000-2486.000=24.000
mean27.677-27.706=-0.029
σ0.071-0.125=-0.054
min27.622-27.587=0.035
max27.778-27.863=-0.086