Compare commits

Home / Compare a290c9bf .. 391da7ac

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.701-70.702=-0.002
σ0.044-0.047=-0.003
min70.675-70.670=0.005
max70.823-70.832=-0.009
mean416.600-416.000=0.600
σ0.516-0.000=0.516
min416.000
max417.000-416.000=1.000
mean0.160-0.161=-0.001
σ0.004-0.005=-0.001
min0.155-0.154=0.000
max0.167-0.172=-0.005
cache=y
dps=1
iters=10
policies=100
mean21.409-21.408=0.002
σ0.002-0.002=0.000
min21.405-21.404=0.001
max21.413-21.412=0.001
mean417.000-416.000=1.000
σ0.000
min417.000-416.000=1.000
max417.000-416.000=1.000
mean0.065-0.064=0.001
σ0.002-0.004=-0.002
min0.063-0.060=0.003
max0.070-0.074=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.932-1754.931=0.001
σ0.360-0.361=-0.001
min1754.361-1754.365=-0.005
max1755.516-1755.517=-0.001
mean1671.050-1668.550=2.500
σ642.739-618.724=24.015
min679.000-627.000=52.000
max2706.000-2501.000=205.000
mean2.849-2.827=0.022
σ0.129-0.150=-0.021
min2.579-2.279=0.300
max3.060-2.970=0.090

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.754-272.754=0.001
σ0.004-0.006=-0.003
min272.751-272.747=0.004
max272.759-272.761=-0.003
mean2706.000-2501.000=205.000
σ0.000
min2706.000-2501.000=205.000
max2706.000-2501.000=205.000
mean0.384-0.384=-0.000
σ0.006-0.008=-0.002
min0.379-0.380=-0.001
max0.393-0.398=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1933.155-1933.162=-0.007
σ0.016-0.017=-0.001
min1933.131-1933.142=-0.011
max1933.172-1933.183=-0.011
mean2706.000-2501.000=205.000
σ0.000
min2706.000-2501.000=205.000
max2706.000-2501.000=205.000
mean3.036-3.144=-0.108
σ0.131-0.165=-0.034
min2.822-3.026=-0.204
max3.173-3.427=-0.255
iters=5
new-facts=6402
prior-facts=1
mean4756.908-4756.945=-0.037
σ7.597-7.555=0.042
min4753.479-4753.537=-0.058
max4770.498-4770.460=0.038
mean2706.000-2501.000=205.000
σ0.000
min2706.000-2501.000=205.000
max2706.000-2501.000=205.000
mean8.615-8.495=0.120
σ0.234-0.135=0.099
min8.276-8.331=-0.055
max8.919-8.680=0.238
iters=5
new-facts=6402
prior-facts=6402
mean4944.252-4944.392=-0.140
σ0.188-0.025=0.163
min4944.046-4944.355=-0.308
max4944.417-4944.419=-0.002
mean2982.200-2948.000=34.200
σ319.572-382.137=-62.565
min2706.000-2501.000=205.000
max3438.000-3456.000=-18.000
mean8.441-8.375=0.067
σ0.186-0.086=0.100
min8.328-8.266=0.062
max8.765-8.470=0.295

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.007-1.663=-0.656
σ0.145-0.246=-0.101
min0.909-1.234=-0.325
max1.240-1.845=-0.605

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.328-468.320=0.008
σ574.269-574.257=0.013
min181.186-181.186=-0.000
max1329.733-1329.705=0.027
mean88.250
σ8.500
min84.000
max101.000
mean2706.000-2501.000=205.000
σ0.000
min2706.000-2501.000=205.000
max2706.000-2501.000=205.000
mean0.543-0.562=-0.019
σ0.519-0.563=-0.044
min0.281-0.280=0.001
max1.321-1.406=-0.085
policies=20
mean1812.181-1812.176=0.005
σ0.375-0.387=-0.012
min1811.933-1811.919=0.014
max1812.738-1812.749=-0.011
mean840.000
σ0.000
min840.000
max840.000
mean2706.000-2501.000=205.000
σ0.000
min2706.000-2501.000=205.000
max2706.000-2501.000=205.000
mean2.824-2.823=0.000
σ0.010-0.009=0.001
min2.811-2.811=-0.000
max2.832-2.831=0.001
policies=200
mean18129.011-18128.965=0.047
σ0.362-0.357=0.004
min18128.729-18128.781=-0.052
max18129.540-18129.501=0.039
mean8400.000
σ0.000
min8400.000
max8400.000
mean2706.000-2501.000=205.000
σ0.000
min2706.000-2501.000=205.000
max2706.000-2501.000=205.000
mean28.366-28.433=-0.066
σ0.160-0.069=0.092
min28.207-28.334=-0.128
max28.530-28.493=0.037