Compare commits

Home / Compare 1f8697fd .. d7d3cb7d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.374-70.375=-0.002
σ0.058-0.059=-0.001
min70.336-70.335=0.001
max70.537-70.542=-0.005
mean412.000-416.000=-4.000
σ0.000
min412.000-416.000=-4.000
max412.000-416.000=-4.000
mean0.157-0.158=-0.002
σ0.005-0.003=0.001
min0.148-0.152=-0.003
max0.162-0.165=-0.004
cache=y
dps=1
iters=10
policies=100
mean21.143-21.143=-0.000
σ0.003-0.002=0.001
min21.138-21.140=-0.002
max21.146-21.146=-0.000
mean412.000-416.000=-4.000
σ0.000
min412.000-416.000=-4.000
max412.000-416.000=-4.000
mean0.064-0.064=0.000
σ0.002-0.002=-0.000
min0.062-0.062=0.001
max0.068-0.068=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.200-1752.200=-0.001
σ0.362-0.362=0.000
min1751.628-1751.629=-0.001
max1752.784-1752.788=-0.004
mean1629.750-1654.700=-24.950
σ607.058-623.384=-16.326
min625.000-676.000=-51.000
max2448.000-2650.000=-202.000
mean2.773-2.853=-0.080
σ0.180-0.138=0.042
min2.354-2.487=-0.133
max3.025-3.191=-0.166

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.933-269.931=0.001
σ0.007-0.005=0.002
min269.925-269.926=-0.001
max269.944-269.937=0.006
mean2448.000-2650.000=-202.000
σ0.000
min2448.000-2650.000=-202.000
max2448.000-2650.000=-202.000
mean0.378-0.373=0.006
σ0.008-0.007=0.001
min0.371-0.368=0.003
max0.389-0.384=0.004
iters=5
new-facts=1
prior-facts=6402
mean1930.384-1930.398=-0.014
σ0.024-0.009=0.015
min1930.351-1930.389=-0.038
max1930.403-1930.410=-0.007
mean2448.000-2650.000=-202.000
σ0.000
min2448.000-2650.000=-202.000
max2448.000-2650.000=-202.000
mean2.560-2.510=0.050
σ0.137-0.069=0.067
min2.454-2.453=0.002
max2.785-2.613=0.172
iters=5
new-facts=6402
prior-facts=1
mean4750.728-4750.872=-0.144
σ0.892-0.775=0.118
min4750.052-4750.282=-0.230
max4752.284-4752.227=0.056
mean2448.000-2650.000=-202.000
σ0.000
min2448.000-2650.000=-202.000
max2448.000-2650.000=-202.000
mean8.600-8.487=0.113
σ0.211-0.346=-0.135
min8.355-8.189=0.166
max8.896-9.064=-0.168
iters=5
new-facts=6402
prior-facts=6402
mean4941.330-4941.333=-0.003
σ0.081-0.089=-0.008
min4941.258-4941.255=0.003
max4941.421-4941.435=-0.014
mean2960.000-2996.800=-36.800
σ263.358-264.195=-0.837
min2603.000-2650.000=-47.000
max3303.000-3322.000=-19.000
mean8.582-8.526=0.055
σ0.149-0.184=-0.036
min8.459-8.332=0.126
max8.802-8.721=0.082

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.800-1.146=0.654
σ0.216-0.175=0.040
min1.566-0.946=0.620
max2.102-1.371=0.731

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.911-465.920=-0.009
σ575.765-575.791=-0.026
min178.024-178.021=0.003
max1329.558-1329.607=-0.049
mean81.750
σ7.500
min78.000
max93.000
mean2448.000-2650.000=-202.000
σ0.000
min2448.000-2650.000=-202.000
max2448.000-2650.000=-202.000
mean0.578-0.568=0.010
σ0.595-0.568=0.027
min0.275-0.281=-0.006
max1.471-1.421=0.051
policies=20
mean1780.478-1780.459=0.019
σ0.368-0.350=0.018
min1780.225-1780.219=0.006
max1781.023-1780.977=0.046
mean780.000
σ0.000
min780.000
max780.000
mean2448.000-2650.000=-202.000
σ0.000
min2448.000-2650.000=-202.000
max2448.000-2650.000=-202.000
mean2.772-2.778=-0.006
σ0.019-0.017=0.002
min2.754-2.764=-0.010
max2.796-2.802=-0.005
policies=200
mean17811.530-17811.409=0.121
σ0.515-0.457=0.058
min17811.220-17811.037=0.183
max17812.300-17812.077=0.223
mean7800.000
σ0.000
min7800.000
max7800.000
mean2448.000-2650.000=-202.000
σ0.000
min2448.000-2650.000=-202.000
max2448.000-2650.000=-202.000
mean27.774-27.859=-0.085
σ0.032-0.121=-0.090
min27.745-27.755=-0.009
max27.805-28.033=-0.228