Compare commits

Home / Compare da52ced5 .. b8a23a42

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.392-70.391=0.001
σ0.045-0.044=0.001
min70.365-70.369=-0.004
max70.518-70.513=0.005
mean413.000
σ0.000
min413.000
max413.000
mean0.160-0.158=0.001
σ0.003-0.004=-0.001
min0.155-0.151=0.005
max0.167-0.165=0.001
cache=y
dps=1
iters=10
policies=100
mean21.147-21.147=-0.000
σ0.010-0.010=0.000
min21.139-21.139=0.000
max21.175-21.175=0.000
mean413.000
σ0.000
min413.000
max413.000
mean0.064-0.064=0.001
σ0.002-0.002=-0.000
min0.063-0.062=0.001
max0.071-0.070=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.394-1752.393=0.001
σ0.360-0.361=-0.002
min1751.825-1751.824=0.001
max1752.981-1752.981=-0.000
mean1657.150-1660.050=-2.900
σ633.126-635.969=-2.843
min625.000-615.000=10.000
max2765.000-2776.000=-11.000
mean2.754-2.833=-0.079
σ0.227-0.123=0.104
min2.232-2.577=-0.345
max3.047-3.076=-0.030

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.144-270.146=-0.001
σ0.009-0.010=-0.001
min270.134-270.131=0.003
max270.153-270.156=-0.003
mean2765.000-2776.000=-11.000
σ0.000
min2765.000-2776.000=-11.000
max2765.000-2776.000=-11.000
mean0.379-0.379=-0.001
σ0.007-0.005=0.002
min0.367-0.371=-0.003
max0.387-0.384=0.003
iters=5
new-facts=1
prior-facts=6402
mean1930.588-1930.608=-0.020
σ0.026-0.005=0.021
min1930.562-1930.603=-0.042
max1930.617-1930.617=0.000
mean2765.000-2776.000=-11.000
σ0.000
min2765.000-2776.000=-11.000
max2765.000-2776.000=-11.000
mean2.500-2.557=-0.057
σ0.184-0.135=0.049
min2.339-2.464=-0.125
max2.791-2.774=0.017
iters=5
new-facts=6402
prior-facts=1
mean4751.296-4751.314=-0.018
σ0.878-0.834=0.044
min4750.824-4750.798=0.026
max4752.856-4752.792=0.063
mean2765.000-2776.000=-11.000
σ0.000
min2765.000-2776.000=-11.000
max2765.000-2776.000=-11.000
mean8.640-8.422=0.218
σ0.354-0.506=-0.153
min8.065-7.684=0.382
max8.983-9.078=-0.095
iters=5
new-facts=6402
prior-facts=6402
mean4941.772-4941.771=0.001
σ0.023-0.025=-0.002
min4941.747-4941.744=0.003
max4941.801-4941.802=-0.000
mean3037.800-3038.000=-0.200
σ232.347-233.983=-1.636
min2765.000-2776.000=-11.000
max3319.000-3377.000=-58.000
mean8.458-8.586=-0.128
σ0.188-0.174=0.015
min8.190-8.395=-0.205
max8.715-8.798=-0.082

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.026-1.022=0.004
σ0.138-0.139=-0.002
min0.933-0.930=0.003
max1.252-1.253=-0.001

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.757-466.757=-0.000
σ575.928-575.929=-0.001
min178.783-178.786=-0.004
max1330.649-1330.651=-0.002
mean86.250
σ8.500
min82.000
max99.000
mean2765.000-2776.000=-11.000
σ0.000
min2765.000-2776.000=-11.000
max2765.000-2776.000=-11.000
mean0.441-0.437=0.003
σ0.306-0.296=0.010
min0.285-0.285=0.000
max0.900-0.882=0.019
policies=20
mean1788.148-1788.147=0.000
σ0.346-0.357=-0.011
min1787.897-1787.891=0.006
max1788.651-1788.672=-0.021
mean820.000
σ0.000
min820.000
max820.000
mean2765.000-2776.000=-11.000
σ0.000
min2765.000-2776.000=-11.000
max2765.000-2776.000=-11.000
mean2.834-2.839=-0.006
σ0.109-0.077=0.032
min2.775-2.752=0.023
max2.997-2.938=0.060
policies=200
mean17888.069-17888.169=-0.100
σ0.530-0.482=0.048
min17887.701-17887.851=-0.150
max17888.846-17888.886=-0.040
mean8200.000
σ0.000
min8200.000
max8200.000
mean2765.000-2776.000=-11.000
σ0.000
min2765.000-2776.000=-11.000
max2765.000-2776.000=-11.000
mean28.001-27.986=0.015
σ0.103-0.224=-0.120
min27.867-27.867=0.000
max28.111-28.321=-0.210