Compare commits

Home / Compare 9f94bcea .. 433475c3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.040-31.040=-0.000
σ0.049-0.052=-0.002
min31.001-31.002=-0.001
max31.177-31.185=-0.007
mean412.200-417.000=-4.800
σ0.422-0.000=0.422
min412.000-417.000=-5.000
max413.000-417.000=-4.000
mean0.078-0.076=0.002
σ0.003-0.005=-0.002
min0.077-0.071=0.007
max0.086-0.084=0.002
cache=y
dps=1
iters=10
policies=100
mean21.143-21.142=0.001
σ0.003-0.003=0.000
min21.140-21.138=0.002
max21.149-21.146=0.003
mean413.000-417.000=-4.000
σ0.000
min413.000-417.000=-4.000
max413.000-417.000=-4.000
mean0.064-0.063=0.002
σ0.002-0.005=-0.002
min0.063-0.058=0.005
max0.070-0.072=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.413-1751.414=-0.000
σ0.361-0.361=-0.001
min1750.850-1750.849=0.001
max1751.995-1751.998=-0.003
mean1654.650-1664.600=-9.950
σ648.384-622.945=25.439
min649.000-641.000=8.000
max2849.000-2513.000=336.000
mean2.869-2.861=0.008
σ0.129-0.102=0.027
min2.526-2.626=-0.099
max3.202-3.089=0.113

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.070-279.073=-0.002
σ0.006-0.009=-0.003
min279.060-279.062=-0.003
max279.074-279.083=-0.009
mean2849.000-2513.000=336.000
σ0.000
min2849.000-2513.000=336.000
max2849.000-2513.000=336.000
mean0.390-0.391=-0.000
σ0.006-0.004=0.001
min0.385-0.386=-0.001
max0.398-0.395=0.002
iters=5
new-facts=1
prior-facts=6402
mean1939.511-1939.510=0.001
σ0.009-0.005=0.004
min1939.502-1939.505=-0.003
max1939.524-1939.517=0.007
mean2849.000-2513.000=336.000
σ0.000
min2849.000-2513.000=336.000
max2849.000-2513.000=336.000
mean3.027-3.050=-0.024
σ0.144-0.078=0.066
min2.790-2.972=-0.182
max3.146-3.167=-0.021
iters=5
new-facts=6402
prior-facts=1
mean4759.950-4759.933=0.017
σ0.960-0.980=-0.020
min4759.030-4759.067=-0.037
max4761.575-4761.621=-0.046
mean2849.000-2513.000=336.000
σ0.000
min2849.000-2513.000=336.000
max2849.000-2513.000=336.000
mean8.161-8.282=-0.121
σ0.539-0.605=-0.066
min7.761-7.686=0.075
max9.062-9.254=-0.192
iters=5
new-facts=6402
prior-facts=6402
mean4950.472-4950.466=0.006
σ0.079-0.075=0.004
min4950.410-4950.405=0.005
max4950.562-4950.548=0.014
mean3073.000-2976.800=96.200
σ297.765-420.091=-122.326
min2849.000-2513.000=336.000
max3533.000-3550.000=-17.000
mean8.365-8.459=-0.094
σ0.068-0.129=-0.061
min8.297-8.355=-0.057
max8.447-8.684=-0.236

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.102-1.797=-0.695
σ0.085-0.114=-0.029
min1.056-1.644=-0.588
max1.254-1.898=-0.644

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.346-463.328=0.018
σ572.203-572.195=0.009
min177.233-177.228=0.005
max1321.651-1321.620=0.031
mean79.750
σ7.500
min76.000
max91.000
mean2849.000-2513.000=336.000
σ0.000
min2849.000-2513.000=336.000
max2849.000-2513.000=336.000
mean0.438-0.551=-0.113
σ0.299-0.542=-0.243
min0.284-0.277=0.007
max0.886-1.364=-0.478
policies=20
mean1772.624-1772.564=0.060
σ0.330-0.335=-0.005
min1772.378-1772.342=0.036
max1773.106-1773.062=0.044
mean760.000
σ0.000
min760.000
max760.000
mean2849.000-2513.000=336.000
σ0.000
min2849.000-2513.000=336.000
max2849.000-2513.000=336.000
mean2.832-2.756=0.076
σ0.008-0.026=-0.018
min2.822-2.729=0.094
max2.842-2.782=0.060
policies=200
mean17732.564-17732.474=0.090
σ0.474-0.504=-0.030
min17732.195-17732.071=0.124
max17733.258-17733.207=0.051
mean7600.000
σ0.000
min7600.000
max7600.000
mean2849.000-2513.000=336.000
σ0.000
min2849.000-2513.000=336.000
max2849.000-2513.000=336.000
mean28.101-27.685=0.416
σ0.491-0.142=0.349
min27.573-27.511=0.062
max28.588-27.810=0.778