Compare commits

Home / Compare b381c6e4 .. 178a65a9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.263-35.263=0.001
σ0.055-0.055=0.000
min35.233-35.229=0.004
max35.417-35.415=0.002
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.086-0.085=0.001
σ0.004-0.005=-0.001
min0.082-0.077=0.005
max0.092-0.092=-0.001
cache=y
dps=1
iters=10
policies=100
mean23.769-23.768=0.001
σ0.003-0.003=-0.001
min23.766-23.761=0.005
max23.774-23.774=0.000
mean415.700-413.000=2.700
σ0.483-0.000=0.483
min415.000-413.000=2.000
max416.000-413.000=3.000
mean0.068-0.069=-0.000
σ0.003-0.004=-0.000
min0.066-0.066=-0.000
max0.075-0.076=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.484-1756.486=-0.001
σ0.365-0.364=0.001
min1755.907-1755.911=-0.003
max1757.069-1757.072=-0.003
mean1652.300-1629.300=23.000
σ639.625-592.676=46.949
min629.000-634.000=-5.000
max2839.000-2428.000=411.000
mean2.381-2.331=0.050
σ0.130-0.075=0.055
min2.265-2.191=0.074
max2.745-2.458=0.287

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.707-324.703=0.004
σ0.045-0.053=-0.008
min324.627-324.610=0.017
max324.733-324.742=-0.008
mean2839.000-2428.000=411.000
σ0.000
min2839.000-2428.000=411.000
max2839.000-2428.000=411.000
mean0.426-0.423=0.003
σ0.002-0.028=-0.026
min0.424-0.374=0.050
max0.429-0.445=-0.016
iters=5
new-facts=1
prior-facts=6402
mean1985.261-1985.264=-0.003
σ0.011-0.016=-0.004
min1985.247-1985.237=0.010
max1985.274-1985.279=-0.005
mean2839.000-2428.000=411.000
σ0.000
min2839.000-2428.000=411.000
max2839.000-2428.000=411.000
mean2.712-2.753=-0.041
σ0.081-0.164=-0.083
min2.567-2.571=-0.005
max2.757-2.907=-0.150
iters=5
new-facts=6402
prior-facts=1
mean4809.018-4808.932=0.086
σ7.708-7.732=-0.024
min4805.538-4804.954=0.583
max4822.805-4822.752=0.053
mean2839.000-2428.000=411.000
σ0.000
min2839.000-2428.000=411.000
max2839.000-2428.000=411.000
mean8.925-8.686=0.239
σ0.208-0.488=-0.281
min8.645-7.817=0.828
max9.180-8.977=0.203
iters=5
new-facts=6402
prior-facts=6402
mean4996.569-4996.488=0.081
σ0.027-0.145=-0.118
min4996.533-4996.232=0.301
max4996.605-4996.581=0.024
mean3086.800-2938.800=148.000
σ256.656-449.499=-192.844
min2839.000-2428.000=411.000
max3351.000-3540.000=-189.000
mean8.809-8.614=0.195
σ0.246-0.140=0.106
min8.512-8.486=0.025
max9.108-8.810=0.298

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.938-1.730=-0.792
σ0.013-0.184=-0.171
min0.929-1.409=-0.480
max0.961-1.865=-0.904

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.213-463.203=0.010
σ574.764-574.761=0.003
min175.823-175.819=0.004
max1325.359-1325.345=0.014
mean86.250
σ8.500
min82.000
max99.000
mean2839.000-2428.000=411.000
σ0.000
min2839.000-2428.000=411.000
max2839.000-2428.000=411.000
mean0.412-0.548=-0.136
σ0.265-0.548=-0.284
min0.269-0.272=-0.003
max0.809-1.370=-0.562
policies=20
mean1758.593-1758.511=0.082
σ0.369-0.346=0.023
min1758.362-1758.268=0.093
max1759.143-1759.021=0.122
mean820.000
σ0.000
min820.000
max820.000
mean2839.000-2428.000=411.000
σ0.000
min2839.000-2428.000=411.000
max2839.000-2428.000=411.000
mean2.824-2.722=0.102
σ0.019-0.022=-0.003
min2.811-2.699=0.112
max2.852-2.741=0.111
policies=200
mean17592.517-17592.579=-0.063
σ0.566-0.516=0.050
min17592.177-17592.261=-0.085
max17593.361-17593.347=0.014
mean8200.000
σ0.000
min8200.000
max8200.000
mean2839.000-2428.000=411.000
σ0.000
min2839.000-2428.000=411.000
max2839.000-2428.000=411.000
mean28.056-27.583=0.474
σ0.364-0.130=0.234
min27.639-27.437=0.202
max28.483-27.726=0.757