Compare commits

Home / Compare 53f8cad8 .. a2568713

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.708-70.703=0.005
σ0.047-0.049=-0.002
min70.681-70.669=0.012
max70.838-70.837=0.001
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.162-0.161=0.001
σ0.003-0.004=-0.000
min0.159-0.157=0.002
max0.167-0.168=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.412-21.408=0.004
σ0.002-0.002=0.000
min21.409-21.404=0.005
max21.416-21.411=0.005
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.065-0.061=0.004
σ0.003-0.004=-0.001
min0.063-0.059=0.005
max0.072-0.070=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.931-1754.930=0.001
σ0.360-0.359=0.000
min1754.358-1754.364=-0.006
max1755.516-1755.513=0.003
mean1662.800-1665.300=-2.500
σ620.652-624.888=-4.236
min623.000-624.000=-1.000
max2505.000-2521.000=-16.000
mean2.821-2.795=0.025
σ0.138-0.161=-0.023
min2.510-2.278=0.232
max3.113-3.022=0.091

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.755-272.756=-0.001
σ0.005-0.010=-0.005
min272.749-272.741=0.008
max272.763-272.764=-0.001
mean2505.000-2521.000=-16.000
σ0.000
min2505.000-2521.000=-16.000
max2505.000-2521.000=-16.000
mean0.382-0.382=-0.000
σ0.007-0.008=-0.001
min0.377-0.377=0.000
max0.394-0.397=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1933.167-1933.167=-0.000
σ0.007-0.006=0.001
min1933.156-1933.157=-0.001
max1933.175-1933.174=0.001
mean2505.000-2521.000=-16.000
σ0.000
min2505.000-2521.000=-16.000
max2505.000-2521.000=-16.000
mean2.962-3.056=-0.094
σ0.057-0.077=-0.020
min2.890-2.939=-0.049
max3.041-3.128=-0.087
iters=5
new-facts=6402
prior-facts=1
mean4756.938-4756.989=-0.051
σ7.559-7.631=-0.072
min4753.416-4753.381=0.034
max4770.460-4770.638=-0.178
mean2505.000-2521.000=-16.000
σ0.000
min2505.000-2521.000=-16.000
max2505.000-2521.000=-16.000
mean8.541-8.243=0.298
σ0.297-0.574=-0.277
min8.290-7.782=0.508
max9.033-9.125=-0.092
iters=5
new-facts=6402
prior-facts=6402
mean4944.386-4944.330=0.056
σ0.020-0.160=-0.140
min4944.363-4944.045=0.318
max4944.415-4944.420=-0.005
mean2918.000-2951.000=-33.000
σ364.704-368.212=-3.508
min2505.000-2521.000=-16.000
max3413.000-3453.000=-40.000
mean8.459-8.616=-0.157
σ0.158-0.195=-0.037
min8.315-8.398=-0.083
max8.647-8.875=-0.228

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.604-1.694=-0.090
σ0.226-0.110=0.116
min1.233-1.515=-0.282
max1.787-1.790=-0.004

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.319-468.320=-0.001
σ574.255-574.256=-0.001
min181.187-181.189=-0.002
max1329.702-1329.705=-0.003
mean88.250
σ8.500
min84.000
max101.000
mean2505.000-2521.000=-16.000
σ0.000
min2505.000-2521.000=-16.000
max2505.000-2521.000=-16.000
mean0.548-0.580=-0.032
σ0.522-0.591=-0.069
min0.284-0.283=0.001
max1.330-1.466=-0.136
policies=20
mean1812.185-1812.179=0.006
σ0.383-0.381=0.002
min1811.927-1811.932=-0.005
max1812.751-1812.744=0.006
mean840.000
σ0.000
min840.000
max840.000
mean2505.000-2521.000=-16.000
σ0.000
min2505.000-2521.000=-16.000
max2505.000-2521.000=-16.000
mean2.820-2.818=0.002
σ0.005-0.012=-0.008
min2.814-2.807=0.007
max2.825-2.836=-0.011
policies=200
mean18129.141-18129.006=0.136
σ0.402-0.361=0.042
min18128.853-18128.721=0.132
max18129.734-18129.533=0.201
mean8400.000
σ0.000
min8400.000
max8400.000
mean2505.000-2521.000=-16.000
σ0.000
min2505.000-2521.000=-16.000
max2505.000-2521.000=-16.000
mean28.359-28.391=-0.031
σ0.064-0.063=0.001
min28.307-28.319=-0.012
max28.436-28.459=-0.023