Compare commits

Home / Compare fc9092f9 .. 2f7a3968

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.707-70.702=0.004
σ0.047-0.045=0.002
min70.673-70.674=-0.001
max70.837-70.827=0.010
mean412.600-417.200=-4.600
σ0.516-0.422=0.095
min412.000-417.000=-5.000
max413.000-418.000=-5.000
mean0.160-0.160=-0.001
σ0.006-0.004=0.002
min0.149-0.152=-0.003
max0.169-0.166=0.004
cache=y
dps=1
iters=10
policies=100
mean21.412-21.409=0.004
σ0.002-0.003=-0.001
min21.409-21.404=0.005
max21.415-21.413=0.002
mean413.000-418.000=-5.000
σ0.000
min413.000-418.000=-5.000
max413.000-418.000=-5.000
mean0.063-0.065=-0.002
σ0.004-0.003=0.001
min0.059-0.064=-0.005
max0.070-0.073=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.935-1754.928=0.006
σ0.360-0.360=-0.001
min1754.369-1754.355=0.014
max1755.519-1755.516=0.003
mean1645.600-1642.350=3.250
σ631.817-615.711=16.106
min622.000-627.000=-5.000
max2769.000-2480.000=289.000
mean2.893-2.775=0.118
σ0.148-0.189=-0.041
min2.515-2.268=0.247
max3.226-2.985=0.240

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.793-272.757=0.036
σ0.007-0.002=0.005
min272.782-272.755=0.027
max272.800-272.760=0.040
mean2769.000-2480.000=289.000
σ0.000
min2769.000-2480.000=289.000
max2769.000-2480.000=289.000
mean0.378-0.381=-0.003
σ0.001-0.007=-0.006
min0.377-0.377=-0.001
max0.380-0.394=-0.013
iters=5
new-facts=1
prior-facts=6402
mean1933.223-1933.160=0.063
σ0.019-0.009=0.010
min1933.200-1933.151=0.049
max1933.242-1933.172=0.070
mean2769.000-2480.000=289.000
σ0.000
min2769.000-2480.000=289.000
max2769.000-2480.000=289.000
mean3.294-2.930=0.364
σ0.328-0.126=0.202
min3.019-2.724=0.295
max3.689-3.034=0.655
iters=5
new-facts=6402
prior-facts=1
mean4756.841-4756.736=0.104
σ7.637-7.380=0.256
min4753.011-4753.116=-0.105
max4770.493-4769.934=0.559
mean2769.000-2480.000=289.000
σ0.000
min2769.000-2480.000=289.000
max2769.000-2480.000=289.000
mean8.846-8.586=0.260
σ0.356-0.311=0.045
min8.504-8.246=0.258
max9.419-8.971=0.448
iters=5
new-facts=6402
prior-facts=6402
mean4944.452-4944.251=0.201
σ0.019-0.322=-0.303
min4944.433-4943.675=0.758
max4944.477-4944.403=0.074
mean2995.200-2921.200=74.000
σ279.358-385.873=-106.515
min2769.000-2480.000=289.000
max3416.000-3461.000=-45.000
mean8.400-8.432=-0.032
σ0.038-0.056=-0.018
min8.344-8.382=-0.038
max8.450-8.514=-0.065

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.028-1.673=-0.645
σ0.132-0.136=-0.004
min0.910-1.478=-0.568
max1.232-1.804=-0.572

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.331-468.321=0.011
σ574.227-574.256=-0.030
min181.208-181.186=0.023
max1329.671-1329.705=-0.034
mean88.250
σ8.500
min84.000
max101.000
mean2769.000-2480.000=289.000
σ0.000
min2769.000-2480.000=289.000
max2769.000-2480.000=289.000
mean0.445-0.565=-0.120
σ0.302-0.562=-0.260
min0.293-0.282=0.011
max0.897-1.408=-0.510
policies=20
mean1812.385-1812.171=0.214
σ0.390-0.378=0.012
min1812.112-1811.923=0.189
max1812.958-1812.731=0.227
mean840.000
σ0.000
min840.000
max840.000
mean2769.000-2480.000=289.000
σ0.000
min2769.000-2480.000=289.000
max2769.000-2480.000=289.000
mean2.892-2.823=0.069
σ0.004-0.012=-0.008
min2.887-2.811=0.077
max2.896-2.840=0.056
policies=200
mean18129.063-18129.078=-0.015
σ0.583-0.461=0.122
min18128.619-18128.793=-0.175
max18129.921-18129.763=0.157
mean8400.000
σ0.000
min8400.000
max8400.000
mean2769.000-2480.000=289.000
σ0.000
min2769.000-2480.000=289.000
max2769.000-2480.000=289.000
mean28.527-28.369=0.159
σ0.181-0.101=0.080
min28.286-28.263=0.023
max28.707-28.470=0.237