Compare commits

Home / Compare e175c523 .. 32492fea

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.379-70.379=0.000
σ0.049-0.048=0.001
min70.352-70.344=0.008
max70.516-70.512=0.004
mean415.000
σ0.000
min415.000
max415.000
mean0.153-0.154=-0.001
σ0.003-0.016=-0.013
min0.150-0.110=0.039
max0.159-0.165=-0.006
cache=y
dps=1
iters=10
policies=100
mean21.144-21.143=0.000
σ0.001-0.003=-0.002
min21.141-21.140=0.000
max21.145-21.149=-0.004
mean415.000
σ0.000
min415.000
max415.000
mean0.064-0.063=0.002
σ0.003-0.003=-0.000
min0.063-0.058=0.005
max0.071-0.067=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.387-1752.387=-0.000
σ0.360-0.359=0.000
min1751.820-1751.817=0.003
max1752.952-1752.950=0.003
mean1654.500-1635.350=19.150
σ645.332-609.350=35.982
min632.000-633.000=-1.000
max2850.000-2454.000=396.000
mean2.815-2.808=0.007
σ0.162-0.164=-0.002
min2.299-2.301=-0.001
max3.075-3.035=0.040

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.127-270.130=-0.003
σ0.001-0.004=-0.002
min270.126-270.126=-0.001
max270.129-270.137=-0.008
mean2850.000-2454.000=396.000
σ0.000
min2850.000-2454.000=396.000
max2850.000-2454.000=396.000
mean0.373-0.378=-0.005
σ0.004-0.001=0.003
min0.370-0.377=-0.007
max0.379-0.380=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1930.584-1930.591=-0.007
σ0.019-0.018=0.001
min1930.563-1930.571=-0.008
max1930.608-1930.611=-0.004
mean2850.000-2454.000=396.000
σ0.000
min2850.000-2454.000=396.000
max2850.000-2454.000=396.000
mean2.544-2.496=0.048
σ0.116-0.050=0.066
min2.451-2.452=-0.001
max2.738-2.573=0.165
iters=5
new-facts=6402
prior-facts=1
mean4751.129-4750.779=0.350
σ0.783-0.707=0.076
min4750.652-4750.189=0.463
max4752.520-4751.946=0.575
mean2850.000-2454.000=396.000
σ0.000
min2850.000-2454.000=396.000
max2850.000-2454.000=396.000
mean8.092-8.113=-0.021
σ0.382-0.463=-0.081
min7.650-7.574=0.076
max8.476-8.652=-0.176
iters=5
new-facts=6402
prior-facts=6402
mean4941.456-4941.529=-0.074
σ0.201-0.090=0.111
min4941.120-4941.455=-0.335
max4941.619-4941.635=-0.015
mean3060.600-3014.800=45.800
σ270.281-259.761=10.520
min2850.000-2629.000=221.000
max3475.000-3323.000=152.000
mean8.374-8.534=-0.160
σ0.132-0.225=-0.093
min8.256-8.269=-0.013
max8.586-8.803=-0.217

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.077-1.789=-0.712
σ0.113-0.144=-0.031
min0.936-1.607=-0.671
max1.254-2.001=-0.748

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.363-466.356=0.007
σ575.922-575.924=-0.002
min178.386-178.391=-0.005
max1330.246-1330.242=0.005
mean84.000
σ8.000
min80.000
max96.000
mean2850.000-2454.000=396.000
σ0.000
min2850.000-2454.000=396.000
max2850.000-2454.000=396.000
mean0.441-0.559=-0.119
σ0.310-0.555=-0.245
min0.284-0.281=0.003
max0.906-1.391=-0.486
policies=20
mean1784.247-1784.198=0.050
σ0.359-0.356=0.003
min1784.006-1783.973=0.033
max1784.778-1784.728=0.050
mean800.000
σ0.000
min800.000
max800.000
mean2850.000-2454.000=396.000
σ0.000
min2850.000-2454.000=396.000
max2850.000-2454.000=396.000
mean2.852-2.772=0.080
σ0.022-0.024=-0.002
min2.835-2.742=0.094
max2.882-2.800=0.082
policies=200
mean17848.931-17848.842=0.089
σ0.492-0.498=-0.007
min17848.615-17848.438=0.177
max17849.665-17849.568=0.096
mean8000.000
σ0.000
min8000.000
max8000.000
mean2850.000-2454.000=396.000
σ0.000
min2850.000-2454.000=396.000
max2850.000-2454.000=396.000
mean28.324-27.967=0.357
σ0.487-0.142=0.345
min27.733-27.837=-0.104
max28.729-28.169=0.559