Compare commits

Home / Compare 4cdeda2a .. e7116f59

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.015-54.015=-0.000
σ0.369-0.370=-0.001
min53.867-53.873=-0.005
max55.064-55.068=-0.003
mean417.000-416.000=1.000
σ0.000
min417.000-416.000=1.000
max417.000-416.000=1.000
mean0.139-0.139=0.000
σ0.003-0.004=-0.001
min0.136-0.132=0.004
max0.145-0.146=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.323-43.322=0.000
σ0.007-0.005=0.002
min43.313-43.315=-0.002
max43.335-43.333=0.002
mean417.000-416.000=1.000
σ0.000
min417.000-416.000=1.000
max417.000-416.000=1.000
mean0.124-0.121=0.003
σ0.004-0.003=0.000
min0.120-0.115=0.006
max0.129-0.129=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.305-1006.305=-0.001
σ1.198-1.181=0.017
min1005.771-1005.768=0.003
max1011.336-1011.255=0.081
mean1047.550-1046.150=1.400
σ305.266-313.448=-8.182
min587.000-597.000=-10.000
max1638.000-1644.000=-6.000
mean1.558-1.558=0.001
σ0.070-0.079=-0.008
min1.492-1.485=0.007
max1.746-1.801=-0.055

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1638.000-1644.000=-6.000
σ0.000
min1638.000-1644.000=-6.000
max1638.000-1644.000=-6.000
mean0.396-0.405=-0.008
σ0.103-0.137=-0.034
min0.337-0.320=0.017
max0.578-0.647=-0.070
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1638.000-1644.000=-6.000
σ0.000
min1638.000-1644.000=-6.000
max1638.000-1644.000=-6.000
mean0.893-0.890=0.003
σ0.086-0.086=-0.000
min0.837-0.831=0.006
max1.045-1.040=0.005
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1638.000-1644.000=-6.000
σ0.000
min1638.000-1644.000=-6.000
max1638.000-1644.000=-6.000
mean0.545-0.549=-0.004
σ0.047-0.045=0.002
min0.504-0.509=-0.005
max0.621-0.622=-0.001
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1638.000-1644.000=-6.000
σ0.000
min1638.000-1644.000=-6.000
max1638.000-1644.000=-6.000
mean0.849-0.846=0.003
σ0.036-0.032=0.004
min0.825-0.814=0.011
max0.912-0.894=0.019

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.114-964.115=-0.000
σ0.032-0.034=-0.002
min964.087-964.086=0.002
max964.167-964.170=-0.004
mean1638.000-1644.000=-6.000
σ0.000
min1638.000-1644.000=-6.000
max1638.000-1644.000=-6.000
mean0.838-0.849=-0.011
σ0.027-0.005=0.022
min0.791-0.845=-0.054
max0.858-0.857=0.001
name=cdr_enhanced_4k_loc.art
mean884.711-884.712=-0.000
σ0.007-0.008=-0.001
min884.705-884.703=0.001
max884.721-884.722=-0.001
mean1638.000-1644.000=-6.000
σ0.000
min1638.000-1644.000=-6.000
max1638.000-1644.000=-6.000
mean0.706-0.702=0.004
σ0.042-0.036=0.005
min0.663-0.663=0.001
max0.759-0.736=0.023

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=0.000
σ0.002-0.002=0.000
min7.714
max7.722-7.719=0.003
mean1638.000-1644.000=-6.000
σ0.000
min1638.000-1644.000=-6.000
max1638.000-1644.000=-6.000
mean4.246-3.505=0.741
σ0.090-0.092=-0.002
min4.117-3.351=0.766
max4.611-3.808=0.803
name=record_render_large_syntax_err.art
mean7.663
σ0.002
min7.662
max7.666
mean1638.000-1644.000=-6.000
σ0.000
min1638.000-1644.000=-6.000
max1638.000-1644.000=-6.000
mean4.244-3.784=0.460
σ0.077-0.378=-0.301
min4.132-3.298=0.834
max4.525-4.557=-0.032
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1638.000-1644.000=-6.000
σ0.000
min1638.000-1644.000=-6.000
max1638.000-1644.000=-6.000
mean0.743-0.598=0.145
σ0.027-0.106=-0.079
min0.533-0.508=0.025
max0.824-0.920=-0.096
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1638.000-1644.000=-6.000
σ0.000
min1638.000-1644.000=-6.000
max1638.000-1644.000=-6.000
mean0.698-0.496=0.202
σ0.014-0.012=0.002
min0.670-0.472=0.198
max0.784-0.563=0.221

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.273-296.288=-0.016
σ0.220-0.264=-0.044
min296.125-296.052=0.073
max296.875-296.990=-0.115
mean1907.000-1975.000=-68.000
σ0.000
min1907.000-1975.000=-68.000
max1907.000-1975.000=-68.000
mean0.597-0.579=0.018
σ0.024-0.047=-0.023
min0.563-0.510=0.052
max0.654-0.666=-0.012

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.697-284.695=0.003
σ0.035-0.031=0.004
min284.656-284.652=0.003
max284.738-284.726=0.012
mean1638.000-1644.000=-6.000
σ0.000
min1638.000-1644.000=-6.000
max1638.000-1644.000=-6.000
mean0.396-0.403=-0.006
σ0.011-0.004=0.007
min0.384-0.396=-0.012
max0.405-0.406=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1295.080-1295.055=0.025
σ0.109-0.079=0.030
min1294.961-1294.955=0.005
max1295.214-1295.135=0.079
mean1638.000-1644.000=-6.000
σ0.000
min1638.000-1644.000=-6.000
max1638.000-1644.000=-6.000
mean1.909-1.975=-0.065
σ0.083-0.278=-0.195
min1.816-1.806=0.011
max2.002-2.463=-0.462
iters=5
new-facts=6402
prior-facts=1
mean1539.190-1539.212=-0.022
σ6.865-6.866=-0.001
min1535.936-1535.918=0.018
max1551.466-1551.491=-0.025
mean1638.000-1644.000=-6.000
σ0.000
min1638.000-1644.000=-6.000
max1638.000-1644.000=-6.000
mean2.274-2.230=0.044
σ0.247-0.181=0.066
min2.027-2.105=-0.077
max2.542-2.550=-0.009
iters=5
new-facts=6402
prior-facts=6402
mean1856.991-1856.986=0.004
σ0.056-0.060=-0.003
min1856.925-1856.930=-0.005
max1857.067-1857.068=-0.001
mean1775.200-1800.400=-25.200
σ131.336-166.746=-35.410
min1638.000-1644.000=-6.000
max1907.000-1975.000=-68.000
mean3.093-2.969=0.125
σ0.423-0.112=0.311
min2.763-2.856=-0.092
max3.826-3.131=0.694

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.241-1.214=0.027
σ0.326-0.401=-0.076
min0.931-0.935=-0.004
max1.717-1.892=-0.175

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.786-447.786=-0.000
σ581.212-581.212=-0.000
min157.178-157.179=-0.001
max1319.605-1319.605=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1638.000-1644.000=-6.000
σ0.000
min1638.000-1644.000=-6.000
max1638.000-1644.000=-6.000
mean0.540-0.532=0.007
σ0.556-0.543=0.013
min0.259-0.259=-0.001
max1.374-1.347=0.027
policies=20
mean1572.088-1572.102=-0.013
σ0.342-0.352=-0.011
min1571.867-1571.864=0.002
max1572.598-1572.625=-0.027
mean920.000
σ0.000
min920.000
max920.000
mean1638.000-1644.000=-6.000
σ0.000
min1638.000-1644.000=-6.000
max1638.000-1644.000=-6.000
mean2.627-2.625=0.002
σ0.022-0.018=0.004
min2.611-2.599=0.012
max2.658-2.638=0.020
policies=200
mean15728.995-15729.056=-0.061
σ0.189-0.086=0.103
min15728.834-15728.998=-0.164
max15729.260-15729.184=0.075
mean9200.000
σ0.000
min9200.000
max9200.000
mean1638.000-1644.000=-6.000
σ0.000
min1638.000-1644.000=-6.000
max1638.000-1644.000=-6.000
mean26.452-26.553=-0.102
σ0.011-0.110=-0.099
min26.440-26.450=-0.010
max26.465-26.706=-0.241