Compare commits

Home / Compare 80334b7e .. d47c069e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.014-53.837=0.177
σ0.372-0.367=0.004
min53.870-53.696=0.174
max55.071-54.882=0.189
mean416.000
σ0.000
min416.000
max416.000
mean0.139-0.139=0.001
σ0.004-0.003=0.001
min0.135-0.135=0.000
max0.146-0.144=0.002
cache=y
dps=1
iters=10
policies=100
mean43.323-43.208=0.115
σ0.007-0.007=-0.000
min43.311-43.197=0.113
max43.337-43.222=0.115
mean416.000
σ0.000
min416.000
max416.000
mean0.122-0.123=-0.001
σ0.004-0.004=-0.000
min0.118-0.120=-0.001
max0.128-0.129=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.305-1016.202=-9.897
σ1.171-1.189=-0.018
min1005.767-1015.652=-9.885
max1011.211-1021.187=-9.976
mean1048.750-1052.000=-3.250
σ313.963-298.419=15.543
min597.000-578.000=19.000
max1644.000-1451.000=193.000
mean1.563-1.545=0.019
σ0.077-0.053=0.024
min1.484-1.492=-0.008
max1.783-1.700=0.083

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1644.000
σ0.000
min1644.000
max1644.000
mean0.420
σ0.164
min0.320
max0.710
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1644.000
σ0.000
min1644.000
max1644.000
mean0.908
σ0.146
min0.813
max1.163
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.527
mean1644.000
σ0.000
min1644.000
max1644.000
mean0.551
σ0.047
min0.518
max0.628
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.364
mean1644.000
σ0.000
min1644.000
max1644.000
mean0.845
σ0.036
min0.806
max0.902

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.111
σ0.022
min964.091
max964.146
mean1644.000
σ0.000
min1644.000
max1644.000
mean0.815
σ0.027
min0.770
max0.840
name=cdr_enhanced_4k_loc.art
mean884.713
σ0.001
min884.712
max884.714
mean1644.000
σ0.000
min1644.000
max1644.000
mean0.699
σ0.035
min0.653
max0.734

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.714
σ0.002
min7.714
max7.718
mean1644.000
σ0.000
min1644.000
max1644.000
mean3.459
σ0.084
min3.319
max3.748
name=record_render_large_syntax_err.art
mean7.663
σ0.002
min7.662
max7.668
mean1644.000
σ0.000
min1644.000
max1644.000
mean3.456
σ0.072
min3.340
max3.772
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1644.000
σ0.000
min1644.000
max1644.000
mean0.737
σ0.018
min0.644
max0.826
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1644.000
σ0.000
min1644.000
max1644.000
mean0.699
σ0.015
min0.669
max0.770

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.210-301.331=-5.121
σ0.186-0.266=-0.080
min295.991-301.122=-5.131
max296.664-302.050=-5.386
mean1901.000-2027.000=-126.000
σ0.000
min1901.000-2027.000=-126.000
max1901.000-2027.000=-126.000
mean0.586-0.560=0.025
σ0.031-0.034=-0.003
min0.541-0.504=0.036
max0.641-0.601=0.040

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.693-301.477=-16.785
σ0.035-0.061=-0.026
min284.650-301.384=-16.734
max284.730-301.540=-16.810
mean1644.000-1451.000=193.000
σ0.000
min1644.000-1451.000=193.000
max1644.000-1451.000=193.000
mean0.395-0.392=0.003
σ0.009-0.005=0.004
min0.387-0.388=-0.001
max0.405-0.400=0.005
iters=5
new-facts=1
prior-facts=6402
mean1295.068-1324.070=-29.002
σ0.108-0.118=-0.010
min1294.949-1323.924=-28.976
max1295.224-1324.208=-28.984
mean1644.000-1451.000=193.000
σ0.000
min1644.000-1451.000=193.000
max1644.000-1451.000=193.000
mean1.869-1.908=-0.038
σ0.059-0.071=-0.012
min1.826-1.831=-0.005
max1.968-1.973=-0.005
iters=5
new-facts=6402
prior-facts=1
mean1539.220-1562.085=-22.865
σ6.868-6.954=-0.086
min1535.961-1558.741=-22.780
max1551.504-1574.519=-23.015
mean1644.000-1451.000=193.000
σ0.000
min1644.000-1451.000=193.000
max1644.000-1451.000=193.000
mean2.146-2.313=-0.167
σ0.129-0.299=-0.169
min2.014-2.027=-0.013
max2.349-2.790=-0.441
iters=5
new-facts=6402
prior-facts=6402
mean1856.981-1891.968=-34.988
σ0.064-0.064=0.000
min1856.899-1891.859=-34.960
max1857.065-1892.011=-34.947
mean1771.200-1723.400=47.800
σ124.502-234.628=-110.126
min1644.000-1451.000=193.000
max1901.000-2027.000=-126.000
mean3.067-2.917=0.150
σ0.264-0.105=0.160
min2.846-2.858=-0.012
max3.514-3.103=0.411

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.134-1.558=-0.424
σ0.247-0.126=0.122
min0.933-1.371=-0.438
max1.507-1.714=-0.207

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.931-444.041=3.889
σ581.505-575.351=6.154
min157.176-156.360=0.816
max1320.188-1307.068=13.120
mean96.250
σ8.500
min92.000
max109.000
mean1644.000-1451.000=193.000
σ0.000
min1644.000-1451.000=193.000
max1644.000-1451.000=193.000
mean0.524-0.541=-0.018
σ0.523-0.560=-0.037
min0.259-0.261=-0.002
max1.308-1.381=-0.074
policies=20
mean1572.093-1563.889=8.204
σ0.364-0.341=0.023
min1571.849-1563.660=8.189
max1572.635-1564.396=8.238
mean920.000
σ0.000
min920.000
max920.000
mean1644.000-1451.000=193.000
σ0.000
min1644.000-1451.000=193.000
max1644.000-1451.000=193.000
mean2.650-2.616=0.033
σ0.025-0.015=0.010
min2.628-2.600=0.028
max2.682-2.634=0.048
policies=200
mean15729.082-15646.948=82.134
σ0.115-0.122=-0.007
min15729.000-15646.806=82.194
max15729.249-15647.059=82.190
mean9200.000
σ0.000
min9200.000
max9200.000
mean1644.000-1451.000=193.000
σ0.000
min1644.000-1451.000=193.000
max1644.000-1451.000=193.000
mean26.579-26.519=0.060
σ0.031-0.182=-0.151
min26.552-26.312=0.241
max26.616-26.675=-0.059