Compare commits

Home / Compare 17a2a48c .. 9936543e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.014-54.014=0.000
σ0.368-0.371=-0.003
min53.866-53.873=-0.007
max55.060-55.069=-0.009
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.138-0.138=-0.000
σ0.004-0.003=0.001
min0.135-0.135=-0.001
max0.144-0.144=-0.000
cache=y
dps=1
iters=10
policies=100
mean43.321-43.321=0.000
σ0.006-0.007=-0.001
min43.313-43.308=0.005
max43.334-43.336=-0.001
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.122-0.117=0.005
σ0.004-0.004=-0.000
min0.118-0.112=0.005
max0.130-0.125=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.309-1011.001=-4.691
σ1.182-1.165=0.018
min1005.765-1010.432=-4.667
max1011.267-1015.880=-4.613
mean1051.150-1043.900=7.250
σ303.691-292.674=11.017
min586.000-593.000=-7.000
max1640.000-1426.000=214.000
mean1.561-1.555=0.005
σ0.103-0.086=0.017
min1.471-1.452=0.019
max1.820-1.741=0.079

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1640.000
σ0.000
min1640.000
max1640.000
mean0.423
σ0.140
min0.330
max0.670
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1640.000
σ0.000
min1640.000
max1640.000
mean0.916
σ0.102
min0.832
max1.090
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1640.000
σ0.000
min1640.000
max1640.000
mean0.551
σ0.056
min0.493
max0.625
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1640.000
σ0.000
min1640.000
max1640.000
mean0.870
σ0.062
min0.827
max0.979

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.113
σ0.031
min964.088
max964.164
mean1640.000
σ0.000
min1640.000
max1640.000
mean0.811
σ0.030
min0.783
max0.858
name=cdr_enhanced_4k_loc.art
mean884.711
σ0.007
min884.705
max884.721
mean1640.000
σ0.000
min1640.000
max1640.000
mean0.710
σ0.040
min0.642
max0.739

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715
σ0.002
min7.714
max7.718
mean1640.000
σ0.000
min1640.000
max1640.000
mean4.214
σ0.081
min4.094
max4.663
name=record_render_large_syntax_err.art
mean7.663
σ0.002
min7.662
max7.669
mean1640.000
σ0.000
min1640.000
max1640.000
mean4.196
σ0.060
min4.094
max4.476
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1640.000
σ0.000
min1640.000
max1640.000
mean0.753
σ0.044
min0.714
max1.062
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1640.000
σ0.000
min1640.000
max1640.000
mean0.705
σ0.022
min0.671
max0.781

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.277-301.073=-4.796
σ0.279-0.179=0.100
min295.980-300.881=-4.902
max296.999-301.514=-4.516
mean1902.000-1941.000=-39.000
σ0.000
min1902.000-1941.000=-39.000
max1902.000-1941.000=-39.000
mean0.568-0.548=0.020
σ0.043-0.032=0.011
min0.512-0.503=0.008
max0.652-0.578=0.073

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.704-299.456=-14.752
σ0.027-0.038=-0.012
min284.677-299.414=-14.737
max284.735-299.505=-14.770
mean1640.000-1426.000=214.000
σ0.000
min1640.000-1426.000=214.000
max1640.000-1426.000=214.000
mean0.392-0.389=0.003
σ0.007-0.008=-0.001
min0.384-0.384=-0.000
max0.403-0.403=0.000
iters=5
new-facts=1
prior-facts=6402
mean1295.077-1309.877=-14.801
σ0.105-0.087=0.018
min1294.960-1309.766=-14.806
max1295.206-1309.999=-14.792
mean1640.000-1426.000=214.000
σ0.000
min1640.000-1426.000=214.000
max1640.000-1426.000=214.000
mean1.917-1.914=0.003
σ0.104-0.069=0.035
min1.808-1.808=-0.000
max2.037-2.000=0.037
iters=5
new-facts=6402
prior-facts=1
mean1539.184-1553.969=-14.785
σ6.828-6.863=-0.035
min1535.950-1550.653=-14.703
max1551.395-1566.239=-14.845
mean1640.000-1426.000=214.000
σ0.000
min1640.000-1426.000=214.000
max1640.000-1426.000=214.000
mean2.213-2.279=-0.066
σ0.180-0.207=-0.027
min2.058-2.043=0.015
max2.489-2.542=-0.053
iters=5
new-facts=6402
prior-facts=6402
mean1856.989-1871.763=-14.774
σ0.059-0.044=0.014
min1856.932-1871.709=-14.778
max1857.076-1871.801=-14.725
mean1773.200-1721.400=51.800
σ128.550-159.500=-30.950
min1640.000-1524.000=116.000
max1902.000-1941.000=-39.000
mean3.045-2.911=0.135
σ0.272-0.068=0.203
min2.827-2.831=-0.004
max3.502-2.982=0.520

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.197-1.699=-0.501
σ0.289-0.178=0.111
min0.927-1.389=-0.462
max1.672-1.846=-0.174

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.784-447.793=-0.010
σ581.212-581.214=-0.002
min157.176-157.183=-0.007
max1319.602-1319.615=-0.012
mean96.250
σ8.500
min92.000
max109.000
mean1640.000-1426.000=214.000
σ0.000
min1640.000-1426.000=214.000
max1640.000-1426.000=214.000
mean0.535-0.534=0.001
σ0.553-0.535=0.018
min0.257-0.260=-0.003
max1.364-1.337=0.027
policies=20
mean1572.089-1572.115=-0.026
σ0.363-0.343=0.019
min1571.841-1571.901=-0.059
max1572.628-1572.628=0.000
mean920.000
σ0.000
min920.000
max920.000
mean1640.000-1426.000=214.000
σ0.000
min1640.000-1426.000=214.000
max1640.000-1426.000=214.000
mean2.628-2.633=-0.005
σ0.024-0.011=0.013
min2.599-2.623=-0.024
max2.658-2.648=0.009
policies=200
mean15729.009-15728.940=0.069
σ0.167-0.144=0.024
min15728.823-15728.769=0.054
max15729.208-15729.077=0.132
mean9200.000
σ0.000
min9200.000
max9200.000
mean1640.000-1426.000=214.000
σ0.000
min1640.000-1426.000=214.000
max1640.000-1426.000=214.000
mean26.496-26.686=-0.190
σ0.130-0.377=-0.246
min26.402-26.394=0.009
max26.688-27.228=-0.539