Compare commits

Home / Compare 67c356a8 .. f237d6e6

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.055=-0.000
σ0.368-0.370=-0.002
min53.905-53.908=-0.003
max55.102-55.108=-0.006
mean416.000
σ0.000
min416.000
max416.000
mean0.142-0.143=-0.001
σ0.004-0.004=-0.000
min0.138-0.140=-0.002
max0.149-0.150=-0.000
cache=y
dps=1
iters=10
policies=100
mean43.393-43.394=-0.001
σ0.007-0.007=0.000
min43.384-43.386=-0.002
max43.407-43.408=-0.001
mean416.000
σ0.000
min416.000
max416.000
mean0.123-0.121=0.002
σ0.003-0.004=-0.001
min0.120-0.115=0.006
max0.130-0.128=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.005-1007.005=-0.000
σ1.204-1.200=0.004
min1006.433-1006.436=-0.002
max1012.052-1012.036=0.015
mean1053.200-1053.350=-0.150
σ307.708-307.827=-0.119
min578.000
max1646.000
mean1.549-1.538=0.011
σ0.106-0.083=0.022
min1.361-1.420=-0.059
max1.807-1.786=0.021

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1646.000
σ0.000
min1646.000
max1646.000
mean0.406-0.425=-0.019
σ0.138-0.133=0.005
min0.332-0.341=-0.009
max0.651-0.660=-0.009
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1646.000
σ0.000
min1646.000
max1646.000
mean0.873-0.880=-0.008
σ0.099-0.093=0.006
min0.817-0.804=0.012
max1.046-1.039=0.007
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1646.000
σ0.000
min1646.000
max1646.000
mean0.532-0.543=-0.011
σ0.051-0.052=-0.001
min0.493-0.507=-0.015
max0.621-0.630=-0.010
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1646.000
σ0.000
min1646.000
max1646.000
mean0.844-0.855=-0.010
σ0.037-0.036=0.001
min0.814-0.817=-0.003
max0.907-0.914=-0.006

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.840-964.839=0.001
σ0.035-0.034=0.001
min964.811-964.811=-0.000
max964.897-964.896=0.002
mean1646.000
σ0.000
min1646.000
max1646.000
mean0.826-0.826=0.001
σ0.047-0.033=0.014
min0.744-0.773=-0.029
max0.859-0.851=0.009
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=0.000
σ0.008-0.007=0.000
min885.504-885.505=-0.001
max885.522-885.522=0.000
mean1646.000
σ0.000
min1646.000
max1646.000
mean0.729-0.723=0.007
σ0.027-0.034=-0.006
min0.681-0.663=0.018
max0.746-0.740=0.006

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.721-7.720=0.001
mean1646.000
σ0.000
min1646.000
max1646.000
mean4.220-4.249=-0.028
σ0.092-0.080=0.011
min4.076-4.100=-0.023
max4.758-4.544=0.214
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1646.000
σ0.000
min1646.000
max1646.000
mean4.191-4.242=-0.051
σ0.071-0.070=0.001
min4.062-4.091=-0.029
max4.428-4.438=-0.010
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1646.000
σ0.000
min1646.000
max1646.000
mean0.743-0.746=-0.003
σ0.034-0.019=0.015
min0.704-0.709=-0.006
max0.953-0.848=0.105
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1646.000
σ0.000
min1646.000
max1646.000
mean0.691-0.705=-0.013
σ0.016-0.026=-0.010
min0.659-0.506=0.153
max0.790-0.794=-0.004

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.990-296.902=0.088
σ0.217-0.268=-0.052
min296.794-296.723=0.071
max297.533-297.646=-0.113
mean1901.000-1915.000=-14.000
σ0.000
min1901.000-1915.000=-14.000
max1901.000-1915.000=-14.000
mean0.591-0.581=0.010
σ0.039-0.047=-0.009
min0.543-0.518=0.025
max0.687-0.675=0.012

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.825-286.822=0.004
σ0.038-0.042=-0.003
min286.778-286.769=0.009
max286.865-286.867=-0.002
mean1646.000
σ0.000
min1646.000
max1646.000
mean0.397-0.396=0.001
σ0.006-0.007=-0.000
min0.389-0.388=0.000
max0.403-0.402=0.000
iters=5
new-facts=1
prior-facts=6402
mean1297.229-1297.236=-0.007
σ0.073-0.067=0.006
min1297.139-1297.169=-0.029
max1297.305-1297.328=-0.023
mean1646.000
σ0.000
min1646.000
max1646.000
mean2.072-2.100=-0.028
σ0.070-0.074=-0.003
min1.983-2.010=-0.027
max2.143-2.169=-0.026
iters=5
new-facts=6402
prior-facts=1
mean1541.317-1541.336=-0.019
σ6.836-6.817=0.019
min1538.068-1538.133=-0.065
max1553.541-1553.528=0.012
mean1646.000
σ0.000
min1646.000
max1646.000
mean2.214-2.259=-0.045
σ0.132-0.292=-0.160
min2.085-1.977=0.108
max2.371-2.738=-0.367
iters=5
new-facts=6402
prior-facts=6402
mean1859.111-1859.111=-0.000
σ0.081-0.081=0.000
min1858.988-1858.992=-0.004
max1859.189-1859.189=0.000
mean1771.600-1773.800=-2.200
σ124.160-135.332=-11.171
min1646.000
max1901.000-1915.000=-14.000
mean3.155-3.055=0.101
σ0.261-0.142=0.119
min2.896-2.850=0.046
max3.558-3.211=0.348

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.201-1.227=-0.027
σ0.364-0.351=0.013
min0.942-0.934=0.008
max1.815-1.821=-0.007

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.821-448.819=0.002
σ581.371-581.372=-0.001
min158.135-158.132=0.003
max1320.877-1320.877=0.000
mean96.250
σ8.500
min92.000
max109.000
mean1646.000
σ0.000
min1646.000
max1646.000
mean0.565-0.554=0.011
σ0.599-0.567=0.032
min0.262-0.268=-0.007
max1.464-1.405=0.059
policies=20
mean1581.629-1581.605=0.024
σ0.363-0.359=0.004
min1581.386-1581.357=0.029
max1582.168-1582.138=0.030
mean920.000
σ0.000
min920.000
max920.000
mean1646.000
σ0.000
min1646.000
max1646.000
mean2.646-2.631=0.015
σ0.013-0.022=-0.009
min2.630-2.603=0.027
max2.663-2.656=0.007
policies=200
mean15824.236-15824.068=0.168
σ0.080-0.098=-0.018
min15824.170-15823.996=0.174
max15824.351-15824.212=0.140
mean9200.000
σ0.000
min9200.000
max9200.000
mean1646.000
σ0.000
min1646.000
max1646.000
mean26.626-26.584=0.042
σ0.079-0.035=0.044
min26.554-26.550=0.004
max26.721-26.630=0.091