Compare commits

Home / Compare f42ff3e7 .. 9adfe7f4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.054-54.054=-0.001
σ0.370-0.368=0.002
min53.904-53.910=-0.006
max55.106-55.101=0.005
mean416.000-419.000=-3.000
σ0.000
min416.000-419.000=-3.000
max416.000-419.000=-3.000
mean0.138-0.141=-0.002
σ0.005-0.004=0.001
min0.132-0.135=-0.004
max0.149-0.148=0.002
cache=y
dps=1
iters=10
policies=100
mean43.393-43.393=0.000
σ0.007-0.006=0.002
min43.384-43.385=-0.002
max43.407-43.402=0.005
mean416.000-419.000=-3.000
σ0.000
min416.000-419.000=-3.000
max416.000-419.000=-3.000
mean0.123-0.122=0.001
σ0.004-0.004=-0.000
min0.118-0.116=0.002
max0.129-0.128=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.002-1007.005=-0.003
σ1.185-1.199=-0.014
min1006.433-1006.439=-0.007
max1011.971-1012.035=-0.064
mean1043.700-1055.300=-11.600
σ305.592-309.411=-3.819
min589.000-579.000=10.000
max1630.000-1653.000=-23.000
mean1.549-1.534=0.015
σ0.096-0.081=0.014
min1.454-1.452=0.001
max1.797-1.771=0.026

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1630.000-1653.000=-23.000
σ0.000
min1630.000-1653.000=-23.000
max1630.000-1653.000=-23.000
mean0.417-0.416=0.001
σ0.128-0.125=0.004
min0.350-0.342=0.007
max0.645-0.636=0.008
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1630.000-1653.000=-23.000
σ0.000
min1630.000-1653.000=-23.000
max1630.000-1653.000=-23.000
mean0.884-0.877=0.007
σ0.093-0.092=0.002
min0.822-0.820=0.002
max1.048-1.035=0.013
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1630.000-1653.000=-23.000
σ0.000
min1630.000-1653.000=-23.000
max1630.000-1653.000=-23.000
mean0.561-0.540=0.021
σ0.066-0.049=0.017
min0.495-0.504=-0.009
max0.640-0.620=0.020
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1630.000-1653.000=-23.000
σ0.000
min1630.000-1653.000=-23.000
max1630.000-1653.000=-23.000
mean0.852-0.836=0.016
σ0.045-0.047=-0.002
min0.814-0.796=0.017
max0.926-0.910=0.016

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.840-964.839=0.000
σ0.033-0.023=0.010
min964.812-964.818=-0.006
max964.894-964.876=0.018
mean1630.000-1653.000=-23.000
σ0.000
min1630.000-1653.000=-23.000
max1630.000-1653.000=-23.000
mean0.823-0.826=-0.003
σ0.033-0.038=-0.004
min0.783-0.781=0.001
max0.855-0.873=-0.018
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=0.001
σ0.007-0.007=0.000
min885.504
max885.522-885.521=0.001
mean1630.000-1653.000=-23.000
σ0.000
min1630.000-1653.000=-23.000
max1630.000-1653.000=-23.000
mean0.733-0.695=0.037
σ0.010-0.051=-0.040
min0.718-0.633=0.085
max0.743-0.742=0.001

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=0.000
min7.715
max7.721-7.720=0.000
mean1630.000-1653.000=-23.000
σ0.000
min1630.000-1653.000=-23.000
max1630.000-1653.000=-23.000
mean4.182-3.552=0.631
σ0.068-0.088=-0.020
min4.063-3.369=0.694
max4.409-3.831=0.578
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1630.000-1653.000=-23.000
σ0.000
min1630.000-1653.000=-23.000
max1630.000-1653.000=-23.000
mean4.178-3.549=0.629
σ0.123-0.070=0.053
min3.296-3.421=-0.125
max4.552-3.812=0.741
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1630.000-1653.000=-23.000
σ0.000
min1630.000-1653.000=-23.000
max1630.000-1653.000=-23.000
mean0.751-0.539=0.212
σ0.028-0.013=0.015
min0.711-0.515=0.195
max0.935-0.614=0.322
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1630.000-1653.000=-23.000
σ0.000
min1630.000-1653.000=-23.000
max1630.000-1653.000=-23.000
mean0.710-0.512=0.198
σ0.028-0.011=0.018
min0.507-0.485=0.021
max0.800-0.559=0.241

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.744-296.841=-0.097
σ0.206-0.248=-0.041
min296.614-296.661=-0.047
max297.317-297.503=-0.186
mean1956.000-1902.000=54.000
σ0.000
min1956.000-1902.000=54.000
max1956.000-1902.000=54.000
mean0.582-0.601=-0.019
σ0.038-0.032=0.006
min0.510-0.568=-0.058
max0.636-0.682=-0.046

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.819-286.824=-0.005
σ0.036-0.034=0.002
min286.769-286.782=-0.013
max286.855-286.867=-0.013
mean1630.000-1653.000=-23.000
σ0.000
min1630.000-1653.000=-23.000
max1630.000-1653.000=-23.000
mean0.395-0.401=-0.006
σ0.006-0.013=-0.007
min0.388-0.390=-0.002
max0.403-0.419=-0.016
iters=5
new-facts=1
prior-facts=6402
mean1297.253-1297.226=0.027
σ0.079-0.074=0.005
min1297.166-1297.143=0.024
max1297.343-1297.327=0.017
mean1630.000-1653.000=-23.000
σ0.000
min1630.000-1653.000=-23.000
max1630.000-1653.000=-23.000
mean2.102-2.079=0.023
σ0.077-0.065=0.012
min2.004-2.014=-0.009
max2.195-2.174=0.021
iters=5
new-facts=6402
prior-facts=1
mean1541.306-1541.396=-0.090
σ6.832-6.823=0.009
min1538.072-1538.199=-0.127
max1553.523-1553.598=-0.075
mean1630.000-1653.000=-23.000
σ0.000
min1630.000-1653.000=-23.000
max1630.000-1653.000=-23.000
mean2.162-2.397=-0.235
σ0.071-0.175=-0.104
min2.062-2.139=-0.076
max2.248-2.542=-0.294
iters=5
new-facts=6402
prior-facts=6402
mean1859.111-1859.117=-0.006
σ0.081-0.063=0.019
min1858.989-1859.040=-0.051
max1859.185-1859.193=-0.008
mean1789.400-1773.000=16.400
σ163.199-123.219=39.979
min1630.000-1653.000=-23.000
max1956.000-1902.000=54.000
mean2.996-3.080=-0.083
σ0.113-0.264=-0.151
min2.858-2.789=0.069
max3.150-3.420=-0.270

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.251-1.184=0.067
σ0.309-0.352=-0.043
min1.060-0.926=0.134
max1.785-1.763=0.022

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.821-448.820=0.001
σ581.372-581.372=0.001
min158.133-158.133=0.001
max1320.879-1320.877=0.002
mean96.250
σ8.500
min92.000
max109.000
mean1630.000-1653.000=-23.000
σ0.000
min1630.000-1653.000=-23.000
max1630.000-1653.000=-23.000
mean0.556-0.537=0.019
σ0.584-0.551=0.033
min0.261-0.259=0.001
max1.432-1.364=0.068
policies=20
mean1581.615-1581.609=0.006
σ0.355-0.357=-0.002
min1581.374-1581.369=0.005
max1582.143-1582.140=0.003
mean920.000
σ0.000
min920.000
max920.000
mean1630.000-1653.000=-23.000
σ0.000
min1630.000-1653.000=-23.000
max1630.000-1653.000=-23.000
mean2.635-2.633=0.002
σ0.014-0.013=0.001
min2.621-2.620=0.001
max2.653-2.650=0.003
policies=200
mean15824.040-15824.211=-0.172
σ0.174-0.147=0.027
min15823.871-15824.075=-0.204
max15824.283-15824.416=-0.133
mean9200.000
σ0.000
min9200.000
max9200.000
mean1630.000-1653.000=-23.000
σ0.000
min1630.000-1653.000=-23.000
max1630.000-1653.000=-23.000
mean26.609-26.600=0.009
σ0.057-0.039=0.017
min26.554-26.557=-0.003
max26.658-26.645=0.013