Compare commits

Home / Compare 813f2750 .. 8dbbc69f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.054-54.054=-0.000
σ0.370-0.371=-0.001
min53.904-53.908=-0.004
max55.106-55.108=-0.002
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.138-0.139=-0.000
σ0.005-0.006=-0.001
min0.132-0.130=0.002
max0.149-0.147=0.002
cache=y
dps=1
iters=10
policies=100
mean43.393-43.393=-0.000
σ0.007-0.006=0.001
min43.384-43.386=-0.002
max43.407-43.401=0.006
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.123-0.123=-0.000
σ0.004-0.004=0.000
min0.118-0.119=-0.001
max0.129-0.128=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.002-1007.006=-0.004
σ1.185-1.189=-0.003
min1006.433-1006.434=-0.001
max1011.971-1011.987=-0.016
mean1043.700-1055.100=-11.400
σ305.592-314.791=-9.199
min589.000-585.000=4.000
max1630.000-1618.000=12.000
mean1.549-1.530=0.019
σ0.096-0.053=0.043
min1.454-1.459=-0.006
max1.797-1.631=0.166

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1630.000-1618.000=12.000
σ0.000
min1630.000-1618.000=12.000
max1630.000-1618.000=12.000
mean0.417-0.447=-0.030
σ0.128-0.147=-0.018
min0.350-0.362=-0.012
max0.645-0.705=-0.060
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1630.000-1618.000=12.000
σ0.000
min1630.000-1618.000=12.000
max1630.000-1618.000=12.000
mean0.884-0.940=-0.056
σ0.093-0.214=-0.121
min0.822-0.827=-0.006
max1.048-1.322=-0.275
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1630.000-1618.000=12.000
σ0.000
min1630.000-1618.000=12.000
max1630.000-1618.000=12.000
mean0.561-0.554=0.007
σ0.066-0.057=0.009
min0.495-0.487=0.008
max0.640-0.615=0.025
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1630.000-1618.000=12.000
σ0.000
min1630.000-1618.000=12.000
max1630.000-1618.000=12.000
mean0.852-0.868=-0.016
σ0.045-0.039=0.007
min0.814-0.843=-0.029
max0.926-0.936=-0.010

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.840-964.840=0.000
σ0.033-0.035=-0.002
min964.812-964.810=0.002
max964.894-964.898=-0.003
mean1630.000-1618.000=12.000
σ0.000
min1630.000-1618.000=12.000
max1630.000-1618.000=12.000
mean0.823-0.810=0.013
σ0.033-0.060=-0.027
min0.783-0.727=0.055
max0.855-0.861=-0.006
name=cdr_enhanced_4k_loc.art
mean885.512-885.513=-0.000
σ0.007-0.008=-0.000
min885.504-885.506=-0.001
max885.522-885.525=-0.003
mean1630.000-1618.000=12.000
σ0.000
min1630.000-1618.000=12.000
max1630.000-1618.000=12.000
mean0.733-0.696=0.036
σ0.010-0.039=-0.028
min0.718-0.648=0.071
max0.743-0.751=-0.008

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.721-7.720=0.000
mean1630.000-1618.000=12.000
σ0.000
min1630.000-1618.000=12.000
max1630.000-1618.000=12.000
mean4.182-4.281=-0.098
σ0.068-0.080=-0.012
min4.063-4.132=-0.069
max4.409-4.671=-0.262
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1630.000-1618.000=12.000
σ0.000
min1630.000-1618.000=12.000
max1630.000-1618.000=12.000
mean4.178-4.262=-0.083
σ0.123-0.117=0.006
min3.296-4.096=-0.801
max4.552-5.012=-0.460
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1630.000-1618.000=12.000
σ0.000
min1630.000-1618.000=12.000
max1630.000-1618.000=12.000
mean0.751-0.750=0.001
σ0.028-0.017=0.011
min0.711-0.711=-0.001
max0.935-0.863=0.072
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1630.000-1618.000=12.000
σ0.000
min1630.000-1618.000=12.000
max1630.000-1618.000=12.000
mean0.710-0.703=0.007
σ0.028-0.015=0.013
min0.507-0.674=-0.167
max0.800-0.780=0.020

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.744-296.935=-0.192
σ0.206-0.246=-0.040
min296.614-296.719=-0.105
max297.317-297.559=-0.242
mean1956.000-2032.000=-76.000
σ0.000
min1956.000-2032.000=-76.000
max1956.000-2032.000=-76.000
mean0.582-0.577=0.005
σ0.038-0.020=0.018
min0.510-0.537=-0.027
max0.636-0.595=0.041

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.819-286.818=0.001
σ0.036-0.039=-0.002
min286.769-286.767=0.002
max286.855-286.858=-0.003
mean1630.000-1618.000=12.000
σ0.000
min1630.000-1618.000=12.000
max1630.000-1618.000=12.000
mean0.395-0.396=-0.001
σ0.006-0.005=0.001
min0.388-0.388=-0.000
max0.403-0.400=0.002
iters=5
new-facts=1
prior-facts=6402
mean1297.253-1297.211=0.042
σ0.079-0.121=-0.042
min1297.166-1297.088=0.078
max1297.343-1297.363=-0.020
mean1630.000-1618.000=12.000
σ0.000
min1630.000-1618.000=12.000
max1630.000-1618.000=12.000
mean2.102-1.879=0.223
σ0.077-0.094=-0.017
min2.004-1.804=0.200
max2.195-2.017=0.178
iters=5
new-facts=6402
prior-facts=1
mean1541.306-1541.335=-0.029
σ6.832-6.843=-0.011
min1538.072-1538.054=0.019
max1553.523-1553.573=-0.050
mean1630.000-1618.000=12.000
σ0.000
min1630.000-1618.000=12.000
max1630.000-1618.000=12.000
mean2.162-2.230=-0.068
σ0.071-0.156=-0.085
min2.062-2.119=-0.057
max2.248-2.489=-0.241
iters=5
new-facts=6402
prior-facts=6402
mean1859.111-1859.123=-0.012
σ0.081-0.065=0.016
min1858.989-1859.032=-0.043
max1859.185-1859.199=-0.014
mean1789.400-1763.000=26.400
σ163.199-178.827=-15.628
min1630.000-1618.000=12.000
max1956.000-2032.000=-76.000
mean2.996-2.891=0.105
σ0.113-0.145=-0.032
min2.858-2.777=0.081
max3.150-3.143=0.007

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.251-1.228=0.023
σ0.309-0.363=-0.054
min1.060-0.932=0.128
max1.785-1.843=-0.058

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.821-448.821=-0.000
σ581.372-581.372=-0.000
min158.133-158.131=0.002
max1320.879-1320.880=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1630.000-1618.000=12.000
σ0.000
min1630.000-1618.000=12.000
max1630.000-1618.000=12.000
mean0.556-0.533=0.024
σ0.584-0.538=0.046
min0.261-0.260=0.000
max1.432-1.339=0.093
policies=20
mean1581.615-1581.621=-0.006
σ0.355-0.340=0.015
min1581.374-1581.390=-0.016
max1582.143-1582.126=0.017
mean920.000
σ0.000
min920.000
max920.000
mean1630.000-1618.000=12.000
σ0.000
min1630.000-1618.000=12.000
max1630.000-1618.000=12.000
mean2.635-2.608=0.027
σ0.014-0.014=0.000
min2.621-2.591=0.030
max2.653-2.623=0.030
policies=200
mean15824.040-15824.268=-0.229
σ0.174-0.067=0.108
min15823.871-15824.218=-0.347
max15824.283-15824.366=-0.082
mean9200.000
σ0.000
min9200.000
max9200.000
mean1630.000-1618.000=12.000
σ0.000
min1630.000-1618.000=12.000
max1630.000-1618.000=12.000
mean26.609-26.573=0.036
σ0.057-0.048=0.008
min26.554-26.517=0.036
max26.658-26.630=0.028