Compare commits

Home / Compare 89eb1237 .. 22373103

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.056-54.055=0.001
σ0.369-0.371=-0.003
min53.922-53.907=0.015
max55.106-55.112=-0.006
mean418.000-415.000=3.000
σ0.000
min418.000-415.000=3.000
max418.000-415.000=3.000
mean0.141-0.141=0.001
σ0.007-0.004=0.003
min0.133-0.138=-0.005
max0.156-0.148=0.009
cache=y
dps=1
iters=10
policies=100
mean43.394-43.394=0.000
σ0.006-0.006=-0.000
min43.385-43.386=-0.001
max43.401-43.406=-0.005
mean418.000-415.000=3.000
σ0.000
min418.000-415.000=3.000
max418.000-415.000=3.000
mean0.122-0.122=-0.000
σ0.003-0.003=0.000
min0.119-0.118=0.001
max0.128-0.129=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.980-1007.004=-0.023
σ0.870-1.209=-0.339
min1006.481-1006.435=0.046
max1010.582-1012.074=-1.491
mean1048.250-1050.400=-2.150
σ311.486-308.002=3.484
min577.000-576.000=1.000
max1650.000-1643.000=7.000
mean1.542-1.567=-0.026
σ0.096-0.081=0.016
min1.460-1.426=0.034
max1.791-1.826=-0.035

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.884-0.883=0.000
σ0.002-0.003=-0.000
min0.882
max0.887
mean1650.000-1643.000=7.000
σ0.000
min1650.000-1643.000=7.000
max1650.000-1643.000=7.000
mean0.445-0.414=0.031
σ0.181-0.134=0.047
min0.346-0.330=0.016
max0.767-0.652=0.115
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1650.000-1643.000=7.000
σ0.000
min1650.000-1643.000=7.000
max1650.000-1643.000=7.000
mean0.921-0.876=0.045
σ0.155-0.100=0.055
min0.830-0.786=0.044
max1.197-1.046=0.150
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1650.000-1643.000=7.000
σ0.000
min1650.000-1643.000=7.000
max1650.000-1643.000=7.000
mean0.529-0.555=-0.025
σ0.046-0.054=-0.008
min0.494-0.505=-0.011
max0.607-0.632=-0.025
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1650.000-1643.000=7.000
σ0.000
min1650.000-1643.000=7.000
max1650.000-1643.000=7.000
mean0.839-0.848=-0.009
σ0.038-0.065=-0.027
min0.802-0.802=0.001
max0.902-0.959=-0.057

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.835-964.837=-0.003
σ0.030-0.031=-0.001
min964.811-964.810=0.001
max964.886-964.888=-0.002
mean1650.000-1643.000=7.000
σ0.000
min1650.000-1643.000=7.000
max1650.000-1643.000=7.000
mean0.785-0.824=-0.039
σ0.058-0.046=0.012
min0.708-0.745=-0.037
max0.864-0.855=0.009
name=cdr_enhanced_4k_loc.art
mean885.514-885.512=0.002
σ0.009-0.007=0.002
min885.504-885.505=-0.001
max885.525-885.523=0.002
mean1650.000-1643.000=7.000
σ0.000
min1650.000-1643.000=7.000
max1650.000-1643.000=7.000
mean0.710-0.715=-0.005
σ0.064-0.034=0.030
min0.598-0.662=-0.064
max0.755-0.744=0.011

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.719-7.720=-0.001
mean1650.000-1643.000=7.000
σ0.000
min1650.000-1643.000=7.000
max1650.000-1643.000=7.000
mean4.224-4.214=0.010
σ0.070-0.076=-0.006
min4.093-4.106=-0.013
max4.591-4.562=0.029
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=0.000
min7.664
max7.668
mean1650.000-1643.000=7.000
σ0.000
min1650.000-1643.000=7.000
max1650.000-1643.000=7.000
mean4.231-4.175=0.056
σ0.069-0.070=-0.001
min4.106-4.055=0.051
max4.511-4.500=0.011
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1650.000-1643.000=7.000
σ0.000
min1650.000-1643.000=7.000
max1650.000-1643.000=7.000
mean0.742-0.730=0.011
σ0.025-0.016=0.009
min0.575-0.696=-0.120
max0.859-0.843=0.017
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1650.000-1643.000=7.000
σ0.000
min1650.000-1643.000=7.000
max1650.000-1643.000=7.000
mean0.704-0.693=0.011
σ0.015-0.012=0.002
min0.676-0.660=0.016
max0.802-0.748=0.054

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.572-296.842=-1.270
σ0.240-0.247=-0.006
min295.411-296.656=-1.246
max296.235-297.484=-1.249
mean2031.000-1900.000=131.000
σ0.000
min2031.000-1900.000=131.000
max2031.000-1900.000=131.000
mean0.545-0.565=-0.019
σ0.029-0.033=-0.004
min0.505-0.517=-0.011
max0.574-0.602=-0.028

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.409-286.822=-1.414
σ0.031-0.039=-0.008
min285.375-286.772=-1.397
max285.442-286.862=-1.420
mean1650.000-1643.000=7.000
σ0.000
min1650.000-1643.000=7.000
max1650.000-1643.000=7.000
mean0.386-0.397=-0.011
σ0.007-0.007=0.000
min0.380-0.389=-0.009
max0.398-0.403=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1295.807-1297.271=-1.464
σ0.111-0.085=0.027
min1295.682-1297.185=-1.503
max1295.951-1297.389=-1.439
mean1650.000-1643.000=7.000
σ0.000
min1650.000-1643.000=7.000
max1650.000-1643.000=7.000
mean1.893-2.172=-0.279
σ0.089-0.078=0.011
min1.805-2.089=-0.284
max2.023-2.265=-0.241
iters=5
new-facts=6402
prior-facts=1
mean1539.915-1541.334=-1.418
σ6.882-6.819=0.063
min1536.608-1538.118=-1.510
max1552.221-1553.530=-1.308
mean1650.000-1643.000=7.000
σ0.000
min1650.000-1643.000=7.000
max1650.000-1643.000=7.000
mean2.297-2.211=0.086
σ0.235-0.085=0.150
min2.037-2.096=-0.059
max2.587-2.313=0.274
iters=5
new-facts=6402
prior-facts=6402
mean1857.710-1859.115=-1.404
σ0.048-0.067=-0.019
min1857.660-1859.023=-1.363
max1857.768-1859.196=-1.428
mean1789.200-1769.400=19.800
σ165.069-125.373=39.696
min1650.000-1643.000=7.000
max2031.000-1900.000=131.000
mean3.037-3.104=-0.067
σ0.252-0.294=-0.043
min2.839-2.833=0.006
max3.461-3.583=-0.121

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.305-1.228=0.077
σ0.216-0.341=-0.125
min1.107-0.944=0.163
max1.628-1.804=-0.176

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.740-448.821=-3.081
σ580.934-581.371=-0.436
min155.270-158.135=-2.865
max1317.142-1320.877=-3.735
mean96.250
σ8.500
min92.000
max109.000
mean1650.000-1643.000=7.000
σ0.000
min1650.000-1643.000=7.000
max1650.000-1643.000=7.000
mean0.524-0.562=-0.038
σ0.537-0.593=-0.056
min0.254-0.265=-0.011
max1.330-1.452=-0.122
policies=20
mean1552.987-1581.637=-28.651
σ0.328-0.373=-0.045
min1552.761-1581.391=-28.630
max1553.474-1582.193=-28.719
mean920.000
σ0.000
min920.000
max920.000
mean1650.000-1643.000=7.000
σ0.000
min1650.000-1643.000=7.000
max1650.000-1643.000=7.000
mean2.587-2.660=-0.074
σ0.015-0.021=-0.006
min2.572-2.643=-0.071
max2.606-2.687=-0.082
policies=200
mean15537.993-15824.088=-286.095
σ0.070-0.077=-0.006
min15537.897-15823.984=-286.087
max15538.064-15824.167=-286.103
mean9200.000
σ0.000
min9200.000
max9200.000
mean1650.000-1643.000=7.000
σ0.000
min1650.000-1643.000=7.000
max1650.000-1643.000=7.000
mean26.155-26.831=-0.676
σ0.190-0.063=0.127
min26.021-26.748=-0.726
max26.433-26.901=-0.468