Compare commits

Home / Compare 625b49b5 .. aedcf4f1

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.702-70.702=0.001
σ0.046-0.050=-0.004
min70.673-70.672=0.002
max70.829-70.840=-0.011
mean413.000-417.000=-4.000
σ0.000
min413.000-417.000=-4.000
max413.000-417.000=-4.000
mean0.161-0.159=0.002
σ0.003-0.005=-0.002
min0.158-0.153=0.005
max0.166-0.167=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.409-21.408=0.001
σ0.003-0.002=0.000
min21.406-21.404=0.002
max21.415-21.412=0.003
mean413.000-417.000=-4.000
σ0.000
min413.000-417.000=-4.000
max413.000-417.000=-4.000
mean0.066-0.064=0.002
σ0.003-0.003=-0.000
min0.064-0.061=0.003
max0.074-0.072=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.928-1754.932=-0.004
σ0.360-0.361=-0.001
min1754.354-1754.367=-0.013
max1755.495-1755.519=-0.024
mean1665.950-1653.450=12.500
σ625.126-626.334=-1.208
min622.000-626.000=-4.000
max2521.000-2773.000=-252.000
mean2.822-2.856=-0.034
σ0.160-0.148=0.013
min2.370-2.491=-0.121
max3.037-3.118=-0.082

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean3.815
σ0.000
min3.815
max3.815
mean2521.000-2773.000=-252.000
σ0.000
min2521.000-2773.000=-252.000
max2521.000-2773.000=-252.000
mean1.169-1.118=0.051
σ0.000
min1.169-1.118=0.051
max1.169-1.118=0.051
name=error_case.art
mean10.999-10.998=0.001
σ0.000
min10.999-10.998=0.001
max10.999-10.998=0.001
mean2521.000-2773.000=-252.000
σ0.000
min2521.000-2773.000=-252.000
max2521.000-2773.000=-252.000
mean5.830-5.415=0.416
σ0.000
min5.830-5.415=0.416
max5.830-5.415=0.416
name=heavy_item.art
mean7.432
σ0.000
min7.432
max7.432
mean2521.000-2773.000=-252.000
σ0.000
min2521.000-2773.000=-252.000
max2521.000-2773.000=-252.000
mean3.463-3.235=0.228
σ0.000
min3.463-3.235=0.228
max3.463-3.235=0.228
name=nested_use.art
mean11.074-11.073=0.002
σ0.000
min11.074-11.073=0.002
max11.074-11.073=0.002
mean2521.000-2773.000=-252.000
σ0.000
min2521.000-2773.000=-252.000
max2521.000-2773.000=-252.000
mean6.098-5.450=0.648
σ0.000
min6.098-5.450=0.648
max6.098-5.450=0.648

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean4668.605-4668.622=-0.017
σ0.000
min4668.605-4668.622=-0.017
max4668.605-4668.622=-0.017
mean2521.000-2773.000=-252.000
σ0.000
min2521.000-2773.000=-252.000
max2521.000-2773.000=-252.000
mean3.804-2.905=0.899
σ0.000
min3.804-2.905=0.899
max3.804-2.905=0.899
name=cdr_enhanced_4k_loc.art
mean4303.767-4303.829=-0.062
σ0.000
min4303.767-4303.829=-0.062
max4303.767-4303.829=-0.062
mean2521.000-2773.000=-252.000
σ0.000
min2521.000-2773.000=-252.000
max2521.000-2773.000=-252.000
mean3.364-2.501=0.863
σ0.000
min3.364-2.501=0.863
max3.364-2.501=0.863

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean752.207-752.160=0.047
σ0.000
min752.207-752.160=0.047
max752.207-752.160=0.047
mean2521.000-2773.000=-252.000
σ0.000
min2521.000-2773.000=-252.000
max2521.000-2773.000=-252.000
mean569.339-437.668=131.671
σ0.000
min569.339-437.668=131.671
max569.339-437.668=131.671
name=record_render_large_syntax_err.art
mean747.274-747.276=-0.002
σ0.000
min747.274-747.276=-0.002
max747.274-747.276=-0.002
mean2521.000-2773.000=-252.000
σ0.000
min2521.000-2773.000=-252.000
max2521.000-2773.000=-252.000
mean549.431-433.997=115.434
σ0.000
min549.431-433.997=115.434
max549.431-433.997=115.434
name=record_render_success.art
mean222.494-222.486=0.008
σ0.000
min222.494-222.486=0.008
max222.494-222.486=0.008
mean2521.000-2773.000=-252.000
σ0.000
min2521.000-2773.000=-252.000
max2521.000-2773.000=-252.000
mean137.005-120.540=16.465
σ0.000
min137.005-120.540=16.465
max137.005-120.540=16.465
name=record_render_syntax_err.art
mean210.255
σ0.000
min210.255
max210.255
mean2521.000-2773.000=-252.000
σ0.000
min2521.000-2773.000=-252.000
max2521.000-2773.000=-252.000
mean127.139-113.762=13.377
σ0.000
min127.139-113.762=13.377
max127.139-113.762=13.377

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.757-272.754=0.003
σ0.009-0.008=0.001
min272.748-272.742=0.006
max272.768-272.761=0.007
mean2521.000-2773.000=-252.000
σ0.000
min2521.000-2773.000=-252.000
max2521.000-2773.000=-252.000
mean0.378-0.376=0.002
σ0.001-0.001=-0.001
min0.377-0.375=0.002
max0.379-0.378=0.001
iters=5
new-facts=1
prior-facts=6402
mean1933.168-1933.173=-0.005
σ0.011-0.012=-0.001
min1933.156-1933.157=-0.001
max1933.179-1933.190=-0.011
mean2521.000-2773.000=-252.000
σ0.000
min2521.000-2773.000=-252.000
max2521.000-2773.000=-252.000
mean3.105-3.127=-0.022
σ0.069-0.140=-0.070
min3.045-3.023=0.022
max3.213-3.360=-0.147
iters=5
new-facts=6402
prior-facts=1
mean4756.991-4756.912=0.079
σ7.629-7.639=-0.010
min4753.367-4753.434=-0.067
max4770.635-4770.576=0.059
mean2521.000-2773.000=-252.000
σ0.000
min2521.000-2773.000=-252.000
max2521.000-2773.000=-252.000
mean8.365-8.632=-0.266
σ0.518-0.391=0.127
min7.890-8.000=-0.110
max9.222-9.009=0.213
iters=5
new-facts=6402
prior-facts=6402
mean4944.393-4944.399=-0.005
σ0.023-0.018=0.004
min4944.369-4944.374=-0.006
max4944.416-4944.420=-0.004
mean2942.800-3018.000=-75.200
σ393.509-281.637=111.872
min2521.000-2773.000=-252.000
max3468.000-3420.000=48.000
mean8.494-8.476=0.018
σ0.152-0.112=0.040
min8.346-8.385=-0.038
max8.751-8.670=0.081

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.582-0.988=0.593
σ0.271-0.137=0.134
min1.148-0.923=0.225
max1.810-1.234=0.576

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.316-468.317=-0.002
σ574.255-574.264=-0.009
min181.184-181.181=0.003
max1329.698-1329.713=-0.015
mean88.250
σ8.500
min84.000
max101.000
mean2521.000-2773.000=-252.000
σ0.000
min2521.000-2773.000=-252.000
max2521.000-2773.000=-252.000
mean0.580-0.565=0.015
σ0.583-0.561=0.022
min0.287-0.281=0.006
max1.454-1.407=0.047
policies=20
mean1812.162-1812.137=0.025
σ0.394-0.394=-0.001
min1811.901-1811.867=0.034
max1812.745-1812.719=0.026
mean840.000
σ0.000
min840.000
max840.000
mean2521.000-2773.000=-252.000
σ0.000
min2521.000-2773.000=-252.000
max2521.000-2773.000=-252.000
mean2.803-2.822=-0.019
σ0.027-0.008=0.019
min2.763-2.815=-0.052
max2.823-2.832=-0.010
policies=200
mean18129.059-18128.919=0.140
σ0.443-0.386=0.057
min18128.737-18128.590=0.147
max18129.712-18129.461=0.251
mean8400.000
σ0.000
min8400.000
max8400.000
mean2521.000-2773.000=-252.000
σ0.000
min2521.000-2773.000=-252.000
max2521.000-2773.000=-252.000
mean28.397-28.399=-0.002
σ0.195-0.123=0.073
min28.162-28.301=-0.139
max28.624-28.574=0.050