summaryrefslogtreecommitdiff
path: root/utils/NightlyTestTemplate.html
blob: bf6894b88c6e1cf85ff0977c70bf91f12c922211 (plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167

<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
<html><head><title>LLVM Test Results for $DateString</title></head>

<body bgcolor=white>
<center><font size=+3 face=Verdana><b>LLVM Test Results for $DateString</b></font></center>
<hr height=1>

<table width=100%>
<tr><td valign=top align=center>

<table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000"> 
<table border="0" cellpadding="5" cellspacing="0"><tr><td bgcolor="#DDAA77">
<font size=+1><b>Sections:</b></font><br>
</td></tr><tr><td bgcolor="#FFCC99" align=center>
<a href="#Overview">Overview</a><br>
<a href="#Changes">Changes</a><br>
<a href="#Trends">Trends</a><br>
<a href="#Programs">Programs</a><br>
<a href="#Regression">Regression</a><br>
</td></tr></table></td></tr></table>

<p>
<table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000"> 
<table border="0" cellpadding="5" cellspacing="0"><tr><td bgcolor="#DDAA77"
<font size=+1><b>Previous:</b></font><br>
</td></tr><tr><td bgcolor="#FFCC99">
  $PrevDaysList
</td></tr></table></td></tr></table>
<p>

<font size=+1><b>Back to:</b></font><br>
<a href="..">Test&nbsp;Results</a><br>
<a href="../..">LLVM&nbsp;Page</a><p>

</td><td valign=top>

<center>
<table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000"> 
<table border="0" cellpadding="10" cellspacing="0"><tr><td bgcolor="#DDAA77"
<font size=+2 face=Verdana><b><a name="Overview">Today's Test Results Overview</font></b>
</td></tr></table></td></tr></table></center><p>

<h2>CVS Tree Overview:</h2>
<ul>
<li><a href="$DATE-CVS-Log.txt">CVS Checkout Log</a>
<ul>
    Time to check out CVS tree:  <b>$CVSCheckoutTime</b> seconds<br>
    Number of directories in CVS: <b>$NumDirsInCVS</b><br>
    Number of files in CVS: <b>$NumFilesInCVS</b><br>
    Number of lines of code: <b>$LOC</b></ul>
<li><a href="$DATE-Build-Log.txt">Compilation Log</a>
<ul>
    $BuildError
    Time to build CVS tree:      <b>$BuildTime</b> seconds
               (<b>$BuildWallTime</b> seconds wall time)<br>
    Number of object files compiled: <b>$NumObjects</b><br>
    Number of libraries linked: <b>$NumLibraries</b><br>
    Number of executables linked:<b> $NumExecutables</b><br>
</ul>
</ul>

<h2>Warnings during the build:</h2>
<ul>$WarningsList
</ul><p>

<br><br><center>
<table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000"> 
<table border="0" cellpadding="10" cellspacing="0"><tr><td bgcolor="#DDAA77"
<font size=+2 face=Verdana><b><a name="Changes">Changes from Yesterday</font></b>
</td></tr></table></td></tr></table></center><p>

<h2>Changes to CVS:</h2>
<ul>
<li>Users who committed to CVS: <b>$UserCommitList</b>
<li>Users who updated from CVS: <b>$UserUpdateList</b>
<li>Added Files:    $AddedFilesList
<li>Modified Files: $ModifiedFilesList
<li>Removed Files:  $RemovedFilesList
</ul><p>

<h2>Changes to Warnings:</h2>
<ul>
<li>Warnings Added: $WarningsAdded
<li>Warnings Removed: $WarningsRemoved
</ul><p>

<h2>Changes in the test suite:</h2>
<ul>
<li>New Tests: $TestsAdded
<li>Removed Tests: $TestsRemoved
<li>Newly passing tests: $TestsFixed
<li>Newly failing tests: $TestsBroken
</ul>

<br><br><center>
<table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000"> 
<table border="0" cellpadding="10" cellspacing="0"><tr><td bgcolor="#DDAA77"
<font size=+2 face=Verdana><b><a name="Trends">Changes over Time</font></b>
</td></tr></table></td></tr></table></center><p>

GNUplot <b>charts</b> showing a couple of things:
<ol>
<li>LOC in CVS
<li>Compile Time
<li>Testing Time
<li>Time to run some programs, say all of Olden
<li>Time to compile something, say Olden.
<li>Size of bytecode files for Olden
</ol>

<br><br><center>
<table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000"> 
<table border="0" cellpadding="10" cellspacing="0"><tr><td bgcolor="#DDAA77"
<font size=+2 face=Verdana><b><a name="Programs">Program Tests</font></b>
</td></tr></table></td></tr></table></center><p>

This section tests LLVM on a variety of programs in the test suite.  This
includes benchmark suites like the Olden, ptrdist, and SPEC benchmarks as well
as a few random programs with test inputs.  This section is meant to track how
stable LLVM is as a whole.  The columns of the tables are:<p>

<ol>
<li><a name="Program">Program - The name of the program for that row
<li><a name="GCCAS">GCCAS - Time to run LLVM optimizers on the program
<li><a name="Bytecode">Bytecode - The size of the bytecode for the program
<li><a name="Instrs">Instrs - The number of LLVM instructions in the
    compiled bytecode
<li><a name="LLC">LLC - The time taken compile with LLC (the static backend)
<li><a name="NAT">NAT - The time taken to execute the program when compiled
    with GCC -O3.
<li><a name="CBE">CBE - The time taken to execute the program after compilation
    through the C Backend.  If the diff fails, this a *.
<li><a name="LLC">LLC - The time taken to run LLC compiled program
<li><a name="JIT">JIT - How long does the program take to execute in the
    Just-In-Time compiler.
<li><a name="MachCode">MachCode - The number of bytes of machine code
    generated by the JIT.
<li><a name="CompTime">CompTime - The amount of time spent in the JIT itself,
    instead of executing the program.
</ol><p>

A complete log of testing <a href="$DATE-ProgramTest.txt.gz">is available</a>
for further analysis.

<h2>Programs/MultiSource</h2>

<center>
<table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000"> 
$ProgramsTable
</td></tr></table></center>

<h2>Programs/SingleSource</h2>



<br><br><center>
<table border="0" cellspacing="0" cellpadding="2"><tr><td bgcolor="#000000"> 
<table border="0" cellpadding="10" cellspacing="0"><tr><td bgcolor="#DDAA77"
<font size=+2 face=Verdana><b><a name="Regression">Regression Tests</font></b>
</td></tr></table></td></tr></table></center><p>

Not yet implemented<p>

</td></tr>

</html>