defaria.com/blogs/Status/2006/09/jvm-stackheap-s.html

   1 <!DOCTYPE html>
   2 <html lang="en-us" itemscope itemtype="http://schema.org/Article">
   3   <head>
   4     <meta charset="utf-8">
   5     <meta name="description" content=" Looked into JVM stack and heap sizes on dfls83-85...">
   6     <meta name="generator" content="Movable Type 5.2.3">
   7     <title>JVM Stack/Heap Sizes - Status</title>
   8     <link rel="alternate" type="application/atom+xml" title="Recent Entries" href="http://defaria.com/blogs/Status/atom.xml">
   9     <link rel="canonical" href="http://defaria.com/blogs/Status/2006/09/jvm-stackheap-s.html">
  10     <meta name="viewport" content="width=device-width,initial-scale=1">
  11     <link rel="stylesheet" href="http://defaria.com/blogs/Status/styles.css">
  12     <!--[if lt IE 9]>
  13     <link rel="stylesheet" href="http://defaria.com/blogs/Status/styles_ie.css">
  14     <script src="/mt/mt-static/support/theme_static/rainier/js/html5shiv.js"></script>
  15     <![endif]-->
  16
  17     <link rel="start" href="http://defaria.com/blogs/Status/">
  18
  19     <link rel="prev" href="http://defaria.com/blogs/Status/2006/09/omapspm-bug.html" title="OMAPS.pm bug">
  20     <link rel="next" href="http://defaria.com/blogs/Status/2006/09/load-balancing.html" title="Load Balancing Redirection">
  21     <!-- Open Graph Protocol -->
  22     <meta property="og:type" content="article">
  23     <meta property="og:locale" content="en-us">
  24     <meta property="og:title" content="JVM Stack/Heap Sizes">
  25     <meta property="og:url" content="http://defaria.com/blogs/Status/2006/09/jvm-stackheap-s.html">
  26     <meta property="og:description" content=" Looked into JVM stack and heap sizes on dfls83-85...">
  27     <meta property="og:site_name" content="Status">
  28     <meta property="og:image" content="/mt/mt-static/support/theme_static/rainier/img/siteicon-sample.png">
  29     <!-- Metadata -->
  30     <meta itemprop="description" content=" Looked into JVM stack and heap sizes on dfls83-85...">
  31     <link itemprop="url" href="http://defaria.com/blogs/Status/2006/09/jvm-stackheap-s.html">
  32     <link itemprop="image" href="/mt/mt-static/support/theme_static/rainier/img/siteicon-sample.png">
  33
  34   </head>
  35   <body>
  36     <div id="container">
  37       <div id="container-inner">
  38         <header id="header" role="banner">
  39           <div id="header-inner">
  40             <div id="header-content">
  41               <h1>
  42                 <a href="http://defaria.com/blogs/Status/">
  43
  44                   Status
  45
  46                 </a>
  47               </h1>
  48
  49             </div>
  50
  51             <nav role="navigation">
  52           <ul>
  53             <li><a href="http://defaria.com/blogs/Status/">Home</a></li>
  54
  55
  56           </ul>
  57         </nav>
  58
  59           </div>
  60         </header>
  61         <div id="content">
  62           <div id="content-inner">
  63             <ul class="breadcrumb breadcrumb-list">
  64               <li class="breadcrumb-list-item"><a href="http://defaria.com/blogs/Status/">Home</a></li>
  65               <li class="breadcrumb-list-item">JVM Stack/Heap Sizes</li>
  66             </ul>
  67             <div id="individual-main" class="main" role="main">
  68               <article id="entry-1832" class="entry entry-asset asset hentry">
  69                 <div class="asset-header">
  70                   <h2 itemprop="name" class="asset-name entry-title">JVM Stack/Heap Sizes</h2>
  71                   <footer class="asset-meta">
  72                     <ul class="asset-meta-list">
  73                       <li class="asset-meta-list-item">Posted on <time datetime="2006-09-28T11:53:12-08:00" itemprop="datePublished">September 28, 2006</time></li>
  74                       <li class="asset-meta-list-item">by <span class="author entry-author vcard"></span></li>
  75
  76
  77                       <li class="asset-meta-list-item">in <a itemprop="articleSection" rel="tag" href="http://defaria.com/blogs/Status/texas-instruments/">Texas Instruments</a></li>
  78
  79
  80                    </ul>
  81                 </footer>
  82                 </div>
  83                 <div class="entry-content asset-content" itemprop="articleBody">
  84                   <ul>
  85   <li>Looked into JVM stack and heap sizes on dfls83-85</li>
  86 </ul>
  87                   <p>As you know there have been service interruptions in CQWeb. I keep looking at the logs for clues. About the only consistent thing is an error similar to this:</p>
  88
  89 <div class=code><pre>
  90 2006-09-28 00:10:20 Ajp13Processor[8009][15] process: invoke
  91 java.net.SocketException: Connection reset by peer: socket write error
  92         at java.net.SocketOutputStream.socketWrite0(Native Method)
  93         at java.net.SocketOutputStream.socketWrite(Unknown Source)
  94         at java.net.SocketOutputStream.write(Unknown Source)
  95         at org.apache.ajp.Ajp13.send(Ajp13.java:525)
  96         at org.apache.ajp.RequestHandler.finish(RequestHandler.java:495)
  97         at org.apache.ajp.Ajp13.finish(Ajp13.java:395)
  98         at org.apache.ajp.tomcat4.Ajp13Response.finishResponse(Ajp13Response.java:196)
  99         at org.apache.ajp.tomcat4.Ajp13Processor.process(Ajp13Processor.java:464)
 100         at org.apache.ajp.tomcat4.Ajp13Processor.run(Ajp13Processor.java:551)
 101         at java.lang.Thread.run(Unknown Source)
 102 </pre></div>
 103
 104 <p>Now "Connection reset by peer" could be an error that the process gets because the service has stopped so this could be more of a symptom than a cure. However searching for "Ajp13Processor socket write error" points me to <a href="http://mail-archives.apache.org/mod_mbox/tomcat-users/200203.mbox/%3C751828609.20020327090907@e-box.dk%3E">this
 105 post</a> which suggests increasing the stack and heap sizes for the JVM. Problems that are intermittent can be consistent with running out of stack or heap size.<./p>
 106
 107 <p>According to the Clearquest Web Administration Guide:</p>
 108
 109 <blockquote>
 110   <hr size="2" width="100%">
 111   <h3>Controlling Java VM Memory Consumption </h3>
 112
 113   <p>You can configure the memory consumption of Java processes used by New ClearQuest Web by adjusting the parameters in property files under the various components.</p>
 114
 115   <h4>Windows </h4>
 116
 117   <p>This section describes the configuration changes for New ClearQuest Web Java VM memory consumption for processes running on Microsoft Windows. To specify the VM memory consumption:</p>
 118
 119   <ol>
 120     <li>Open the appropriate configuration file for the New ClearQuest Web component whose memory consumption you want to reconfigure. For the ClearQuest Web application:
 121
 122       <table border="1" cellpadding="2" cellspacing="0" width="100%">
 123         <tbody>
 124           <tr>
 125             <th align="left" valign="top">Component</th>
 126             <th align="left" valign="top">Configuration file</th>
 127           </tr>
 128           <tr>
 129             <td valign="top">Apache Tomcat Server</td>
 130             <td valign="top">C:\Program
 131 Files\Rational\Common\rwp\bin\jk_service2.in.properties</td>
 132           </tr>
 133           <tr>
 134             <td valign="top">Rational Web Platform</td>
 135             <td valign="top">C:\Program
 136 Files\Rational\Common\rwp\bin\jk_service2.properties</td>
 137           </tr>
 138         </tbody>
 139       </table>
 140       <br>
 141     <p>For the ClearQuest server:</p>
 142       <table border="1" cellpadding="2" cellspacing="0" width="100%">
 143         <tbody>
 144           <tr>
 145             <th align="left" valign="top">Component</th>
 146             <th align="left" valign="top">Configuration file</th>
 147           </tr>
 148           <tr>
 149             <td valign="top">ClearQuest Request Manager</td>
 150             <td valign="top">C:\Program
 151 Files\Rational\ClearQuest\cqweb\cqserver\requestmgr_service.properties</td>
 152           </tr>
 153           <tr>
 154             <td valign="top">ClearQuest Registry Server</td>
 155             <td valign="top">C:\Program
 156 Files\Rational\ClearQuest\cqweb\cqregsvr\cqregsvr_service.properties</td>
 157           </tr>
 158         </tbody>
 159       </table>
 160     </li>
 161     <li>Modify the section shown below:<br>
 162       <br>
 163     <div class=code><pre>
 164 # # JVM Options #
 165 # Useful Options:
 166 # -Xms2m = Initial heap size, modify for desired size
 167 # -Xmx256m = Maximum heap size, modify for desired size
 168 # -Xrs = Available in Jdk1.3.1 to avoid JVM termination during logoff
 169 #
 170 wrapper.jvm.options=-Xrs -Xms2m -Xmx256m
 171     </pre></div></li>
 172   </ol>
 173   <hr size="2" width="100%">
 174 </blockquote>
 175
 176 <p>I looked at these config files on the three machines (dfls83-85) and they were pretty much set to the default:</p>
 177
 178 <div class=code><pre>
 179 <font color=blue><b>Ltx0062320:</b></font><u>for server in 83 84 85; do grep
 180 wrapper.jvm.options= //dfls$server/Rational/Common/rwp/bin/jk_service2*properties
 181 //dfls$server/Rational/ClearQuest/cqweb/cqserver/requestmgr_service.properties
 182 //dfls
 183 $server/Rational/ClearQuest/cqweb/cqregsvr/cqregsvr_service.properties;
 184 done</u>
 185 //dfls83/Rational/Common/rwp/bin/jk_service2.default.properties:wrapper.jvm.options=-Xrs
 186 -Xms2m -Xmx256m<br>
 187 //dfls83/Rational/Common/rwp/bin/jk_service2.in.properties:wrapper.jvm.options=-Xrs
 188 -Xms2m -Xmx256m<br>
 189 //dfls83/Rational/Common/rwp/bin/jk_service2.properties:wrapper.jvm.options=-Xrs
 190 -Xms2m -Xmx256m<br>
 191 //dfls83/Rational/ClearQuest/cqweb/cqserver/requestmgr_service.properties:wrapper.jvm.options=-Xrs<br>
 192 //dfls83/Rational/ClearQuest/cqweb/cqregsvr/cqregsvr_service.properties:wrapper.jvm.options=-Xrs<br>
 193 //dfls84/Rational/Common/rwp/bin/jk_service2.default.properties:wrapper.jvm.options=-Xrs
 194 -Xms2m -Xmx256m<br>
 195 //dfls84/Rational/Common/rwp/bin/jk_service2.in.properties:wrapper.jvm.options=-Xrs
 196 -Xms2m -Xmx256m<br>
 197 //dfls84/Rational/Common/rwp/bin/jk_service2.properties:wrapper.jvm.options=-Xrs
 198 -Xms2m -Xmx256m<br>
 199 //dfls84/Rational/ClearQuest/cqweb/cqserver/requestmgr_service.properties:wrapper.jvm.options=-Xrs<br>
 200 //dfls84/Rational/ClearQuest/cqweb/cqregsvr/cqregsvr_service.properties:wrapper.jvm.options=-Xrs<br>
 201 //dfls85/Rational/Common/rwp/bin/jk_service2.default.properties:wrapper.jvm.options=-Xrs
 202 -Xms2m -Xmx256m<br>
 203 //dfls85/Rational/Common/rwp/bin/jk_service2.in.properties:wrapper.jvm.options=-Xrs
 204 -Xms2m -Xmx256m<br>
 205 //dfls85/Rational/Common/rwp/bin/jk_service2.properties:wrapper.jvm.options=-Xrs
 206 -Xms2m -Xmx256m<br>
 207 //dfls85/Rational/ClearQuest/cqweb/cqserver/requestmgr_service.properties:wrapper.jvm.options=-Xrs<br>
 208 //dfls85/Rational/ClearQuest/cqweb/cqregsvr/cqregsvr_service.properties:wrapper.jvm.options=-Xrs<br>
 209  </pre></div>
 210
 211 </blockquote>
 212   <p>All these machines have 2 gig of main memory and largely just serve CQWeb. Indeed the CQWeb service processes are consuming most of the memory:</p>
 213
 214 <div align="center"><img title="dfls83"  src="/blogs/Status/images/dfls83.jpg" alt="" height="541"  width="524">
 215 <b>dfls83</b><br>
 216 <img title="dfls84" src="/blogs/Status/images/dfls84.jpg" alt=""  height="545" width="525">
 217 <b>dfls84</b>
 218 <br>
 219 <img title="dfls85" src="/blogs/Status/images/dfls85.jpg" alt="" height="577" width="528">
 220 <b>dfls85</b>
 221 </div>
 222
 223 <p>I think we should try setting at least the following:</p>
 224
 225 <div class=code><pre>
 226 wrapper.jvm.options=-Xrs -Xms128m -Xmx512m
 227 </pre></div>
 228
 229 <p>A restart of all CQ Web services would probably be needed for the changes to become effective. The above settings start off the jvm @ 128m for all 4 processes thus a total memory footprint of 512 Meg and limit each process to 512 Meg max for a total footprint of 2 Gig (when full). We might want to bounce this idea off IBM/Rational support to see if all 4 process should have the same settings or if we show vary
 230 them.</p>
 231                 </div>
 232                 <nav class="page-navigation entry-navigation pagination content-nav">
 233                   <ul class="page-navigation-list">
 234
 235                     <li class="page-navigation-list-item page-navigation-prev"><a rel="prev" href="http://defaria.com/blogs/Status/2006/09/omapspm-bug.html" title="OMAPS.pm bug">Previous entry</a></li>
 236
 237
 238                     <li class="page-navigation-list-item page-navigation-next"><a rel="next" href="http://defaria.com/blogs/Status/2006/09/load-balancing.html" title="Load Balancing Redirection">Next entry</a></li>
 239
 240                   </ul>
 241                 </nav>
 242                 <!--
 243 <aside id="zenback" class="zenback feedback">
 244   Please paste Zenback script code here.
 245 </aside>
 246 -->
 247
 248
 249               </article>
 250             </div>
 251             <aside class="widgets related" role="complementary">
 252               <nav class="widget-search widget">
 253   <div class="widget-content">
 254     <form method="get" id="search" action="http://defaria.com/mt/mt-search.cgi">
 255       <div>
 256         <input type="text" name="search" value="" placeholder="Search...">
 257
 258         <input type="hidden" name="IncludeBlogs" value="8">
 259
 260         <input type="hidden" name="limit" value="20">
 261         <button type="submit" name="button">
 262           <img alt="Search" src="/mt/mt-static/support/theme_static/rainier/img/search-icon.png">
 263         </button>
 264       </div>
 265     </form>
 266   </div>
 267 </nav>
 268 <nav class="widget-archive-category widget">
 269   <h3 class="widget-header">Categories</h3>
 270   <div class="widget-content">
 271
 272
 273     <ul class="widget-list">
 274
 275
 276       <li class="widget-list-item"><a href="http://defaria.com/blogs/Status/ameriquest/">Ameriquest (99)</a>
 277
 278
 279       </li>
 280
 281
 282
 283
 284       <li class="widget-list-item"><a href="http://defaria.com/blogs/Status/audience/">Audience (3)</a>
 285
 286
 287       </li>
 288
 289
 290
 291
 292       <li class="widget-list-item"><a href="http://defaria.com/blogs/Status/broadcom/">Broadcom (76)</a>
 293
 294
 295       </li>
 296
 297
 298
 299
 300       <li class="widget-list-item"><a href="http://defaria.com/blogs/Status/gpdb/">GPDB (35)</a>
 301
 302
 303       </li>
 304
 305
 306
 307
 308       <li class="widget-list-item"><a href="http://defaria.com/blogs/Status/general-dynamics/">General Dynamics (61)</a>
 309
 310
 311       </li>
 312
 313
 314
 315
 316       <li class="widget-list-item"><a href="http://defaria.com/blogs/Status/general-electric/">General Electric (13)</a>
 317
 318
 319       </li>
 320
 321
 322
 323
 324       <li class="widget-list-item"><a href="http://defaria.com/blogs/Status/hewlett-packard/">Hewlett Packard (13)</a>
 325
 326
 327       </li>
 328
 329
 330
 331
 332       <li class="widget-list-item"><a href="http://defaria.com/blogs/Status/lynuxworks/">LynuxWorks (162)</a>
 333
 334
 335       </li>
 336
 337
 338
 339
 340       <li class="widget-list-item"><a href="http://defaria.com/blogs/Status/pqa/">PQA (35)</a>
 341
 342
 343       </li>
 344
 345
 346
 347
 348       <li class="widget-list-item"><a href="http://defaria.com/blogs/Status/salira/">Salira (79)</a>
 349
 350
 351       </li>
 352
 353
 354
 355
 356       <li class="widget-list-item"><a href="http://defaria.com/blogs/Status/tellabs/">Tellabs (2)</a>
 357
 358
 359       </li>
 360
 361
 362
 363
 364       <li class="widget-list-item"><a href="http://defaria.com/blogs/Status/texas-instruments/">Texas Instruments (31)</a>
 365
 366
 367       </li>
 368
 369     </ul>
 370
 371
 372   </div>
 373 </nav>
 374
 375
 376 <nav class="widget-archive-dropdown widget">
 377   <h3 class="widget-header">Archives</h3>
 378   <div class="widget-content">
 379     <select>
 380       <option>Select a Month...</option>
 381
 382       <option value="http://defaria.com/blogs/Status/2016/02/">February 2016</option>
 383
 384
 385
 386       <option value="http://defaria.com/blogs/Status/2014/09/">September 2014</option>
 387
 388
 389
 390       <option value="http://defaria.com/blogs/Status/2014/04/">April 2014</option>
 391
 392
 393
 394       <option value="http://defaria.com/blogs/Status/2014/03/">March 2014</option>
 395
 396
 397
 398       <option value="http://defaria.com/blogs/Status/2013/02/">February 2013</option>
 399
 400
 401
 402       <option value="http://defaria.com/blogs/Status/2012/09/">September 2012</option>
 403
 404
 405
 406       <option value="http://defaria.com/blogs/Status/2012/08/">August 2012</option>
 407
 408
 409
 410       <option value="http://defaria.com/blogs/Status/2012/05/">May 2012</option>
 411
 412
 413
 414       <option value="http://defaria.com/blogs/Status/2012/04/">April 2012</option>
 415
 416
 417
 418       <option value="http://defaria.com/blogs/Status/2012/02/">February 2012</option>
 419
 420
 421
 422       <option value="http://defaria.com/blogs/Status/2012/01/">January 2012</option>
 423
 424
 425
 426       <option value="http://defaria.com/blogs/Status/2011/10/">October 2011</option>
 427
 428
 429
 430       <option value="http://defaria.com/blogs/Status/2011/07/">July 2011</option>
 431
 432
 433
 434       <option value="http://defaria.com/blogs/Status/2010/09/">September 2010</option>
 435
 436
 437
 438       <option value="http://defaria.com/blogs/Status/2010/08/">August 2010</option>
 439
 440
 441
 442       <option value="http://defaria.com/blogs/Status/2010/04/">April 2010</option>
 443
 444
 445
 446       <option value="http://defaria.com/blogs/Status/2010/03/">March 2010</option>
 447
 448
 449
 450       <option value="http://defaria.com/blogs/Status/2010/02/">February 2010</option>
 451
 452
 453
 454       <option value="http://defaria.com/blogs/Status/2009/05/">May 2009</option>
 455
 456
 457
 458       <option value="http://defaria.com/blogs/Status/2009/04/">April 2009</option>
 459
 460
 461
 462       <option value="http://defaria.com/blogs/Status/2008/07/">July 2008</option>
 463
 464
 465
 466       <option value="http://defaria.com/blogs/Status/2008/05/">May 2008</option>
 467
 468
 469
 470       <option value="http://defaria.com/blogs/Status/2008/04/">April 2008</option>
 471
 472
 473
 474       <option value="http://defaria.com/blogs/Status/2008/03/">March 2008</option>
 475
 476
 477
 478       <option value="http://defaria.com/blogs/Status/2008/02/">February 2008</option>
 479
 480
 481
 482       <option value="http://defaria.com/blogs/Status/2008/01/">January 2008</option>
 483
 484
 485
 486       <option value="http://defaria.com/blogs/Status/2007/12/">December 2007</option>
 487
 488
 489
 490       <option value="http://defaria.com/blogs/Status/2007/11/">November 2007</option>
 491
 492
 493
 494       <option value="http://defaria.com/blogs/Status/2007/10/">October 2007</option>
 495
 496
 497
 498       <option value="http://defaria.com/blogs/Status/2007/09/">September 2007</option>
 499
 500
 501
 502       <option value="http://defaria.com/blogs/Status/2007/08/">August 2007</option>
 503
 504
 505
 506       <option value="http://defaria.com/blogs/Status/2007/07/">July 2007</option>
 507
 508
 509
 510       <option value="http://defaria.com/blogs/Status/2007/06/">June 2007</option>
 511
 512
 513
 514       <option value="http://defaria.com/blogs/Status/2007/05/">May 2007</option>
 515
 516
 517
 518       <option value="http://defaria.com/blogs/Status/2007/04/">April 2007</option>
 519
 520
 521
 522       <option value="http://defaria.com/blogs/Status/2007/03/">March 2007</option>
 523
 524
 525
 526       <option value="http://defaria.com/blogs/Status/2007/01/">January 2007</option>
 527
 528
 529
 530       <option value="http://defaria.com/blogs/Status/2006/12/">December 2006</option>
 531
 532
 533
 534       <option value="http://defaria.com/blogs/Status/2006/11/">November 2006</option>
 535
 536
 537
 538       <option value="http://defaria.com/blogs/Status/2006/10/">October 2006</option>
 539
 540
 541
 542       <option value="http://defaria.com/blogs/Status/2006/09/">September 2006</option>
 543
 544
 545
 546       <option value="http://defaria.com/blogs/Status/2006/07/">July 2006</option>
 547
 548
 549
 550       <option value="http://defaria.com/blogs/Status/2006/06/">June 2006</option>
 551
 552
 553
 554       <option value="http://defaria.com/blogs/Status/2006/05/">May 2006</option>
 555
 556
 557
 558       <option value="http://defaria.com/blogs/Status/2006/04/">April 2006</option>
 559
 560
 561
 562       <option value="http://defaria.com/blogs/Status/2006/03/">March 2006</option>
 563
 564
 565
 566       <option value="http://defaria.com/blogs/Status/2006/02/">February 2006</option>
 567
 568
 569
 570       <option value="http://defaria.com/blogs/Status/2006/01/">January 2006</option>
 571
 572
 573
 574       <option value="http://defaria.com/blogs/Status/2005/12/">December 2005</option>
 575
 576
 577
 578       <option value="http://defaria.com/blogs/Status/2005/11/">November 2005</option>
 579
 580
 581
 582       <option value="http://defaria.com/blogs/Status/2005/10/">October 2005</option>
 583
 584
 585
 586       <option value="http://defaria.com/blogs/Status/2005/09/">September 2005</option>
 587
 588
 589
 590       <option value="http://defaria.com/blogs/Status/2005/08/">August 2005</option>
 591
 592
 593
 594       <option value="http://defaria.com/blogs/Status/2005/07/">July 2005</option>
 595
 596
 597
 598       <option value="http://defaria.com/blogs/Status/2005/06/">June 2005</option>
 599
 600
 601
 602       <option value="http://defaria.com/blogs/Status/2005/05/">May 2005</option>
 603
 604
 605
 606       <option value="http://defaria.com/blogs/Status/2005/04/">April 2005</option>
 607
 608
 609
 610       <option value="http://defaria.com/blogs/Status/2005/03/">March 2005</option>
 611
 612
 613
 614       <option value="http://defaria.com/blogs/Status/2005/02/">February 2005</option>
 615
 616
 617
 618       <option value="http://defaria.com/blogs/Status/2005/01/">January 2005</option>
 619
 620
 621
 622       <option value="http://defaria.com/blogs/Status/2004/12/">December 2004</option>
 623
 624
 625
 626       <option value="http://defaria.com/blogs/Status/2004/09/">September 2004</option>
 627
 628
 629
 630       <option value="http://defaria.com/blogs/Status/2004/08/">August 2004</option>
 631
 632
 633
 634       <option value="http://defaria.com/blogs/Status/2004/07/">July 2004</option>
 635
 636
 637
 638       <option value="http://defaria.com/blogs/Status/2004/06/">June 2004</option>
 639
 640
 641
 642       <option value="http://defaria.com/blogs/Status/2004/05/">May 2004</option>
 643
 644
 645
 646       <option value="http://defaria.com/blogs/Status/2004/04/">April 2004</option>
 647
 648
 649
 650       <option value="http://defaria.com/blogs/Status/2004/03/">March 2004</option>
 651
 652
 653
 654       <option value="http://defaria.com/blogs/Status/2004/02/">February 2004</option>
 655
 656
 657
 658       <option value="http://defaria.com/blogs/Status/2004/01/">January 2004</option>
 659
 660
 661
 662       <option value="http://defaria.com/blogs/Status/2003/12/">December 2003</option>
 663
 664
 665
 666       <option value="http://defaria.com/blogs/Status/2003/11/">November 2003</option>
 667
 668     </select>
 669   </div>
 670 </nav>
 671
 672
 673
 674 <div class="widget-syndication widget section">
 675   <div class="widget-content">
 676     <p><img src="http://defaria.com/mt/mt-static/images/status_icons/feed.gif" alt="Subscribe to feed" width="9" height="9" /> <a href="http://defaria.com/blogs/Status/atom.xml">Subscribe to this blog's feed</a></p>
 677
 678   </div>
 679 </div>
 680
 681             </aside>
 682           </div>
 683         </div>
 684         <footer id="footer" role="contentinfo">
 685           <div id="footer-inner">
 686             <div id="footer-content">
 687   <nav role="navigation">
 688           <ul>
 689             <li><a href="http://defaria.com/blogs/Status/">Home</a></li>
 690
 691
 692           </ul>
 693         </nav>
 694
 695   <p class="license">&copy; Copyright 2016.</p>
 696   <p class="poweredby">Powered by <a href="http://www.movabletype.org/">Movable Type</a></p>
 697 </div>
 698           </div>
 699         </footer>
 700       </div>
 701     </div>
 702     <script src="http://defaria.com/mt/mt-static/jquery/jquery.min.js"></script>
 703     <script src="http://defaria.com/blogs/Status/mt-theme-scale2.js"></script>
 704   </body>
 705 </html>