Initial add of defaria.com
[clearscm.git] / defaria.com / blogs / Status / archives / week_2005_10_02.html
1 <!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN"
2    "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
3 <html xmlns="http://www.w3.org/1999/xhtml" id="sixapart-standard">
4 <head>
5    <meta http-equiv="Content-Type" content="text/html; charset=utf-8" />
6    <meta name="generator" content="Movable Type 5.2.3" />
7
8    <link rel="stylesheet" href="http://defaria.com/blogs/Status/styles-site.css" type="text/css" />
9    <link rel="alternate" type="application/atom+xml" title="Atom" href="http://defaria.com/blogs/Status/atom.xml" />
10    <link rel="alternate" type="application/rss+xml" title="RSS 2.0" href="http://defaria.com/blogs/Status/index.xml"$>" />
11
12    <title>Status for Andrew DeFaria: October  2, 2005 - October  8, 2005 Archives</title>
13
14    <link rel="start" href="http://defaria.com/blogs/Status/" title="Home" />
15    <link rel="prev" href="http://defaria.com/blogs/Status/archives/week_2005_09_25.html" title="September 25, 2005 - October  1, 2005" />
16    <link rel="next" href="http://defaria.com/blogs/Status/archives/week_2005_10_09.html" title="October  9, 2005 - October 15, 2005" />
17 </head>
18 <body class="layout-one-column">
19    <div id="container">
20       <div id="container-inner" class="pkg">
21
22          <div id="banner">
23             <div id="banner-inner" class="pkg">
24                <h1 id="banner-header"><a href="http://defaria.com/blogs/Status/" accesskey="1">Status for Andrew DeFaria</a></h1>
25                <h2 id="banner-description">Searchable status reports and work log</h2>
26             </div>
27          </div>
28
29          <div id="pagebody">
30             <div id="pagebody-inner" class="pkg">
31                <div id="alpha">
32                   <div id="alpha-inner" class="pkg">
33                      
34                      <p class="content-nav">
35                         <a href="http://defaria.com/blogs/Status/archives/week_2005_09_25.html">&laquo; September 25, 2005 - October  1, 2005</a> |
36                         <a href="http://defaria.com/blogs/Status/">Main</a>
37                         | <a href="http://defaria.com/blogs/Status/archives/week_2005_10_09.html">October  9, 2005 - October 15, 2005 &raquo;</a>
38                      </p>
39                      
40                      
41                      
42
43                      <h2 class="date-header">October  8, 2005</h2>
44                      <a id="a000445"></a>
45                      <div class="entry" id="entry-445">
46                         <h3 class="entry-header">SJ VOB Move</h3>
47                         <div class="entry-content">
48                            <div class="entry-body">
49                               <p>The VOB move for San Jose went fairly well. Without the normal user load on the servers the dumping and loading process was much quicker. I've attached Jennifer's spread sheet and updated it to reflect which vobs we've moved and how long it took as well as what sort of reduction we got in the DB sizes. All moved vobs are tagged on ccase-sj1-7 and Clearcase is still off on ccase-sj1-1 - for now. We will turn that on before Jennifer and Chin start with their testing. Yet left to do is the Multisite chreplica and re instituting of the cronjobs, etc. - nothing that would imped users Monday morning as well as clean up of backup areas assuming we reach a go on the go/no go tomorrow afternoon.</p>
50
51 <p>I've also attached a tar image of the log files that we managed to capture for the dump and load process.</p>
52                               
53                               <p class="entry-footer">
54                                  <span class="post-footers">Posted by  at  3:13 PM</span> <span class="separator">|</span> <a class="permalink" href="http://defaria.com/blogs/Status/archives/000445.html">Permalink</a>
55                                  
56                                  
57                               </p>
58                            </div>
59                         </div>
60                      </div>
61                      
62                      
63
64                      <h2 class="date-header">October  7, 2005</h2>
65                      <a id="a000444"></a>
66                      <div class="entry" id="entry-444">
67                         <h3 class="entry-header">ctmerge</h3>
68                         <div class="entry-content">
69                            <div class="entry-body">
70                               <ul>
71   <li>Started incorporating ctmerge and other old Clearcase/Clearquest oriented scripts in to adm vob</li>
72
73   <lI>Investigated some Multisite issues WRT this SJ VOB move</li>
74
75   <li>Working with Shivdutt on copying VOB storage over to /projects/cc-test</li>
76 </ul>
77                               
78                               <p class="entry-footer">
79                                  <span class="post-footers">Posted by  at  6:01 PM</span> <span class="separator">|</span> <a class="permalink" href="http://defaria.com/blogs/Status/archives/000444.html">Permalink</a>
80                                  
81                                  
82                               </p>
83                            </div>
84                         </div>
85                      </div>
86                      
87                      
88
89                      <h2 class="date-header">October  6, 2005</h2>
90                      <a id="a000443"></a>
91                      <div class="entry" id="entry-443">
92                         <h3 class="entry-header">PQA.pm/adm VOB</h3>
93                         <div class="entry-content">
94                            <div class="entry-body">
95                               <ul>
96   <li>Converted Code Page routines into a PQA.pm Perl Module</li>
97
98   <li>Changed routines to check all fields. Clearquest returns character data for fields such as DATE_TIME fields. These record definitions are now complete and will be useful when it comes time to perform the conversion</li>
99
100   <li>Waiting for new schema to start coding/testing conversion process. Contacted David Shaw who had helped us last time to get the databases onto our test server</li>
101
102   <li>Finally get adm VOB working and am starting to add my stuff into this VOB in a controlled fashion. This is not just a place to dump all of our scripts rather it's a place to start centralizing our code in a manner consistent with proper software engineering principals (Structured coding, code reuse, generalization, object oriented design principals, etc.)</li>
103 </ul>
104                               
105                               <p class="entry-footer">
106                                  <span class="post-footers">Posted by  at 11:28 PM</span> <span class="separator">|</span> <a class="permalink" href="http://defaria.com/blogs/Status/archives/000443.html">Permalink</a>
107                                  
108                                  
109                               </p>
110                            </div>
111                         </div>
112                      </div>
113                      
114                      
115
116                      <h2 class="date-header">October  5, 2005</h2>
117                      <a id="a000441"></a>
118                      <div class="entry" id="entry-441">
119                         <h3 class="entry-header">HTML Characters/VOB Distribution</h3>
120                         <div class="entry-content">
121                            <div class="entry-body">
122                               <ul>
123   <li>Changed CheckCodePage to use HTML character equivalents</li>
124
125   <li>Derived a plan of redistributing VOBs between VOB servers based on VOB database size</li>
126 </ul>
127                               
128                               <h3>HTML Characters</h3>
129
130 <p>Decided to translate non US ASCII characters into their HTML equivalents. Therefore &copy; changes to "&amp;copy;" For characters that have no handy name equivalent used the form of &amp;#<i>n</i>; where <i>n</i> is the decimal number for the character.</p>
131
132 <h3>VOB Distribution</h3>
133
134 <p>Based on Jennifer's email and adjusting for size of DB here is how I'd split the vobs between ccase-sj1-1 and ccase-sj1-7. This distribution balances the vob database size between the two machines.</p>
135
136 <table  align="center" border="1" cellpadding="2" cellspacing="0" height="100%"  width="95%" bgcolor="white">
137   <tbody>
138     <tr>
139       <th colspan="3" bgcolor="teal" align="center"><font color="white">Proposed split of vobs</font></th>
140     </tr>
141     <tr bgcolor="#33ccff">
142       <th>Vob</th>
143       <th>ccase-sj1-1</th>
144       <th>ccase-sj1-7</th>
145     </tr>
146     <tr>
147       <td>\UCM-Projects</td>
148       <td>436.8</td>
149       <td>&nbsp;</td>
150     </tr>
151     <tr bgcolor="#ddd">
152       <td>\SetTop</td>
153       <td>&nbsp;</td>
154       <td>4545.9</td>
155     </tr>
156     <tr>
157       <td>\magnum</td>
158       <td>442.7</td>
159       <td>&nbsp;</td>
160     </tr>
161     <tr bgcolor="#ddd">
162       <td>\BSEAV</td>
163       <td>&nbsp;</td>
164       <td>452.1</td>
165     </tr>
166     <tr>
167       <td>\rockford</td>
168       <td>97.4</td>
169       <td>&nbsp;</td>
170     </tr>
171     <tr bgcolor="#ddd">
172       <td>\TestTools</td>
173       <td>&nbsp;</td>
174       <td>15.4</td>
175     </tr>
176     <tr>
177       <td>\DVTSJ</td>
178       <td>17.5</td>
179       <td>&nbsp;</td>
180     </tr>
181     <tr bgcolor="#ddd">
182       <td>\TiVo</td>
183       <td>&nbsp;</td>
184       <td>49.4</td>
185     </tr>
186     <tr>
187       <td>\LinuxSupport</td>
188       <td>&nbsp;</td>
189       <td>18.8</td>
190     </tr>
191     <tr bgcolor="#ddd">
192       <td>\SetTopGI</td>
193       <td>377.9</td>
194       <td>&nbsp;</td>
195     </tr>
196     <tr>
197       <td>\SetTopMot</td>
198       <td>288.8</td>
199       <td>&nbsp;</td>
200     </tr>
201     <tr bgcolor="#ddd">
202       <td>\Ref_Linux_Kernel</td>
203       <td>&nbsp;</td>
204       <td>1647.2</td>
205     </tr>
206     <tr>
207       <td>\BSE_MS</td>
208       <td>482.5</td>
209       <td>&nbsp;</td>
210     </tr>
211     <tr bgcolor="#ddd">
212       <td>\tmmsky</td>
213       <td>&nbsp;</td>
214       <td>14.7</td>
215     </tr>
216     <tr>
217       <td>\nds</td>
218       <td>14.5</td>
219       <td>&nbsp;</td>
220     </tr>
221     <tr bgcolor="#ddd">
222       <td>\Mot_P3_TCMTC</td>
223       <td>&nbsp;</td>
224       <td>0.2</td>
225     </tr>
226     <tr>
227       <td>\CommEngine</td>
228       <td>1506.7</td>
229       <td>&nbsp;</td>
230     </tr>
231     <tr bgcolor="#ddd">
232       <td>\BSSS</td>
233       <td>&nbsp;</td>
234       <td>28.9</td>
235     </tr>
236     <tr>
237       <td>\softmodem</td>
238       <td>11.7</td>
239       <td>&nbsp;</td>
240     </tr>
241     <tr bgcolor="#ddd">
242       <td>\applications</td>
243       <td>&nbsp;</td>
244       <td>8.4</td>
245     </tr>
246     <tr>
247       <td>\bsp</td>
248       <td>2.4</td>
249       <td>&nbsp;</td>
250     </tr>
251     <tr bgcolor="#ddd">
252       <td>\CP64_TC</td>
253       <td>&nbsp;</td>
254       <td>21.2</td>
255     </tr>
256     <tr>
257       <td>\Mot_P3_TvMon</td>
258       <td>68.6</td>
259       <td>&nbsp;</td>
260     </tr>
261     <tr bgcolor="#ddd">
262       <td>\DSR207</td>
263       <td>&nbsp;</td>
264       <td>5</td>
265     </tr>
266     <tr>
267       <td>\dsr207_tvmon</td>
268       <td>5.2</td>
269       <td>&nbsp;</td>
270     </tr>
271     <tr bgcolor="#ddd">
272       <td>\BcmLib_Dsr530</td>
273       <td>&nbsp;</td>
274       <td>5</td>
275     </tr>
276     <tr>
277       <td>\BcmLib_Dsr550</td>
278       <td>11.1</td>
279       <td>&nbsp;</td>
280     </tr>
281     <tr bgcolor="#ddd">
282       <td>\DSR550P3_BSP</td>
283       <td>&nbsp;</td>
284       <td>3.5</td>
285     </tr>
286     <tr>
287       <td>\Documentation</td>
288       <td>&nbsp;</td>
289       <td>30.6</td>
290     </tr>
291     <tr bgcolor="#ddd">
292       <td>\SQA</td>
293       <td>317.9</td>
294       <td>&nbsp;</td>
295     </tr>
296     <tr>
297       <td>\Web</td>
298       <td>112.7</td>
299       <td>&nbsp;</td>
300     </tr>
301     <tr bgcolor="#ddd">
302       <td>\Test</td>
303       <td>30.3</td>
304       <td>&nbsp;</td>
305     </tr>
306     <tr>
307       <td>\Firmware</td>
308       <td>&nbsp;</td>
309       <td>95</td>
310     </tr>
311     <tr bgcolor="#ddd">
312       <td>\echostarUK</td>
313       <td>483.9</td>
314       <td>&nbsp;</td>
315     </tr>
316     <tr>
317       <td>\kylin</td>
318       <td>53.9</td>
319       <td>&nbsp;</td>
320     </tr>
321     <tr bgcolor="#ddd">
322       <td>\CFE</td>
323       <td>&nbsp;</td>
324       <td>25.2</td>
325     </tr>
326     <tr>
327       <td>\brcm_wince</td>
328       <td>1.1</td>
329       <td>&nbsp;</td>
330     </tr>
331     <tr bgcolor="#ddd">
332       <td>\Tools</td>
333       <td>&nbsp;</td>
334       <td>7</td>
335     </tr>
336     <tr>
337       <td>\Motorola_lib</td>
338       <td>6.3</td>
339       <td>&nbsp;</td>
340     </tr>
341     <tr bgcolor="#ddd">
342       <td>\MOT_97320</td>
343       <td>&nbsp;</td>
344       <td>10.5</td>
345     </tr>
346     <tr>
347       <td>\BcmLib_Dsr580</td>
348       <td>3.3</td>
349       <td>&nbsp;</td>
350     </tr>
351     <tr bgcolor="#ddd">
352       <td>\BcmLib_Dsr580_Venom2_P2</td>
353       <td>&nbsp;</td>
354       <td>4.7</td>
355     </tr>
356     <tr>
357       <td>\BcmLib_Dsr500</td>
358       <td>&nbsp;</td>
359       <td>11.1</td>
360     </tr>
361     <tr bgcolor="#ddd">
362       <td>\BCM_HAL</td>
363       <td>24.4</td>
364       <td>&nbsp;</td>
365     </tr>
366     <tr>
367       <td>\DVI3K</td>
368       <td>15.1</td>
369       <td>&nbsp;</td>
370     </tr>
371     <tr bgcolor="#ddd">
372       <td>\DViTV</td>
373       <td>&nbsp;</td>
374       <td>3.1</td>
375     </tr>
376     <tr>
377       <td >\DSR550P3</td>
378       <td>&nbsp;</td>
379       <td>21.6</td>
380     </tr>
381     <tr bgcolor="#ddd">
382       <td>\ArchiveSetTop</td>
383       <td>189.8</td>
384       <td>&nbsp;</td>
385     </tr>
386     <tr>
387       <td>\Dvtsw</td>
388       <td>296</td>
389       <td>&nbsp;</td>
390     </tr>
391     <tr bgcolor="#ddd">
392       <td>\TestPriv</td>
393       <td>&nbsp;</td>
394       <td>3</td>
395     </tr>
396     <tr>
397       <td>\bxUCM_support_7315sc</td>
398       <td>4</td>
399       <td>&nbsp;</td>
400     </tr>
401     <tr bgcolor="#ddd">
402       <td>\HAL_test</td>
403       <td>&nbsp;</td>
404       <td>1.8</td>
405     </tr>
406     <tr>
407       <td>\BCM_test</td>
408       <td>10.2</td>
409       <td>&nbsp;</td>
410     </tr>
411     <tr bgcolor="#ddd">
412       <td>\UCM-CQTest</td>
413       <td>&nbsp;</td>
414       <td>31.1</td>
415     </tr>
416     <tr>
417       <td>\delivertest</td>
418       <td>0.5</td>
419       <td>&nbsp;</td>
420     </tr>
421     <tr bgcolor="#ddd">
422       <td>\UCMrmcomp</td>
423       <td>&nbsp;</td>
424       <td>0.4</td>
425     </tr>
426     <tr>
427       <td>\UCM-Test</td>
428       <td>3.6</td>
429       <td>&nbsp;</td>
430     </tr>
431     <tr bgcolor="#ddd">
432       <td>\BSE-SYS</td>
433       <td>&nbsp;</td>
434       <td>8.8</td>
435     </tr>
436     <tr>
437       <td>\A1</td>
438       <td>0.3</td>
439       <td>&nbsp;</td>
440     </tr>
441     <tr bgcolor="#ddd">
442       <td>\echostar</td>
443       <td>600.6</td>
444       <td>&nbsp;</td>
445     </tr>
446     <tr>
447       <td>\bknittel_web_pvob</td>
448       <td>0</td>
449       <td>&nbsp;</td>
450     </tr>
451     <tr bgcolor="#ddd">
452       <td>\bknittel_web</td>
453       <td>&nbsp;</td>
454       <td>0</td>
455     </tr>
456     <tr>
457       <td>\ss-test</td>
458       <td>1145.7</td>
459       <td>&nbsp;</td>
460     </tr>
461     <tr bgcolor="#ddd">
462       <td>\last</td>
463       <td>&nbsp;</td>
464       <td>0</td>
465     </tr>
466     <tr>
467       <td>\bxUCM_proj</td>
468       <td>3.4</td>
469       <td>&nbsp;</td>
470     </tr>
471     <tr bgcolor="#ddd">
472       <td>\bxUCM_support</td>
473       <td>&nbsp;</td>
474       <td>11.3</td>
475     </tr>
476     <tr>
477       <td>\bxUCM_system</td>
478       <td>0.8</td>
479       <td>&nbsp;</td>
480     </tr>
481     <tr bgcolor="#33ccff">
482       <td><b>Total</b></td>
483       <td><b>7067.6</b></td>
484       <td><b>7080.9</b></td>
485     </tr>
486   </tbody>
487 </table>
488
489                               
490                               <p class="entry-footer">
491                                  <span class="post-footers">Posted by  at  4:29 PM</span> <span class="separator">|</span> <a class="permalink" href="http://defaria.com/blogs/Status/archives/000441.html">Permalink</a>
492                                  
493                                  
494                               </p>
495                            </div>
496                         </div>
497                      </div>
498                      
499                      
500
501                      <h2 class="date-header">October  4, 2005</h2>
502                      <a id="a000440"></a>
503                      <div class="entry" id="entry-440">
504                         <h3 class="entry-header">rgy_swtichover/Triggers</h3>
505                         <div class="entry-content">
506                            <div class="entry-body">
507                               <ul>
508   <li>Responded to IBM Rational Support regarding rgy_switchover</li>
509
510   <li>Added prohibit_operation to trigger list</li>
511
512   <li>Instituted the <i>evil twin</i> trigger</li>
513
514   <li>Obtained Chris' CQ merge scripts and started looking in to that</li>
515
516   <li>Went back to analyzing the PQA CQ data for invalid characters</li>
517 </ul>
518                               
519                               <h3>rgy_switchover</h3>
520
521 <p>IBM Rational responded</p>
522
523 <blockquote>
524   <p>Steven Chaves wrote:</p>
525
526   <p>Andrew,</p>
527
528   <p>Even though there is no documentation saying that about DHCP, UNIX, and Clearcase environment, I would agree with you that rgy_switchover is useless in your situation. It seems to have no problem if you have no Interop environment. I believe that documents show say that works for one platform not Interop environments.</p>
529 </blockquote>
530
531 <p>My response to this was:</p>
532
533 <blockquote>
534   <p>Where in the documents does it state that rgy_switchover is only supported in non interop environments?</p>
535
536   <p>I would think that it would be fairly common to have a Clearcase shop in which there are some Unix servers and many Windows clients - even Unix/Linux clients. You are saying that in such environments rgy_switchover is essentially broken in that it doesn't accomplish what it was intended to do.</p>
537
538   <p>I feel, but have not managed to proof yet, that if the Windows machine name resolved through DNS then rgy_switchover would work fine. Can you test this scenario? Create an environment where you have two Unix servers, one being the primary registry server and the other the backup registry server. Have 4 clients, 2 Unix and 2 Windows with DHCP assigned IP addresses. Configure 1 Windows machine with a machine name that resolves in DNS via nslookup to it's IP address. The other Windows client's machine name should not resolve in DNS. Same thing with the Unix machine, one resolves, one doesn't.</p>
539
540   <p>Then do rgy_switchover. I think you will find that all machines whose names resolve to IP addresses through DNS will switchover and all machines whose names don't resolve in DNS will fail to switchover.</p>
541
542   <p>If that's the case then the documentation should clearly indicate that rgy_switchover will fail on any machine whose name does not resolve to it's IP address in DNS.</p>
543
544   <p>Ray, why don't Windows machine names (e.g. my machine - ltsjca-adefaria) resolve in DNS using nslookup? I think it is possible to set it up so that Windows machine names resolve in DNS and are still DHCP assigned.</p>
545 </blockquote>
546
547 <h3>Prohibit Operation</h3>
548
549 <p>Many companies add a trigger such that any new element created is immediately changed to be owned by vobadm. This way individuals do not own the element - vobadm does - which is closer to say "these aren't your elements - they are the company's". It also has the nice side effect of automatically disallowing certain potentially dangerous operations like rmelem from being done by non-owners. So then only vobadm can rmelems.</p>
550
551 <p>Here at Broadcom they take a different approach: Rather than changing ownership to vobadm they put a trigger on rmelem and rmver with an -nuser vobadm. I'm not sure I agree with not allowing users to rmver.</p>
552
553 <p>Luckily I was able to add -nusers vobadm to the "Type" line in triggers.dat and it was just passed along. We really should implement an "Options" line for additional options.</p>
554                               
555                               <p class="entry-footer">
556                                  <span class="post-footers">Posted by  at 11:30 AM</span> <span class="separator">|</span> <a class="permalink" href="http://defaria.com/blogs/Status/archives/000440.html">Permalink</a>
557                                  
558                                  
559                               </p>
560                            </div>
561                         </div>
562                      </div>
563                      
564                      
565
566                      <h2 class="date-header">October  3, 2005</h2>
567                      <a id="a000439"></a>
568                      <div class="entry" id="entry-439">
569                         <h3 class="entry-header">SJ Vob move/Triggers</h3>
570                         <div class="entry-content">
571                            <div class="entry-body">
572                               <ul>
573   <li>Discussed how to best handle the upcomming SJ vob move</li>
574
575   <li>Added handling for UCMOBJECT triggers and the few additional triggers on the docs vob</li>
576 </ul>
577                               
578                               <h3>SJ Vob Move</h3>
579
580 <p>I got to thinking over the weekend more about this vob move and trying to tie it to why we are moving the vobs. If we are trying to gain performance then how do we know that this move will accomplish that? It occurred to me that we have not adequately identified the performance problem we are trying to solve. If performance is the issue then just changing architectures is not likely to solve that problem.</p>
581
582 <p>Lacking any real description of the performance problem the users are experiencing the best we can do is optimize performance for vob service. In general, Rational recommends that you do not over load a server with too many vobs. More specifically you need to be concerned about the total size of your vob databases. What you are trying to do is insure that you have enough memory to fit the databases of the most commonly used vobs.</p>
583
584 <p>The old Solaris machine has 1 CPU and 4 gig of memory. The new Linux box also has 4 gig of memory but 2 CPUs. Observation reveals that the Solaris machine is not CPU bound - increasing CPU horsepower or number of CPUs will not increase performance.</p>
585
586 <p>I feel the best course of action at this point would be to identify the commonly used vobs and separate them between the Solaris and Linux machines thus decreasing the load on both servers, increasing the overall amount of memory (8 gig - 4 on one and 4 on the other) and allow for parallelization. Additionally, only 1/2 of the data need move. Need to sell this to Jennifer and Chin.</p>
587                               
588                               <p class="entry-footer">
589                                  <span class="post-footers">Posted by  at  7:50 PM</span> <span class="separator">|</span> <a class="permalink" href="http://defaria.com/blogs/Status/archives/000439.html">Permalink</a>
590                                  
591                                  
592                               </p>
593                            </div>
594                         </div>
595                      </div>
596                      
597                   </div>
598                </div>
599             </div>
600          </div>
601       </div>
602    </div>
603 </body>
604 </html>