Status for Andrew DeFaria

• Further developed Mail.pm. Added code to send HTML mail. HTML mail not completely working yet
• Worked on problems with ccase-rmna-3
• Assisted Ray in some Perl coding issues

Posted by at 4:48 PM | Permalink

• Developed Mail.pm module
• Working with Rational about CQ Web hang problem

Posted by at 7:56 PM | Permalink

• Standardized some modules a little bit
• Added much more functionality to Clearcase modules and tied that into stats and log_activity
• Changed the startup of many scripts to be more standard
• Implemented much more functionality in stats

Odd characters in view tags

I found this odd view tag in the SanJoseNT region:

ccase-sj1-1:ct lsview -long -region SanJoseNT helenay_PIRelease_12022002_7031RC\)
Tag: helenay_PIRelease_12022002_7031RC)
  Global path: \\Pc-1ubrv\Myview\helenay.v.vws
  Server host: Pc-1ubrv
  Region: SanJoseNT
  Active: NO
  View tag uuid:132d6e50.0eee11d7.a7a4.00:b0:d0:20:ba:8a
View on host: Pc-1ubrv
View server access path: F:\Myview\helenay.v.vws
View uuid: 132d6e50.0eee11d7.a7a4.00:b0:d0:20:ba:8a
View attributes: snapshot
View owner: BROADCOM\helenay

Note the trailing ")" in the view tag. Alas this screws up Perl scripts when one may take a view tag and include it in a cleartool cmd:

`cleartool lsview -long -region SanJoseNT $view_tag 2> /dev/null`

when $view_tag is the above results in:

sh: -c: line 1: syntax error near unexpected token `)'
sh: -c: line 1: `cleartool lsview -long -region SanJoseNT helenay_PIRelease_12022002_7031RC) 2> /dev/null'

I don't think I should write code to escape such characters but what else can I do? We could ask this user to rename their view but apparently Clearcase does not disallow such strange characters in view tag names (and perhaps other objects...).

DNS Issues

Kerrynn De Roche wrote:

I just checked the etc/hosts and it seems we had last set the entries to 128.34 instead of 128.37. I changed them to 128.37 and it seems to be working now...

10.136.128.37 has always been the IP address of ccase-rmna-4. If you had previously had 10.138.128.34 then that was what was wrong (with that workaround).

I would rather not have to worry about having to check the hosts file whenever the IP address changes though.

You see that's the difference between desktops and servers - server IP addresses never (or at least rarely) change. In fact in the administration business, keeping the servers IP address static is always a consideration - even if the machine is being swapped. We'll swap the IP addresses in DNS to the new machine to keep them the same precisely because of these issues. ccase-rmna-4's IP address will not change!

What is the method you use to not have to worry about hosts file?

As I said, in my environment it works without /etc/hosts:

Local:cat /etc/hosts
# Copyright (c) 1993-1999 Microsoft Corp.
#
# This is a sample HOSTS file used by Microsoft TCP/IP for Windows.
#
# This file contains the mappings of IP addresses to host names. Each
# entry should be kept on an individual line. The IP address should
# be placed in the first column followed by the corresponding host name.
# The IP address and the host name should be separated by at least one
# space.
#
# Additionally, comments (such as these) may be inserted on individual
# lines or following the machine name denoted by a '#' symbol.
#
# For example:
#
#      102.54.94.97     rhino.acme.com          # source server
#       38.25.63.10     x.acme.com              # x client host
127.0.0.1       localhost laptop
#10.136.128.37  ccase-rmna-4

Note ccase-rmna-4's entry is commented out. Additionally I do not have ca.broadcom.com on the DNS Suffix Search List:

Local:ipconfig /all

Windows IP Configuration

        Host Name . . . . . . . . . . . . : LTSJCA-ADEFARIA
        Primary Dns Suffix  . . . . . . . : corp.ad.broadcom.com
        Node Type . . . . . . . . . . . . : Hybrid
        IP Routing Enabled. . . . . . . . : No
        WINS Proxy Enabled. . . . . . . . : No
        DNS Suffix Search List. . . . . . : corp.ad.broadcom.com
                                            broadcom.com

Ethernet adapter Wireless:

        Media State . . . . . . . . . . . : Media disconnected
        Description . . . . . . . . . . . : Broadcom 802.11g Network
Adapter
        Physical Address. . . . . . . . . : 00-10-18-90-1D-11

Ethernet adapter Secondary:

        Media State . . . . . . . . . . . : Media disconnected
        Description . . . . . . . . . . . : 3Com 3C920 Integrated Fast Ethernet        Controller (3C905C-TX Compatible) #2
        Physical Address. . . . . . . . . : 00-08-74-95-4A-24

Ethernet adapter Primary:

        Connection-specific DNS Suffix  . : broadcom.com
        Description . . . . . . . . . . . : 3Com 3C920 Integrated Fast Ethernet        Controller (3C905C-TX Compatible)
        Physical Address. . . . . . . . . : 00-B0-D0-0E-A2-71
        Dhcp Enabled. . . . . . . . . . . : Yes
        Autoconfiguration Enabled . . . . : Yes
        IP Address. . . . . . . . . . . . : 10.16.65.219
        Subnet Mask . . . . . . . . . . . : 255.255.240.0
        Default Gateway . . . . . . . . . : 10.16.64.1
        DHCP Server . . . . . . . . . . . : 10.16.192.15
        DNS Servers . . . . . . . . . . . : 10.16.64.11
                                            10.16.64.12
                                            10.16.64.13
        Primary WINS Server . . . . . . . : 10.16.192.15
        Secondary WINS Server . . . . . . : 10.16.192.16
        Lease Obtained. . . . . . . . . . : Tuesday, January 03, 2006 8:29:46 PM
        Lease Expires . . . . . . . . . . : Friday, January 06, 2006 8:29:46 PM

So I don't have any kind of workaround any more. It just works. By that I mean the following command used to fail stating a WINSOCK error trying to contact ccase-rman-4:

Local:ct lsstream -invob \\rmna_projects

(Note ct is aliased to cleartool and since I'm using Cygwin "\\" collapses to a single "\"). Now this command works for me. Note that nslookup of a bare ccase-rmna-4 still fails for me:

Local:nslookup ccase-rmna-4
*** dns-sj1-1b.sj.broadcom.com can't find ccase-rmna-4: Non-existent domain
Server:  dns-sj1-1b.sj.broadcom.com
Address:  10.16.64.11

This is because ccase-rmna-4 (and case-rmna-4.corp.ad.broadcom.com and ccase-rmna-4.broadcom.com from the DNS Suffix Search List) don't exist - it should be case-rmna-4.ca.broadcom.com. But a FQDN works:

Local:nslookup ccase-rmna-4.ca.broadcom.com
Non-authoritative answer:
Server:  dns-sj1-1b.sj.broadcom.com
Address:  10.16.64.11

Name:    ccase-rmna-4.ca.broadcom.com
Address:  10.136.128.37

The way resolver(3) (DNS's name resolution) works is to look at files like /etc/hosts and/or apply DNS Suffix Search Lists. So if DNS found ccase-rmna-4 in /etc/hosts it would have it's IP address. Otherwise it'll take a bare hostname of ccase-rmna-4 and append the suffixes. So if you added ca.broadcom.com to the list that also should work.

However the whole reason that Clearcase is using ccase-rmna-4 is because that's what was listed in the vob tag:

Local:llvob \\rmna_projects
Tag: \rmna_projects
  Global path: \\cc-rmna-storage\ccstgloc-cabu\vobstore\rmna_projects.vbs
  Server host: ccase-rmna-4.ca.broadcom.com
  Access: public
  Mount options: 
  Region: rmnaNT
  Active: NO
  Vob tag replica uuid: 088b79e0.0b0c11d9.9204.00:01:80:c8:b5:2d
  Vob on host: ccase-rmna-4.ca.broadcom.com
Vob server access path: /projects/ccstgloc-cabu/vobstore/rmna_projects.vbs
Vob family uuid:  09d0e19e.8b6611d5.b03b.00:01:80:c8:b5:2d
Vob replica uuid: 088b79e0.0b0c11d9.9204.00:01:80:c8:b5:2d
Vob registry attributes: ucmvob,replicated

but as you can see we fully qualified ccase-rmna-4 to ccase-rmna-4.ca.broadcom.com. This means that this should work without an /etc/host workaround or an "add to DNS Suffix Search List" workaround. Why that's not working remains a mystery.

Posted by at 6:19 PM | Permalink

• Started creating a Clearcase.pm module to hold site specific Clearcase information
• Created OSDep.pm
• Worked with the Help Desk to attempt to fix problem with Windows Update

Posted by at 6:09 PM | Permalink

• Documented set up of CVS SCP connector
• Added more functionality to Clearcase::Vob
• Coded up a preliminary stats script

CVS CSP Connector

I've updated CVS CSP Connector documentation to add a description of the CVS administrative files that need to be changed. You'll note at the bottom that the only issues that remain are where to apply this CVS CSP Connector to. I believe we were waiting for David to respond as to the design.

The other issue that I noted was about how to handle branches. IOW do we need to include the branch name in the change set that we append. With the Clearcase CSP Connector the view extended pathname is what is put into the change set. As you know, Clearcase's view extended pathname will include branch names. In CVS such branch names are not included. Instead CVS relies on extending the revision number with extra digits. So a revision number of 1.1 would represent something on the main branch while 1.1.2.1 would be on some branch. There is no branch name information in there - one must do a cvs status or log command to find a branch name such as:

Sticky Tag:          andrew-branch (branch: 1.1.2)

then make the association between all 1.1.2.x revisions and andrew-branch above.

If David is OK with a 4, 6, 8, etc. revision number being enough to denote that this file's revision is branched and doesn't need the branch name then cvsims is effectively functionally complete. We just need to perform the CVS Setup described at CVS CSP Connector on the repositories and directories under those repositories that David or others want to enforce the CVS CSP Connector on.

stats

Ray Tran wrote:

Statistic logs - This is a script that would create two logs - one general data for each site, one for each VOB of each site.

The general data should have at the least - date_time;site;number of VOBs; number of total VOB size; number of snapshot views; number of dynamic views; number of file elements; number of directory element;...

I need a little clarification about some of the above...

• How do you define "site"? I take it that in general we have Clearcase region of <site>NT and <site>UNIX. Is that always the case?
• As for #vobs - skip private vobs?
• As for #vobs, #snapshot views and #dynamic views: Which region is that for? As you know most of our stuff is actually in the NT region not the Unix region. Yet I expect that this script will run from the Unix region. I could -region however often that doesn't work. For example, if I'm on Unix and I do the following to interrogate the NT region it fails:
  
  

  ccase-rmna-3:ct lsview -region rmnaNT adefaria_dynamic
    adefaria_dynamic     \\ltsjca-adefaria\Views\adefaria_dynamic.vws
  ccase-rmna-3:ct lsview -full -properties -region rmnaNT 
  adefaria_dynamic
    adefaria_dynamic     \\ltsjca-adefaria\Views\adefaria_dynamic.vws
  cleartool: Error: Unknown host 'ltsjca-adefaria': Host not found
  cleartool: Error: Unable to get view handle: error detected by ClearCase subsystem.
    

  This is our familar "it fails because ltsjca-adefaria does not resolve in DNS" problem. But I need to do this with -full and -properties to determine if the view is a snapshot or dynamic (and/or a ucmview)!

  Normally this would be the result of an lsview with -full and -properties:

      ccase-rmna-3:ct lsview -full -properties phonex_3.0
    phonex_3.0           /projects/ccstgloc-cabu/viewstore/nnalluri/phonex_3.0.vws
  Created 29-Dec-04.16:48:19 by nnalluri.clearusers@ccase-rmna-3
  Last modified 29-Dec-04.16:48:20 by nnalluri.clearusers@ccase-rmna-3
  Last accessed 29-Dec-04.16:48:20 by nnalluri.clearusers@ccase-rmna-3
  Last config spec update 29-Dec-04.16:48:20 by nnalluri.clearusers@ccase-rmna-3
  Text mode: unix
  Properties: dynamic ucmview readwrite shareable_dos
  Owner: richmond/nnalluri : rwx (all)
  Group: richmond/clearusers : r-x (read)
  Other:                  : r-x (read)
  Additional groups: richmond/brcm richmond/users
  richmond/ccadmin richmond/clearcase richmond/cc_ecan richmond/rmna180qa
      

  Also should I do attempt to somehow combine the NT and Unix regions? If so then I'd need to figure out any vobs/views that are tagged in both regions. Or should I only consider the NT region?

• As for #element, how does one determine this? I mean it is possible for somebody to create a new vob, check out the vob root directory to a specific branch, do a clearfsimport of thousands of elements and check in the root directory. From the perspective of a default view (just CHECKEDOUT and main/LATEST) I would not see nor be able to tabulate those thousands of elements... That's an extreme however the point is, with directories being versioned it is really quite difficult to be able to get an accurate count of #elements.
• BTW: It seems the majority of views are hosted on the individuals desktop or laptop and most of the time getting information about such views is near impossible. Often I get a winsock error saying it can't connect to the machine or an "unable to contact albd_server on host...".

The VOB specific data - date_time;site;VOB_name;size of database;size of source pool; size of devired object; size of cleartext; size of admin data.

The directory structure that I envisioned is as such

/projects/scm_tools_logs

-cc

- 2005

- 12

- 01

I have a preliminary version of this working (Need to code up something to get the current site) at SCM/cc/stats. Output for rmna site looks like:

################################################################################

#
# File:         vob.log
# Description:  This file contains a list of all vobs at rmna along with some
#               statistical information.
# Format:       The format of this file is:
#
# date/time;site;VOB name;db size;src size;do size;clrtxt
size;adm size
#
################################################################################

20060102@18:23;rmna;A1;0.3;0.0;0.00.0;0.1;0.4
20060102@18:23;rmna;CommEngine;1569.3;2920.2;0.064.3;0.1;4553.8
20060102@18:23;rmna;NewTest;0.2;0.0;0.00.0;0.1;0.2
20060102@18:23;rmna;OnePhone;1226.7;3007.9;0.0321.0;0.1;4555.7
20060102@18:23;rmna;SpiceBoxSW;114.3;169.3;0.00.0;0.1;283.7
20060102@18:23;rmna;TrainCommEngine;1.6;10.7;0.00.0;0.1;12.4
20060102@18:23;rmna;adm;0.6;277.8;0.0547.0;0.1;825.5
20060102@18:23;rmna;alpha_video;115.9;205.9;0.00.0;0.1;321.8

and

#################################################################################

# File:         rmna.log
# Description:  This file contains statistical information about the vobs/views
#               at this site.
# Format:       The format of this file is:
#
# date/time;site;nbr vobs;total vob size;nbr snapshot;nbr dynamic;nbr ucm;nbr file elements;nbr dir elements
#
################################################################################

20060102@19:58;rmna;57;54222.1;0;10;5;<To be determined>;<To be determined>

Posted by at 2:56 PM | Permalink