" /> Status for Andrew DeFaria: January 2007 Archives

« December 2006 | Main | March 2007 »

January 18, 2007

VOB UUIDs

  • Decided we need to change the Clearcase ID field from a sequential number to one that better represented an instance of a vob tag uniquely. As such we've now made the VOB Replica UUID the key for both the Clearcase record and it's assorted other tables.

January 16, 2007

CC 7.0 Upgrades

  • Installed CC 7.0 on dslabcc03. This was done by first removing CC 6.0. The result was a loss of all registry entries. Brought back the registry from the saved area. Now all better
  • Did an install-over of CC 7.0 on top of CC 6.0 for dslabcc01. This worked even better
  • Performed install-over for dslabcc05

January 12, 2007

Clearcase 7.0

  • Set up vob server on dslabcc05
  • Set up Multisite synchronization between 1, 3 and 5
  • Installed MSHD on 1, 3 and 5

January 11, 2007

Clearcase 7.0

  • Set up lab servers to CC 6.0
  • Created some vobs and views in the 6.0 environment
  • Populated a vob using clearfsimport
  • Replicated vobs amongst the 6.0 servers

January 8, 2007

cclic_report year boundary problem

  • Documented problem with cclic_report and crossing of the new year's boundary

Year boundary problem

I have been working resolving problems with the cclic_report for this month. The script to do this has been failing due to a subtle bug in the algorithm used for obtaining the necessary files to translate the various user IDs and map them to Org 9 numbers and the like.

The script looks in a series of files out on the file system in order to obtain information to build mapping tables it needs to do the translation. These files are of the form:

/data/cmetrics/recv/<site>/<type>.<year>/<date>

Where:

site
A site designator. This is one of: dal-design (Dallas), nice-design (Nice), tii-shared (Bangalore) or vorlagenkontoliste (Vorlagenkontoliste)
type
The type of map. This is one of: passwd, aids or sbes
year
The current year
date
The current date in YYYY-MM-DD format

These files are automatically generated by dsmetrics however they are not guaranteed to be up to the minute. The script attempts to workaround this by first starting with the current day then working backward one day at a time for up to 30 days. Thus if say /data/cmetrics/dal-design/passwd.2006/2006-12-31 has not yet be generated 2006-12-30 will be checked, then 2006-12-29 and so on.

Problem is that that algorithm assumes that the data store (e.g. /data/cmetrics/<site>/<type>.<year>) has at least 30 days of information. This assumption breaks when the year changes since the year is contained in the parent directory. So, for example, given today is 1/8/2007, if .../passwd.2007/2007-01-08 has not be generated we can only check for 07, 06, .., 01. Checking for .../paswd.2007/2006-12-31 makes no sense and will never work.

Updating of the various files under /data/cmetrics seems sporadic. Currently the script is still not runnable as there is no /data/cmetrics/recv/tii-shared/password.2007 entries at all! The script is failing with:

$ ./cclic_report.pl -v
cclic_report.pl (v{VERSION}) starting
Getting full path to data files
Unable to find /data/cmetrics/recv/tii-shared/passwd.2007/2006-12-10 at ./cclic_report.pl line 137
        main::findFile('/data/cmetrics/recv/tii-shared/passwd.2007') called at ./cclic_report.pl line 249

I can see no real quick or easy solution for this except to wait for tii-shared's 2007 files to be generated...

January 5, 2007

Checkpoint

  • Checked in recent changes to GPDB and its associated scripts
  • gpdb_add_project:
    • Added interrupt handling
    • Moved logic that determines what site a machine is in from here to gpdb.pm
    • Fixed but in checking "no such map" from NIS
  • gpdb_add_vob:
    • Added function prototypes
    • Changed to put together list of vobs from all regions
    • Added getting of Vob Family UUID and Vob UUID
    • Now using gpdb_currentSite
  • gpdb_convertuk:

    • Added function prototypes
  • gpdb.pm:
    • Reorganized export list
    • Added gpdb_mklink_user_to_site, gpdb_mklink_user_to_project, gpdb_unlink_user_from_project, gpdb_unlink_user_from_site
    • Implement gpdb_siteForHostname. This routine returns the site name for the passed in hostname (default localhost)
    • Implemented gpdb_getuserByID
    • Changed handling of retunred %ccdefaults
    • Changed gpdb_getProject to properly return the retired flag
    • Change gpdb_putProject to call gpdb_mklink_user_to_project
    • Renamed siteName and projectName to gpdb_siteName and gpdb_projectName respctively
    • Implemented gpdb_siteAdmins. This returns an array of AXIDs who are site admins
  • tables.sql:
    • Added family_uuid and vob_uuid

Nice is not so "nice"

  • Changed gpdb_add_vob.pl to use Rexec.pm in order that it may be able to collect information about vobs from other sites

gpdb_add_vob.pl and other sites

It was hoped that we cout point things to "login servers" instead of machines specifically designated as DesignSync servers as had been the case for gpdb_add_project.pl. These script really only require cleartool and access, through the automount map, to the sync_custom area in order to pick up the SiteRegistry.reg file.

However gpdb_add_vob.pl uses a heuristic in an attempt to determine what project a particular vob is associated with. The heuristic states that the vob storage path will have as part of it's path, a project directory. While this is often, but not always, the case here in Dallas, it is not the case at all in Nice! Thus, even though gpdb_add_vob.pl can log into remote sites to gather information about vobs, when logging into Nice it finds that no vob in Nice adheres to this convention and thus it cannot add vob records for any vob in Nice. Nice had been using vob attributes for things like the AID of the owner of the vob but there is no attribute for the project that a vob is associated with!

January 4, 2007

gpdb_add_vob.pl

  • Changed gpdb_getProjectsAtSite to be able to separately return all Clearcase projects, Designsync projects, Clearcase & Designsync projects, projects without Clearcase or Designsync associated with them
  • Modified gpdb_add_vob.pl to traverse through all regions of current registry server to collect all vob tags
  • Modified clearcase record to include fields for VOB Family uuid and VOB uuid. Also modified gpdb_add_vob.pl to get these uuids
  • Investigated Victor's CC Metrics database
  • Fixed bug in gpdb_add_vob.pl that was adding clearcase records assigned to the wrong site.

January 3, 2007

Site Admins

  • Changed gpdb_convertuk.pl to properly add mapping records for Site Admins
  • Changed Single Site Display to display Site Admins
  • Change Single Site Display to include all information from Excel design spreadsheet from Bill. Also tightened up display of cc_defaults
  • Added new gpdb_siteForHostname that returns the site for a given hostname. Default is current host. Uses nslookup to retrieve the CNAME for the host