M&TA STATUS - (2000-Apr-24)


NEW RELEASE CODE SINCE Jan 2000:

1) Monitoring EGG (MEG) MTA_MONITOR_PSUEDO
	- From L1 DATA create
	  +MTA summary file containing sums/products etc of data from 
		other files
	  +A plot of new msids via usual web pages (new links)

	Purpose  create new pseudo MSIDS for monitoring
	Procedure- take incoming MSIDS, X,/,+-,AVG as needed. 
		(must be able to function on PMSIDS and MSIDS)
	Output  new file for input/output to MTA monitor static
	Status: spec COMPLETE
	Status: functionality COMPLETE
	Status: pipeline COMPLETE
	Status: DB 0%  Science need to send DBDEV 1 new DB table spec.
	Priority MTA DONE
	Priority DB, part of second DB set 

CLOSED ISSUES - Since Jan 2000:

  1. (BUG 1765) MTA PERL SCRIPT: /usr/bin/perl --> /opt/local/bin/perl
  2. (BUG 1797) MTA_EVT2IMG: Empty image created when counts/pixel > 32767
  3. (BUG 1713) MTA_MONITOR_EVENTS - Object name on first page does not carry past the space (i.e. NGC 2516 --> NGC) this appears correctly on deeper --> --pages.(back in daily)
  4. (BUG 1727) MTA_MONITOR_GRATINGS file size limitation.
  5. (BUG 1774) MTA_MONITOR_STATIC bug in the results of TLEVART, VLEVART and SHEVART
  6. MTA_MONITOR_STATIC Y2K buglet (Year=100)
  7. cti_main.html DONE The OBSIDS should be arranged more horizontally. (i.e. start a new row after each 8 OBSIDS, not each 1.
  8. cti_main.html DONE the should be a link at the top of this page to a page of plots
  9. cti.html DONE below the array, above time stamp should be a table with S/I summary info
  10. (ENH 1479) DONE MTA_MONITOR_STATIC - On summary pages, please arrange items with same error score in alphabetical order.
  11. (ENH 1720) DONE MTA_MONITOR_EVENTS - only report event files which contain events. (This supersedes the previous request to only Monitor HRC events from format 1)
  12. (ENH 1787) MTA_MONITOR_EVENTS: Histogram binsize for ACIS fltgrade is too high
  13. (ENH 1718) DONE MTA_MONITOR_STATIC - when calculating STDEV, please reject the 5 highest and lowest values before making the calculation, unless there are less than 20 values.

CURRENT ISSUES - Released Code:

  • BUGS:

    1. priority 1
      • (BUG 1832) MTA_CHECK_LIMITS: empty output file created if input file empty
      • (BUG 1768) MTA_MONITOR_GRAD: mta_calc_grad exit with status 11 pipeline dies
      • MTA_MERGE_REPORT Older than 4 months- unseen, untested
    2. priority 2
      • (BUG 1773) ACORN: year = 100 on alert messages.
      • (BUG 1717) Older than 4 months ACORN - ACORN does not seem to calibrate EOCHRGBn (n=1,2,3) correctly. The uncalibrated value ranges from 1 to 10000, corresponding to battery state of charge between 0 and 1. The ACORN calibrated value is: 0.84 when the uncalibrated value is 8400 10000 when the uncalibrated value is 10000.
      • MTA_MONITOR_ACA Older than 4 months- unseen, untested
      • (BUG 1715) Older than 4 months AP - as currently run (in "burst mode") does not support M&TA latency requirements. There has been no progress here in four months as emphasis is on reprocessing.
    3. priority 3
      • (BUG 1727) MTA_MONITOR_GRATINGS: No Gratings Reports generated
      • MTA_MONITOR_GRATINGS Older than 4 months we need to update AP registries so this runs on all L1 products which don't have gratings + all gratings products. We need to measure aspect w.r.t. X,Y not detx dety.
      • MTA_MONITOR_GRATINGS Older than 4 monthsI haven't seen the current release run so I can't address whether it deals with zero order correctly. The code available to science does.
      • MTA_MONITOR_GRATINGS Older than 4 monthshas a whole series of DB requirements currently unmet.
    4. ENHANCEMENTS: (priority 4)

      • (ENH 1711) Older than 4 months ALL - No versioning if FITS header (all read 0.0)
      • (ENH 1724) MTA_CTI_MON
        1. DONE Add Start/stop Time to each page
        2. Add Cold radiator temperature to each page
        3. DONE create archival file containing all numeric values on page (including time and temp)
      • (ENH 1480) MTA_MONITOR_STATIC - On summary pages, please calculate the median, not the average (priority 5).
      • (ENH 1719) MTA_MONITOR_EVENTS - zoom items should be recentered.
    5. MTA Databases

      • 15 (check) speced and built being tested
      • Integration to be complete by May 20 (as of April 18)
      • Population to begin June 1 (as of April 18)
      • Specs for 5 additional Databases due June 30
      • Final 5 databases due September 30
      • Data seeker underdevelopment
        • expected usable by September 1
        • First automated trends by October 1
        • Note: simple trending already carried out by DOSS direct software.
    6. MTA Problem Response System:

      • REALTIME : safemode
      • AP : OFF
      • the list of monitored values is ready to go SOT has been running it for a month on RT with emails going out daily. The issue is that every time ACORN goes down, it "forgets" the spacecraft status and thus will re-alert for an existing problem. We need to devise a way to keep the ACORN object alive as much as possible and slip it dump data on an as available basis. This suggest reading dump data into a UDP port.
    7. SDP

      • No L1 files marked for MTA_STATIC

      OVERDUE :

      1. ACA_MON - This is the L1 Aspect monitoring and trending. late from 3/15/1999 turnover. (underway) (Priority 2)
      2. ACA_TRD - This is the L1 Aspect monitoring and trending. (priority 3)

      FUTURE RELEASES :

      Priorities (1-highest (up to 3) , 10-lowest (up to 30))
      
      1) Data Seeker MTA_DATA_SEEKER
      	Speced separately
      	Status: needs DBs 15 of 21 are well defined,
      	When 10 are done finish data seeker
      	1 month JGP
      	When 10 are done deliver specs for others as available,
      	ISSUES; logistic, how will this work, crontab? AP?
      
      
      
      
      2) L2 MON (MTA_SOURCE_MON)
      	Speced separately,
      	Priority 5  JGP 1 Month after stable L2 source lists.
      
      
      
      3) SI-Background MTA_SIB
      	- From L2 DATA create a mask of sources
      	  +Remove these regions from the L1 data product.
      	  +create table of  /counts/time (~5 min) /energy bin
      	  +create plot of /counts/time (~5 min) /energy bin vs time
      	Purpose, track the background rate of the SIs and the sky.
      	Procedure- remove all sources from an event List.
      		Calculate /counts/time (~5 min) /energy bin
      		Energy bin and time window are parameters
      	Output: to web: tables, per OBI
      	OUTPUT to DB: RA, DEC, TIME, calculated quantities NEW DB.
      	Status :Abbey's tool almost done, no other code.
      	Priority MTA 7  RO 2 months.
      
      
      
      4) HRC/ACIS_DOSE (MTA_HRC_DOSE)
      
      	Purpose Monitor HRC dosage/pore Alert scientists if problem
      	Procedure-PerOBI make list of events/ pore pair
      		Each week create dose image/list 
      		Use (coadd/ Dmcopy )last 4 weeks to create last month
      		Use last 52 weeks to create last year 
      		Use all weeks to create mission
      	Notes: use chip coords
      	Note:  well developed may have out paced DM tools
      	Note; if cnt/pore GT Y Alert yellow, GT R RED, 
      	Note Y and R are different for the /OBI and the Weekly and the monthly etc.
      	Output Web page Hottest pores table
      	Output DB, dose list/images
      	Output  for all pore GT D, CX,CY, Total dose 
      	Status: spec 80%
      	Status tool 80%
      	Status pipeline 40% understood, not implemented 
      	Status DB 0%
      	Priority MTA 5 JGP 3 weeks
      	Priority DB 5 -AE 2 weeks	
      
      
      
      5) Monitor - DEA HOUSEKEEPING - spec delivered 3/22/99. Being handled
      through Direct DOSS tools.
      
      
      6)MTA_ACIS_CCD_MON-
      	 - From ACIS L1 Event list create
                 + Histograms
                     o pha
                     o pi
                 + Plots
                     o pha histogram
                     o pi histogram
                     o cnts vs time ( per chip )
      
      	purpose: monitor CTI, and general ACIS performance
      	procedure  OPEN ACIS L1 event lists create fixed plots and histograms
      	procedure  Open ACIS BIAS files create fixed plots 
      	output  to web pages: the plots /per obi or per bias
                    output  to DB #G64, #G2, #G8 ,#G16, Node_ID, CCD_ID. Obsid.
      	Output  to DB BIAS data: FWHM, meadn, meadian, mode, min, max,
      		node_id,ccdid, obsid.
      		THE OTHER SUMMARY INFO IN THE SPEC IS LESS IMPORTANT
      			AT THIS TIME.
      	Status: Spec 90%
      	Status: tool 90%
      	Status: Pipeline 10%
      	Status: DB 0% ; Takashi is able to use data though
      	Status; Integ Good, AP can handle this tool.
      	Priority MTA 5  JGP 2 weeks
      	Priority DB     2 AE  2 weeks
      
      
      
      
      7)Configuration tool: MTA_CHANDRA_CONFIG
      	- From RAW DATA create
      	  +tab delimited files 1 new record when each tracked value
      		changes
      	  +A plot of the spacecraft configuration vs. time
      
      	Purpose -create an easy access mission history
      	Procedure- Run ACORN TC on all dumps and associated procedures
      		developed by SJW/TI
      	Traced quantities (HRC- S HV, HRC-I HV, ACIS CR (2) ,GRAT POS
      		(4) SIM POS (2), OBSID, FMT
      	Output- to web pages:- plot of traced quantities
      	Output to DB: single file with all traced quantities throughout
      		mission (RDB and fits)
      	
      	Issue how to we manage the data product, Write the RDB to the 
      		web page and constantly replace/update FITS file.
      	
      	Status: spec 100% 
      	Status tool  100%
      	Status Pipeline  25% defined and working as cron tab
      	Status integ 50% - should be implemented as part of MTA
      		monitor_RAW?  Or as separate version of it RAWII.
      	Priority MTA 5  it works as is  RO/DP 1 month to integrate
      	Priority DB    4  ditto
              Currently handled through Direct DOSS tools.
      
      
      8)MTA_PRS  REVAMP
      	Prioity MTA 6 RO 1 Month
      
      
      
      	
      9) Integrations Tool (IT)
       	Time comps on DB items
      	I.e. RPMs * time = rotations.
      	Status undone I think this is a pure DB app,   DB priority 6.
      
      
      
      
      
      
      
      
      
      
      

      Lower priority

      1. FLAG - still unstable, these need to be fixed (Priority 7)
      2. Processing speed. (priority 9)
      3. Bias_Mon (priority 7)
      4. Check_ACIS LOAD (priority 7) spec delivered to ISOBE, Shanil will develop.
      5. ACIS configuration (priority 7) ibid
      6. Merged Status files. (priority 7)
      7. Determine pointing offsets - DOSS direct development underway.
      8. MTA DI - string handling. - PSUEDO code exists (Priority 7)
      9. Trend HRMA focus (this covers 10 MTA tasks & gets complicated) (priority 7) -Scheduled for DOSS development June 2000.
      10. SIM positional accuracy tool (includes repeatability, settling time and hysteresis.) This is being handled in by DOSS direct right now (priority 8)

    December 2000

    1. Other issues - Highest priority -9
    2. ACIS trending
    3. HRC trending
    4. PCAD trending
    5. Other issues - Lower priority -10
      • Counting tools
      • Detect flickering pixels on ACIS
      • Monitor CCD/HRC/SIM tilts (Part of ACA Mon)
      • Determine grating orientation (Part of grate_mon)
      • Dump and compare is on indefinite hold.