TAPAS Operation Guide

Note: e-mails in examples use (at) just in case.

Operation

database

The TaPaS database is a mysql data base on mrt-lx3. Program mysqld has to be running.

datafiller

Messages

Accounts

Note: Tapas account are noew created as part of the ProjectManagement.

Each project to be scheduled shall have a TAPAS account. Project account can be created semiautomatically from a list provided by the "scheduler" (CT) or from the bi-weekly planning web page.

Create an account manually

Example:

archive@mrt-lx3:~/archive/wb$ ./createUser.py
enter user, first_name, last_name, email, project: 002y09' '002-09' 'Biver N.' 'x(at)y' '002-09'
# or
./createUser.py '002y09' '002-09' 'Biver N.' 'x(at)y' '002-09'

Create accounts from from project list

Example of projects2009.lis:

archive@mrt-lx3:~/archive/wb$ head -6 projects2009.lis ; echo "..." ; tail -3 projects2009.lis
list of schedulable proposals
5-Feb-2010
format: proposal ID = PI(s) = email = week of schedule = UTS start = UTS end = status 
        -1 means no entry in the DB (prop not yet or never scheduled)

002-09 = Biver N. = x(at)y = 44 = 1256828400 = 1256839200 = continue 
...
D17-09 = LeBourlot J. = x(at)y = 11 = 1269090000 = 1269194400 = scheduled 
D18-09 = Omont A. = x(at)y = -1 = -1 = -1 = scheduled 
D19-08 = Maiolino R. = x(at)y = 20 = 1242234000 = 1242428400 = continue 

Create commands:

archive@mrt-lx3:~/archive/wb$ head -7 projects2009.lis | ./projectListToCreateUsers.py 
list of schedulable proposals

5-Feb-2010

format: proposal ID = PI(s) = email = week of schedule = UTS start = UTS end = status 

        -1 means no entry in the DB (prop not yet or never scheduled)

002-09 = Biver N. = x(at)y = 44 = 1256828400 = 1256839200 = continue 

006-09 = Linz H. = x(at)y = 34 = 1250791200 = 1251165600 = scheduled 

./createUser.py '002y09' '002-09' 'Biver N.' 'x(at)y' '002-09'
./createUser.py '006y09' '006-09' 'Linz H.' 'x(at)y' '006-09'

Check and execute the "createUser.py" lines to create accounts manually (projectListToCreateUsers.py only shows them!)

Create accounts from 30m planning html files

Check via http://www.iram.fr/IRAMFR/PV/sche/sche.html exact name of the bi-weekly planning file and replace "s01v1" by the corresponding value of the current version.

archive@mrt-lx3:~/archive/wb$
#   get planning html file
wget -r http://www.iram.fr/IRAMFR/PV/sche/10/s01v1.html
# extract information
find ./www.iram.fr/php/rel_sched/bgfiles/10/s01*.html -exec ./planner1.sh {} \;
# program planner.py lists createUser.py commands to create accounts

Example:

# wget -r http://www.iram.fr/IRAMFR/PV/sche/10/s21v3.html
...
--11:17:22--  http://www.iram.fr/php/rel_sched/bgfiles/10/s21_189su01.html
           => `www.iram.fr/php/rel_sched/bgfiles/10/s21_189su01.html'
Connecting to www.iram.fr|193.48.252.8|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 1,583 (1.5K) [text/html]

100%[===================================================>] 1,583         --.--K/s             

11:17:22 (142.21 MB/s) - `www.iram.fr/php/rel_sched/bgfiles/10/s21_189su01.html' saved [1583/1583]
...
--11:17:22--  http://www.iram.fr/php/rel_sched/bgfiles/10/s21_TBAsu00.html
           => `www.iram.fr/php/rel_sched/bgfiles/10/s21_TBAsu00.html'
Connecting to www.iram.fr|193.48.252.8|:80... connected.
HTTP request sent, awaiting response... 404 Not Found
11:17:22 ERROR 404: Not Found.


FINISHED --11:17:22--
Downloaded: 64,845 bytes in 11 files

To extract information:

archive(at)mrt-lx3:~/archive/wb$ find ./www.iram.fr/php/rel_sched/bgfiles/10/s21_*.html -exec ./planner1.sh {} \;
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
PI                   Marco Padovani
affiliation          Dipartimento di Astronomia eScienza dello Spazio, I-50125 Firenze (Italy)
email                x(at)y
fax                  ?
project              171-09
./createUser.py '171y09' '171-09' 'Marco Padovani' 'x(at)y' '171-09'

directory /gra-lx4/prArch0/closed/171-09 exists: False
directory /mrt-lx3/visMirror/171-09 exists: False
directory /mrt-lx3/vis/171-09 exists: False

Check the "createUser" commands and execute them manually.

Send e-mail with initial password

archive(at)mrt-lx3:~/archive/wb$ ./emailPI.py 200-09 200y09 x(at)y 
enter: project account e-mail
project> 200-09 200y09 x(at)y
['200-09', '200y09', 'x(at)y']
1st message sent, sleep 10s
(220, 'mrt-lx3.iram.es ESMTP Exim 4.63 Fri, 30 Apr 2010 07:50:46 +0000')
{}
2nd message sent

Notes

Datafiller

Start, stop or restart Datafiller

Run the following commands under root@mrt-lx3:

startCreateDatafillerLinks

stopCreateDatafillerLinks

restartCreateDatafillerLinks

Fill scans from dayDirs disk to Tapas

Do under archive@mrt-lx3:

useNCS
cd ~/archive/datafiller/tools/tmp
# set day, ex:
Day=20141232
bash -v ../fillInOffline $Day

archive@mrt-lx3:~/archive/datafiller/tools/tmp$ ../createDatafillerLinks1.py -h
Usage: Create link to scan directories for Tapas

The directories are entered from stdin, example under archive@mrt-lx3:

cd ~/archive/datafiller/tools/tmp
Day=20101031
Dir=/ncsServer/mrt/ncs/data/$Day/scans/
find $Dir -mindepth 1 -maxdepth 1 -type d | ../createDatafillerLinks1.py -t

creates a list of commands that would be executed
Tapas can then fill in these observations.


Options:
  -h, --help            show this help message and exit
  -v DEBUG, --verbose=DEBUG
                        verbose level - 0: no output, 1: log-, 2: debug-
                        information
  -t, --test            test, only show commands that would be done

CDS

Create CDS listings, see /mrt-lx3/users/archive/archive/wb/ReadMe.txt . See http://vizier.u-strasbg.fr/viz-bin/VizieR-3

Backups

Architecture


Document Info

This is page https://mrt-lx1.iram.es/mainWiki/TapasOperationGuide, moderated by WB. CategoryTapas CategoryNCS CategoryWB CategoryGuide

TapasOperationGuide (last edited 2021-03-26 11:29:03 by mellado)