Difference between revisions of "TRS Data and Tools"

From CoolWiki
Jump to navigationJump to search
(Updated to add links for interim files and scripts.)
Line 29: Line 29:
  
  
−
----
+
==Interim Data Files==
−
 
+
; [[Media:TRS168_irac12_cat.zip|Catalog Files]]
−
'''''AREA BELOW IS UNDER CONSTRUCTION'''''
 
−
 
 
−
 
 
−
Interim Data Files
 
−
; [[placeholder|Catalog Files]]
 
 
: This ZIP file contains 168 listings of object positions, one file for each of the frames we are examining.
 
: This ZIP file contains 168 listings of object positions, one file for each of the frames we are examining.
−
: These catalog files were created by trimming the SourceExtractor output files (''<object>''_irac12.cat) provided by Varoujan at the Summer Workshop.
+
: These catalog files were created by trimming the SourceExtractor output files (''<object>''_irac12.cat) provided by Varoujan at the Summer Workshop. (See ''iraccat2txt.sh'' script below.)
−
: Two of these catalog files had to be manually updated, to remove one position each, because of an incompatibility with APT.  Both the original CAT file and the updated one are included.  For details, see the README.txt file.
+
: Two of these catalog files had to be manually updated, to remove one position each, because of an incompatibility with APT.  Both the original CAT file and the updated one are included.  For details, see the README.txt file inside the ZIP file.
−
; [[placeholder|APT Preferences]]
+
; [[Media:APT.txt|APT Preferences]]
−
: This file recorded the APT preferences that Mark was using while bulk-processing the FITS files with APT.
+
: This file recorded the APT preferences that Mark was using while bulk-processing the FITS files with APT.  (File extension renamed from .pref to .txt to comply with coolwiki restrictions.)
 +
: This was edited "on the fly" by the ''batchAPT.sh'' script (see below).
  
  
−
  Scripts
+
==Scripts==
−
; [[placeholder|setup_APT.sh]]
+
'''NOTE''': All scripts renamed to ".txt" to comply with coolwiki restrictions.
−
: Bash shell setup script for running APT on Mark's Mac.
+
; [[Media:apt_setup.txt|apt_setup.sh]]
−
; [[placeholder|zip the cat files]]
+
: Bash shell setup script to initialize environment for running APT on Mark's Mac.
−
; [[placeholder|reunification.py]]
+
; [[Media:iraccat2txt.txt|iraccat2txt.sh]]
 +
: Bash shell script to trim the "catalog" files from Source Extractor into a list of positions that can be input to APT.
 +
: Results are above (see "Catalog Files").
 +
; [[Media:reunification.txt|reunification.py]]
 
: Python script which generated the latest set of CSV files (magnitude).
 
: Python script which generated the latest set of CSV files (magnitude).
 
: Input are 2 TBL files from APT; output is a CSV file.
 
: Input are 2 TBL files from APT; output is a CSV file.
−
; [[placeholder|flux_reunification.py]]
+
: Results are above (see "Photometry Data").
−
: Python script which generated the first set of CSV files (µJy) at the Summer Workshop.
+
; [[Media:flux_reunification.txt|flux_reunification.py]]
−
; [[placeholder|batchAPT.sh]]
+
: Python script which generated the first set of CSV files (flux in µJy) at the Summer Workshop.
 +
; [[Media:batchAPT.txt|batchAPT.sh]]
 
: Bash script for running APT on an entire set of FITS files.
 
: Bash script for running APT on an entire set of FITS files.
 
: Script needs to be edited to specify source and destination files.
 
: Script needs to be edited to specify source and destination files.
−
; [[placeholder|batchUnify.sh]]
+
: Directly manipulates the APT preferences file (see above).
−
: Bash script for running the reunification.py script on an entire folder full of photometry files from APT.
+
; [[Media:batchUnify.txt|batchUnify.sh]]
 +
: Bash script for running the ''reunification.py'' script on an entire folder full of photometry files from APT.
 
: The result is 1 CSV file for each pair of TBL files.
 
: The result is 1 CSV file for each pair of TBL files.
−
output files
+
 
 +
 
 +
==Output Files==
 +
; [[Media:TRS168_otuput_files.zip|Output Files]]
 +
: This ZIP file contains listings of batch script outputs.  These were useful in debugging and confirming our processing.

Revision as of 23:55, 13 December 2011

Photometry Data

  • There are 4 ZIP files, each one corresponding to one of the 4 folders of FITS images provided by Varoujan at the Summer Workshop.
  • Each zip file holds 3 files for each frame:
    <object>_irac1.tbl
    IRAC1 channel photometry results from APT, flux in µJy
    <object>_irac2.tbl
    IRAC2 channel photometry results from APT, flux in µJy
    <object>_irac12.csv
    Collated IRAC1 and IRAC2 channel results from APT, including only those objects that appear in both channels, filtered for SNR > 3, and converted to magnitude. (These are the files that should be imported into an Excel workbook.)

Download the ZIP files here:

NITARP-TRS1-Phot.zip
147 files for 49 frames
NITARP-TRS2-Phot.zip
165 files for 55 frames
NITARP-TRS3-Phot.zip
156 files for 52 frames
NITARP-TRS4-Phot.zip
36 files for 12 frames


Resources

Sample Workbook
This Excel 2011 workbook has the template pages for photometry and the bubble chart.
Prepared by Mark Abajian
Target_list_111013.xls (AGN Positions Workbook)
This Excel workbook contains the names and positions for all 168 AGNs
Prepared by Varoujan Gorjian


Interim Data Files

Catalog Files
This ZIP file contains 168 listings of object positions, one file for each of the frames we are examining.
These catalog files were created by trimming the SourceExtractor output files (<object>_irac12.cat) provided by Varoujan at the Summer Workshop. (See iraccat2txt.sh script below.)
Two of these catalog files had to be manually updated, to remove one position each, because of an incompatibility with APT. Both the original CAT file and the updated one are included. For details, see the README.txt file inside the ZIP file.
APT Preferences
This file recorded the APT preferences that Mark was using while bulk-processing the FITS files with APT. (File extension renamed from .pref to .txt to comply with coolwiki restrictions.)
This was edited "on the fly" by the batchAPT.sh script (see below).


Scripts

NOTE:  All scripts renamed to ".txt" to comply with coolwiki restrictions.
apt_setup.sh
Bash shell setup script to initialize environment for running APT on Mark's Mac.
iraccat2txt.sh
Bash shell script to trim the "catalog" files from Source Extractor into a list of positions that can be input to APT.
Results are above (see "Catalog Files").
reunification.py
Python script which generated the latest set of CSV files (magnitude).
Input are 2 TBL files from APT; output is a CSV file.
Results are above (see "Photometry Data").
flux_reunification.py
Python script which generated the first set of CSV files (flux in µJy) at the Summer Workshop.
batchAPT.sh
Bash script for running APT on an entire set of FITS files.
Script needs to be edited to specify source and destination files.
Directly manipulates the APT preferences file (see above).
batchUnify.sh
Bash script for running the reunification.py script on an entire folder full of photometry files from APT.
The result is 1 CSV file for each pair of TBL files.


Output Files

Output Files
This ZIP file contains listings of batch script outputs. These were useful in debugging and confirming our processing.
Retrieved from "https://vmcoolwiki.ipac.caltech.edu/index.php?title=TRS_Data_and_Tools&oldid=7960"