Difference between revisions of "TRS Data and Tools"

From CoolWiki
Jump to navigationJump to search
(Initial release of this page)
 
 
(4 intermediate revisions by 2 users not shown)
Line 1: Line 1:
−
=THIS PAGE UNDER CONSTRUCTION=
 
−
 
−
 
 
==Photometry Data==
 
==Photometry Data==
 
* There are 4 ZIP files, each one corresponding to one of the 4 folders of FITS images provided by Varoujan at the Summer Workshop.
 
* There are 4 ZIP files, each one corresponding to one of the 4 folders of FITS images provided by Varoujan at the Summer Workshop.
Line 10: Line 7:
 
*: IRAC2 channel photometry results from APT, flux in µJy
 
*: IRAC2 channel photometry results from APT, flux in µJy
 
*; ''<object>''_irac12.csv
 
*; ''<object>''_irac12.csv
−
*: Collated IRAC1 and IRAC2 channel results from APT, including only those objects that appear in both channels, filtered for SNR > 3, and converted to magnitude
+
*: Collated IRAC1 and IRAC2 channel results from APT, including only those objects that appear in both channels, filtered for SNR > 3, and converted to magnitude.  (These are the files that should be imported into an Excel workbook.)
−
*: These are the files that will be imported into the Excel workbook
 
  
 
Download the ZIP files here:
 
Download the ZIP files here:
−
; [[placeholder]]
+
; [[Media:NITARP-TRS1-Phot.zip|NITARP-TRS1-Phot.zip]]
 
: 147 files for 49 frames
 
: 147 files for 49 frames
−
; [[placeholder]]
+
; [[Media:NITARP-TRS2-Phot.zip|NITARP-TRS2-Phot.zip]]
 
: 165 files for 55 frames
 
: 165 files for 55 frames
−
; [[placeholder]]
+
; [[Media:NITARP-TRS3-Phot.zip|NITARP-TRS3-Phot.zip]]
−
: 156 files for 52 frames, plus a README file explaining that two frames each had one bad object removed.  (These two positions were causing APT to crash, so they were manually removed from the corresponding CAT files.)
+
: 156 files for 52 frames
−
; [[placeholder]]
+
; [[Media:NITARP-TRS4-Phot.zip|NITARP-TRS4-Phot.zip]]
 
: 36 files for 12 frames
 
: 36 files for 12 frames
  
  
 
==Resources==
 
==Resources==
−
; [[placeholder|Sample Workbook]]
+
; [[Media:TRSWorkbook.xlsx|Sample Workbook]]
 
: This Excel 2011 workbook has the template pages for photometry and the bubble chart.
 
: This Excel 2011 workbook has the template pages for photometry and the bubble chart.
 
: Prepared by Mark Abajian
 
: Prepared by Mark Abajian
−
; [[placeholder|Catalog Files]]
+
; [[Media:Target_list_111013.xls|Target_list_111013.xls]] (AGN Positions Workbook)
 +
: This Excel workbook contains the names and positions for all 168 AGNs
 +
: Prepared by Varoujan Gorjian
 +
 
 +
 
 +
==Interim Data Files==
 +
; [[Media:TRS168_irac12_cat.zip|Catalog Files]]
 
: This ZIP file contains 168 listings of object positions, one file for each of the frames we are examining.
 
: This ZIP file contains 168 listings of object positions, one file for each of the frames we are examining.
−
: These catalog files were created by trimming the SourceExtractor output files (''<object>''_irac12.cat) provided by Varoujan at the Summer Workshop.
+
: These catalog files were created by trimming the SourceExtractor output files (''<object>''_irac12.cat) provided by Varoujan at the Summer Workshop. (See ''iraccat2txt.sh'' script below.)
−
: Two of these catalog files had to be manually updated, to remove one position each, because of an incompatibility with APT.  Both the original CAT file and the updated one are included.  There are a total of 170 CAT files here.
+
: Two of these catalog files had to be manually updated, to remove one position each, because of an incompatibility with APT.  Both the original CAT file and the updated one are included.  For details, see the README.txt file inside the ZIP file.
−
; [[placeholder|APT Preferences]]
+
; [[Media:APT.txt|APT Preferences]]
−
: This file recorded the APT preferences that Mark was using while bulk-processing the FITS files with APT.
+
: This file recorded the APT preferences that Mark was using while bulk-processing the FITS files with APT. (File extension renamed from .pref to .txt to comply with coolwiki restrictions.)
−
===Scripts===
+
: This was edited "on the fly" by the ''batchAPT.sh'' script (see below).
−
; [[placeholder|setup_APT.sh]]
+
 
−
: Bash shell setup script for running APT on Mark's Mac.
+
 
−
; [[placeholder|zip the cat files]]
+
==Scripts==
−
; [[placeholder|reunification.py]]
+
'''NOTE''':  All scripts renamed to ".txt" to comply with coolwiki restrictions.
 +
; [[Media:apt_setup.txt|apt_setup.sh]]
 +
: Bash shell setup script to initialize environment for running APT on Mark's Mac.
 +
; [[Media:iraccat2txt.txt|iraccat2txt.sh]]
 +
: Bash shell script to trim the "catalog" files from Source Extractor into a list of positions that can be input to APT.
 +
: Results are above (see "Catalog Files").
 +
; [[Media:reunification.txt|reunification.py]]
 
: Python script which generated the latest set of CSV files (magnitude).
 
: Python script which generated the latest set of CSV files (magnitude).
 
: Input are 2 TBL files from APT; output is a CSV file.
 
: Input are 2 TBL files from APT; output is a CSV file.
−
; [[placeholder|flux_reunification.py]]
+
: Results are above (see "Photometry Data").
−
: Python script which generated the first set of CSV files (µJy) at the Summer Workshop.
+
; [[Media:flux_reunification.txt|flux_reunification.py]]
−
; [[placeholder|batchAPT.sh]]
+
: Python script which generated the first set of CSV files (flux in µJy) at the Summer Workshop.
 +
; [[Media:batchAPT.txt|batchAPT.sh]]
 
: Bash script for running APT on an entire set of FITS files.
 
: Bash script for running APT on an entire set of FITS files.
 
: Script needs to be edited to specify source and destination files.
 
: Script needs to be edited to specify source and destination files.
−
; [[placeholder|batchUnify.sh]]
+
: Directly manipulates the APT preferences file (see above).
−
: Bash script for running the reunification.py script on an entire folder full of photometry files from APT.
+
; [[Media:batchUnify.txt|batchUnify.sh]]
 +
: Bash script for running the ''reunification.py'' script on an entire folder full of photometry files from APT.
 
: The result is 1 CSV file for each pair of TBL files.
 
: The result is 1 CSV file for each pair of TBL files.
−
output files
+
 
 +
 
 +
==Output Files==
 +
; [[Media:TRS168_otuput_files.zip|Output Files]]
 +
: This ZIP file contains listings of batch script outputs.  These were useful in debugging and confirming our processing.

Latest revision as of 22:38, 19 September 2013

Photometry Data

  • There are 4 ZIP files, each one corresponding to one of the 4 folders of FITS images provided by Varoujan at the Summer Workshop.
  • Each zip file holds 3 files for each frame:
    <object>_irac1.tbl
    IRAC1 channel photometry results from APT, flux in µJy
    <object>_irac2.tbl
    IRAC2 channel photometry results from APT, flux in µJy
    <object>_irac12.csv
    Collated IRAC1 and IRAC2 channel results from APT, including only those objects that appear in both channels, filtered for SNR > 3, and converted to magnitude. (These are the files that should be imported into an Excel workbook.)

Download the ZIP files here:

NITARP-TRS1-Phot.zip
147 files for 49 frames
NITARP-TRS2-Phot.zip
165 files for 55 frames
NITARP-TRS3-Phot.zip
156 files for 52 frames
NITARP-TRS4-Phot.zip
36 files for 12 frames


Resources

Sample Workbook
This Excel 2011 workbook has the template pages for photometry and the bubble chart.
Prepared by Mark Abajian
Target_list_111013.xls (AGN Positions Workbook)
This Excel workbook contains the names and positions for all 168 AGNs
Prepared by Varoujan Gorjian


Interim Data Files

Catalog Files
This ZIP file contains 168 listings of object positions, one file for each of the frames we are examining.
These catalog files were created by trimming the SourceExtractor output files (<object>_irac12.cat) provided by Varoujan at the Summer Workshop. (See iraccat2txt.sh script below.)
Two of these catalog files had to be manually updated, to remove one position each, because of an incompatibility with APT. Both the original CAT file and the updated one are included. For details, see the README.txt file inside the ZIP file.
APT Preferences
This file recorded the APT preferences that Mark was using while bulk-processing the FITS files with APT. (File extension renamed from .pref to .txt to comply with coolwiki restrictions.)
This was edited "on the fly" by the batchAPT.sh script (see below).


Scripts

NOTE:  All scripts renamed to ".txt" to comply with coolwiki restrictions.
apt_setup.sh
Bash shell setup script to initialize environment for running APT on Mark's Mac.
iraccat2txt.sh
Bash shell script to trim the "catalog" files from Source Extractor into a list of positions that can be input to APT.
Results are above (see "Catalog Files").
reunification.py
Python script which generated the latest set of CSV files (magnitude).
Input are 2 TBL files from APT; output is a CSV file.
Results are above (see "Photometry Data").
flux_reunification.py
Python script which generated the first set of CSV files (flux in µJy) at the Summer Workshop.
batchAPT.sh
Bash script for running APT on an entire set of FITS files.
Script needs to be edited to specify source and destination files.
Directly manipulates the APT preferences file (see above).
batchUnify.sh
Bash script for running the reunification.py script on an entire folder full of photometry files from APT.
The result is 1 CSV file for each pair of TBL files.


Output Files

Output Files
This ZIP file contains listings of batch script outputs. These were useful in debugging and confirming our processing.
Retrieved from "https://vmcoolwiki.ipac.caltech.edu/index.php?title=TRS_Data_and_Tools&oldid=12178"