CoolWiki - User contributions [en]

TRS Data Analysis

2011-12-14T01:21:29Z

Abajian: Minor updates to emphasis.

[[User:Abajian|Abajian]] 17:09, 13 December 2011 (PST) -- There was some discussion about our methods, with APT, Python, Excel, etc. Here is my version.
* '''''Please also see Tim's reminders below''''' (15 August 2011).
* Feel free to update this list, correct it, etc. Use as much detail or as little, for your poster(s) and report(s).
* Also, you can view the APT preferences file, Python scripts, etc., from the [[TRS Data and Tools]] page.

=====Steps We Took To Perform Our Analysis=====
# Audrey and Varoujan collected the IRAC1 and IRAC2 FITS files from the Spitzer data base for the 168 AGN we are studying.
# Audrey ran a program called SourceExtractor to create a "catalog" file, for each AGN, of all the "sources" present in both IRAC1 and IRAC2 channel FITS files. Each catalog file was an ASCII list of positions, in decimal degrees.
# We ran APT v1.1.1 on one or two of the IRAC FITS files to determine our "aperture" of interest. We determined we would use, for the IRAC1 and IRAC2 images, an aperture radius of 6 pixels. We also chose an annulus with inner and outer radii of 6 and 8 pixels, respectively, to represent our "background sky" photometry. The decision was made to utilize the same aperture and annulus for all objects in each IRAC1 and IRAC2 frame.
# We told APT to report the photometry to us in microJanskys. The way we did this was to convert the DN reading in APT to flux density by multiplying the DN values in the FITS files by 8.4616 MegaJanskys/steradian. I believe this required us to assume that the pixel resolution was identical for the IRAC1 and IRAC2 detectors.
# We ran a script to "bulk process" all 336 FITS files using APT. This resulted in 168 pairs of IRAC1 and IRAC2 data in APT output "table" files. The flux and uncertainties were presented in microJanskys; positions were in decimal degrees.
# We learned that we were unable to match up all the positions in the IRAC1 and IRAC2 table files. This was because our original list of positions that we sent to APT in fact included a few positions that did not have valid data in both IRAC1 and IRAC2 channels.
# We devised a script to read the IRAC1 and IRAC2 files, compare the positions in each, and write out a resultant file comprised of '''only''' those positions truly common to both channels.
# We added some additional logic to that script:
## we filtered the results to include only those positions that demonstrated SNR > 3 in both IRAC1 and IRAC2 channels; SNR was (flux/uncertainty)
## we converted the photometry from microJanskys to magnitudes using the conversion factors provided by Spitzer
## output format was converted from TBL to CSV to simplify importing into Excel
# We ran this script on all 168 pairs of IRAC1 and IRAC2 tables from APT, and this resulted in 168 CSV files. Each CSV file contained position, IRAC1 magnitude, IRAC1 mag uncertainty, IRAC2 magnitude, IRAC2 mag uncertainty.
# We devised an Excel workbook template to allow us to:
## read in a CSV file of positions, IRAC1 magnitude and uncertainty, IRAC2 magnitude and uncertainty, for a given AGN
## compute IRAC1-IRAC2 colors
## specify (by hand) the name and position of the AGN
## plot the AGN and all points in the frame with an IRAC1-IRAC2 color in the range of (-.6, -.1)
## plot a radius of one arc minute around the AGN to help us visualize potential cluster members
# We generated workbooks and plots for each of the 168 AGN frames.
# We viewed the plots to gauge which ones might depict galaxy clusters. (You can add criteria here....)
# We selected a group of the 10 most likely galaxy cluster candidates.
# We re-plotted the 10 candidates to set their X-axes to reflect true RA (East is left).
# We downloaded SDSS images of these same regions to perform a more accurate comparison.
# We made final comparisons between our plots and SDSS images, and made final suggestions about which may in fact represent galaxy clusters.

[[User:Abajian|Abajian]] 01:20, 19 September 2011 (PDT) -- Added [[TRS Data and Tools]] to supply resources for the analysis effort. Let me know if you have any questions or need any assistance. On that page, you will find the CSV files (magnitudes), as well as a "sample" Excel workbook. The Excel workbook has a macro enabled in it, to refresh the data with a new CSV file. I can describe it better during our telecon, or give me a call.

* [[User:Vg|Vg]] 16:57, 15 September 2011 (PDT) Here is the file with all the names, redshifts and RA and Dec for all our target AGN. Note that the RA and Dec are both in Sexegesimal format (h:m:s) as well as degree format which is what you should be using to plot the data. Make sure you add these AGN into your plots so that you can have a good sense of where the image is centered.
** [[Media:Target_list_111013.xls|Target_list_111013.xls]]

* [[User:Spuck|Spuck]] 15:46, 18 August 2011 (PDT) Check this out (5C6.24) what do you think? '''Is this a possible filament?''' The AGN is roughly centered on the graph?
** [[File:Possible Filament.pdf]]
** [[User:vg|vg]] That may very well be!!! We have to check to see that the colors of the sources in the filament match those we would expect from galaxies that would be at the redshift of the AGN.
** [[User:Mehta|Mehta]] 16:20, 18 August 2011 (PDT) [[File:3C6.24.pdf‎]] This file has the main graph, plus two more, one with magnitude differences >0.1, and one for <0.1.

----

* [[User:Spuck|Spuck]] 17:31, 15 August 2011 (PDT) A couple things to remember about APT setup for this project.
** Don't forget to go to "Preferences" and set "Celestial Coordinates Units" to "Decimal".
** Also click on the "More Settings" button and select "Model B = Sky-median subtraction" for your Sky Algorithm. Source Algorithm should be "Model 0 = No aperture interpolation.
** Also under "More Settings" check the box next to "Perform new image-data conversion" and use the following values.
** New image-data conversion factor - 8.4616
** Image-data units after conversion - µJy
** Image-data title after new conversion - Flux Density
------------------------------------------------------

TRS Data Analysis

2011-12-14T01:09:03Z

Abajian: Added a "Steps We Took" section.

[[User:Abajian|Abajian]] 17:09, 13 December 2011 (PST) -- There was some discussion about our methods, with APT, Python, Excel, etc. Here is my version.
* Please also see Tim's reminders below (15 August 2011).
* Feel free to update this list, correct it, etc.
* Also, you can view the APT preferences file, Python scripts, etc., on the [[TRS Data and Tools]] page.

=====Steps We Took To Perform Our Analysis=====
# Audrey and Varoujan collected the IRAC1 and IRAC2 FITS files from the Spitzer data base for the 168 AGN we are studying.
# Audrey ran a program called SourceExtractor to create a "catalog" file, for each AGN, of all the "sources" present in both IRAC1 and IRAC2 channel FITS files. Each catalog file was an ASCII list of positions, in decimal degrees.
# We ran APT v1.1.1 on one or two of the IRAC FITS files to determine our "aperture" of interest. We determined we would use, for the IRAC1 and IRAC2 images, an aperture radius of 6 pixels. We also chose an annulus with inner and outer radii of 6 and 8 pixels, respectively, to represent our "background sky" photometry. The decision was made to utilize the same aperture and annulus for all objects in each IRAC1 and IRAC2 frame.
# We told APT to report the photometry to us in microJanskys. The way we did this was to convert the DN reading in APT to flux density by multiplying the DN values in the FITS files by 8.4616 MegaJanskys/steradian. I believe this required us to assume that the pixel resolution was identical for the IRAC1 and IRAC2 detectors.
# We ran a script to "bulk process" all 336 FITS files using APT. This resulted in 168 pairs of IRAC1 and IRAC2 data in APT output "table" files. The flux and uncertainties were presented in microJanskys; positions were in decimal degrees.
# We learned that we were unable to match up all the positions in the IRAC1 and IRAC2 table files. This was because our original list of positions that we sent to APT in fact included a few positions that did not have valid data in both IRAC1 and IRAC2 channels.
# We devised a script to read the IRAC1 and IRAC2 files, compare the positions in each, and write out a resultant file comprised of '''only''' those positions truly common to both channels.
# We added some additional logic to that script:
## we filtered the results to include only those positions that demonstrated SNR > 3 in both IRAC1 and IRAC2 channels; SNR was (flux/uncertainty)
## we converted the photometry from microJanskys to magnitudes using the conversion factors provided by Spitzer
## output format was converted from TBL to CSV to simplify importing into Excel
# We ran this script on all 168 pairs of IRAC1 and IRAC2 tables from APT, and this resulted in 168 CSV files. Each CSV file contained position, IRAC1 magnitude, IRAC1 mag uncertainty, IRAC2 magnitude, IRAC2 mag uncertainty.
# We devised an Excel workbook template to allow us to:
## read in a CSV file of positions, IRAC1 magnitude and uncertainty, IRAC2 magnitude and uncertainty, for a given AGN
## compute IRAC1-IRAC2 colors
## specify (by hand) the name and position of the AGN
## plot the AGN and all points in the frame with an IRAC1-IRAC2 color in the range of (-.6, -.1)
## plot a radius of one arc minute around the AGN to help us visualize potential cluster members
# We generated workbooks and plots for each of the 168 AGN frames.
# We viewed the plots to gauge which ones might depict galaxy clusters. (You can add criteria here....)
# We selected a group of the 10 most likely galaxy cluster candidates.
# We re-plotted the 10 candidates to set their X-axes to reflect true RA (East is left).
# We downloaded SDSS images of these same regions to perform a more accurate comparison.
# We made final comparisons between our plots and SDSS images, and made final suggestions about which may in fact represent galaxy clusters.

[[User:Abajian|Abajian]] 01:20, 19 September 2011 (PDT) -- Added [[TRS Data and Tools]] to supply resources for the analysis effort. Let me know if you have any questions or need any assistance. On that page, you will find the CSV files (magnitudes), as well as a "sample" Excel workbook. The Excel workbook has a macro enabled in it, to refresh the data with a new CSV file. I can describe it better during our telecon, or give me a call.

* [[User:Vg|Vg]] 16:57, 15 September 2011 (PDT) Here is the file with all the names, redshifts and RA and Dec for all our target AGN. Note that the RA and Dec are both in Sexegesimal format (h:m:s) as well as degree format which is what you should be using to plot the data. Make sure you add these AGN into your plots so that you can have a good sense of where the image is centered.
** [[Media:Target_list_111013.xls|Target_list_111013.xls]]

* [[User:Spuck|Spuck]] 15:46, 18 August 2011 (PDT) Check this out (5C6.24) what do you think? '''Is this a possible filament?''' The AGN is roughly centered on the graph?
** [[File:Possible Filament.pdf]]
** [[User:vg|vg]] That may very well be!!! We have to check to see that the colors of the sources in the filament match those we would expect from galaxies that would be at the redshift of the AGN.
** [[User:Mehta|Mehta]] 16:20, 18 August 2011 (PDT) [[File:3C6.24.pdf‎]] This file has the main graph, plus two more, one with magnitude differences >0.1, and one for <0.1.

----

* [[User:Spuck|Spuck]] 17:31, 15 August 2011 (PDT) A couple things to remember about APT setup for this project.
** Don't forget to go to "Preferences" and set "Celestial Coordinates Units" to "Decimal".
** Also click on the "More Settings" button and select "Model B = Sky-median subtraction" for your Sky Algorithm. Source Algorithm should be "Model 0 = No aperture interpolation.
** Also under "More Settings" check the box next to "Perform new image-data conversion" and use the following values.
** New image-data conversion factor - 8.4616
** Image-data units after conversion - µJy
** Image-data title after new conversion - Flux Density
------------------------------------------------------

TRS Data and Tools

2011-12-13T23:55:39Z

Abajian: Updated to add links for interim files and scripts.

==Photometry Data==
* There are 4 ZIP files, each one corresponding to one of the 4 folders of FITS images provided by Varoujan at the Summer Workshop.
* Each zip file holds 3 files for each frame:
*; ''<object>''_irac1.tbl
*: IRAC1 channel photometry results from APT, flux in µJy
*; ''<object>''_irac2.tbl
*: IRAC2 channel photometry results from APT, flux in µJy
*; ''<object>''_irac12.csv
*: Collated IRAC1 and IRAC2 channel results from APT, including only those objects that appear in both channels, filtered for SNR > 3, and converted to magnitude. (These are the files that should be imported into an Excel workbook.)

Download the ZIP files here:
; [[Media:NITARP-TRS1-Phot.zip|NITARP-TRS1-Phot.zip]]
: 147 files for 49 frames
; [[Media:NITARP-TRS2-Phot.zip|NITARP-TRS2-Phot.zip]]
: 165 files for 55 frames
; [[Media:NITARP-TRS3-Phot.zip|NITARP-TRS3-Phot.zip]]
: 156 files for 52 frames
; [[Media:NITARP-TRS4-Phot.zip|NITARP-TRS4-Phot.zip]]
: 36 files for 12 frames

==Resources==
; [[Media:TRSWorkbook.xlsx|Sample Workbook]]
: This Excel 2011 workbook has the template pages for photometry and the bubble chart.
: Prepared by Mark Abajian
; [[Media:Target_list_111013.xls|Target_list_111013.xls]] (AGN Positions Workbook)
: This Excel workbook contains the names and positions for all 168 AGNs
: Prepared by Varoujan Gorjian

==Interim Data Files==
; [[Media:TRS168_irac12_cat.zip|Catalog Files]]
: This ZIP file contains 168 listings of object positions, one file for each of the frames we are examining.
: These catalog files were created by trimming the SourceExtractor output files (''<object>''_irac12.cat) provided by Varoujan at the Summer Workshop. (See ''iraccat2txt.sh'' script below.)
: Two of these catalog files had to be manually updated, to remove one position each, because of an incompatibility with APT. Both the original CAT file and the updated one are included. For details, see the README.txt file inside the ZIP file.
; [[Media:APT.txt|APT Preferences]]
: This file recorded the APT preferences that Mark was using while bulk-processing the FITS files with APT. (File extension renamed from .pref to .txt to comply with coolwiki restrictions.)
: This was edited "on the fly" by the ''batchAPT.sh'' script (see below).

==Scripts==
'''NOTE''': All scripts renamed to ".txt" to comply with coolwiki restrictions.
; [[Media:apt_setup.txt|apt_setup.sh]]
: Bash shell setup script to initialize environment for running APT on Mark's Mac.
; [[Media:iraccat2txt.txt|iraccat2txt.sh]]
: Bash shell script to trim the "catalog" files from Source Extractor into a list of positions that can be input to APT.
: Results are above (see "Catalog Files").
; [[Media:reunification.txt|reunification.py]]
: Python script which generated the latest set of CSV files (magnitude).
: Input are 2 TBL files from APT; output is a CSV file.
: Results are above (see "Photometry Data").
; [[Media:flux_reunification.txt|flux_reunification.py]]
: Python script which generated the first set of CSV files (flux in µJy) at the Summer Workshop.
; [[Media:batchAPT.txt|batchAPT.sh]]
: Bash script for running APT on an entire set of FITS files.
: Script needs to be edited to specify source and destination files.
: Directly manipulates the APT preferences file (see above).
; [[Media:batchUnify.txt|batchUnify.sh]]
: Bash script for running the ''reunification.py'' script on an entire folder full of photometry files from APT.
: The result is 1 CSV file for each pair of TBL files.

==Output Files==
; [[Media:TRS168_otuput_files.zip|Output Files]]
: This ZIP file contains listings of batch script outputs. These were useful in debugging and confirming our processing.

File:TRS168 otuput files.zip

2011-12-13T23:55:06Z

Abajian: TRS output files captured when running batch scripts. Useful in debugging and confirming our processing.

TRS output files captured when running batch scripts. Useful in debugging and confirming our processing.

File:APT.txt

2011-12-13T23:37:53Z

Abajian: Preferences used when Mark was doing bulk processing of FITS files using APT. (File extension renamed from .pref to .txt to comply with coolwiki restrictions.)

Preferences used when Mark was doing bulk processing of FITS files using APT. (File extension renamed from .pref to .txt to comply with coolwiki restrictions.)

File:TRS168 irac12 cat.zip

2011-12-13T23:36:11Z

Abajian: This ZIP file contains 168 listings of object positions, one file for each of the frames we are examining.

This ZIP file contains 168 listings of object positions, one file for each of the frames we are examining.

File:BatchUnify.txt

2011-12-13T23:32:50Z

Abajian: Bash script for running the reunification.py script on an entire folder full of photometry files from APT.

Bash script for running the reunification.py script on an entire folder full of photometry files from APT.

File:BatchAPT.txt

2011-12-13T23:32:15Z

Abajian: Bash script for running APT on an entire set of FITS files.

Bash script for running APT on an entire set of FITS files.

File:Flux reunification.txt

2011-12-13T23:31:20Z

Abajian: Python script which generated the first set of CSV files (flux in µJy) at the Summer Workshop.

Python script which generated the first set of CSV files (flux in µJy) at the Summer Workshop.

File:Reunification.txt

2011-12-13T23:30:48Z

Abajian: Python script which generated the latest set of CSV files (magnitude).

Python script which generated the latest set of CSV files (magnitude).

File:Iraccat2txt.txt

2011-12-13T23:30:09Z

Abajian: Bash shell script to trim the "catalog" files from Source Extractor into a list of positions that can be input to APT.

Bash shell script to trim the "catalog" files from Source Extractor into a list of positions that can be input to APT.

File:Apt setup.txt

2011-12-13T23:24:06Z

Abajian: Bash shell setup script for running APT on Mark's Mac.

Bash shell setup script for running APT on Mark's Mac.

File:TRSWorkbook.xlsx

2011-10-23T18:47:25Z

Abajian: uploaded a new version of "File:TRSWorkbook.xlsx": Updates from Shefali: 1-arcminute boundary points, .105 degree registration points Updates from Mark: Declination-based corrections for RA on 1-arcminute points and registration points; plot is

Workbook for NITARP Team Red Shift data analysis. Prepared in Excel 2011 by Mark Abajian.

TRS Data Analysis

2011-09-19T18:56:56Z

Abajian: Explained what is on the TRS Data and Tools page.

* [[User:Abajian|Abajian]] 01:20, 19 September 2011 (PDT) -- Added [[TRS Data and Tools]] to supply resources for the analysis effort. Let me know if you have any questions or need any assistance. On that page, you will find the CSV files (magnitudes), as well as a "sample" Excel workbook. The Excel workbook has a macro enabled in it, to refresh the data with a new CSV file. I can describe it better during our telecon, or give me a call.

* [[User:Vg|Vg]] 16:57, 15 September 2011 (PDT) Here is the file with all the names, redshifts and RA and Dec for all our target AGN. Note that the RA and Dec are both in Sexegesimal format (h:m:s) as well as degree format which is what you should be using to plot the data. Make sure you add these AGN into your plots so that you can have a good sense of where the image is centered.
** [[File:Target_list_110915.xls]]

* [[User:Spuck|Spuck]] 15:46, 18 August 2011 (PDT) Check this out (5C6.24) what do you think? '''Is this a possible filament?''' The AGN is roughly centered on the graph?
** [[File:Possible Filament.pdf]]
** [[User:vg|vg]] That may very well be!!! We have to check to see that the colors of the sources in the filament match those we would expect from galaxies that would be at the redshift of the AGN.
** [[User:Mehta|Mehta]] 16:20, 18 August 2011 (PDT) [[File:3C6.24.pdf‎]] This file has the main graph, plus two more, one with magnitude differences >0.1, and one for <0.1.

----

* [[User:Spuck|Spuck]] 17:31, 15 August 2011 (PDT) A couple things to remember about APT setup for this project.
** Don't forget to go to "Preferences" and set "Celestial Coordinates Units" to "Decimal".
** Also click on the "More Settings" button and select "Model B = Sky-median subtraction" for your Sky Algorithm. Source Algorithm should be "Model 0 = No aperture interpolation.
** Also under "More Settings" check the box next to "Perform new image-data conversion" and use the following values.
** New image-data conversion factor - 8.4616
** Image-data units after conversion - µJy
** Image-data title after new conversion - Flux Density
------------------------------------------------------

TRS Data and Tools

2011-09-19T18:43:54Z

Abajian: Updated to include names for zip files and Excel files. Minor reformatting.

==Photometry Data==
* There are 4 ZIP files, each one corresponding to one of the 4 folders of FITS images provided by Varoujan at the Summer Workshop.
* Each zip file holds 3 files for each frame:
*; ''<object>''_irac1.tbl
*: IRAC1 channel photometry results from APT, flux in µJy
*; ''<object>''_irac2.tbl
*: IRAC2 channel photometry results from APT, flux in µJy
*; ''<object>''_irac12.csv
*: Collated IRAC1 and IRAC2 channel results from APT, including only those objects that appear in both channels, filtered for SNR > 3, and converted to magnitude. (These are the files that should be imported into an Excel workbook.)

Download the ZIP files here:
; [[Media:NITARP-TRS1-Phot.zip|NITARP-TRS1-Phot.zip]]
: 147 files for 49 frames
; [[Media:NITARP-TRS2-Phot.zip|NITARP-TRS2-Phot.zip]]
: 165 files for 55 frames
; [[Media:NITARP-TRS3-Phot.zip|NITARP-TRS3-Phot.zip]]
: 156 files for 52 frames
; [[Media:NITARP-TRS4-Phot.zip|NITARP-TRS4-Phot.zip]]
: 36 files for 12 frames

==Resources==
; [[Media:TRSWorkbook.xlsx|Sample Workbook]]
: This Excel 2011 workbook has the template pages for photometry and the bubble chart.
: Prepared by Mark Abajian
; [[Media:Target_list_110915.xls|Target_list_110915.xls]] (AGN Positions Workbook)
: This Excel workbook contains the names and positions for all 168 AGNs
: Prepared by Varoujan Gorjian

----

'''''AREA BELOW IS UNDER CONSTRUCTION'''''

Interim Data Files
; [[placeholder|Catalog Files]]
: This ZIP file contains 168 listings of object positions, one file for each of the frames we are examining.
: These catalog files were created by trimming the SourceExtractor output files (''<object>''_irac12.cat) provided by Varoujan at the Summer Workshop.
: Two of these catalog files had to be manually updated, to remove one position each, because of an incompatibility with APT. Both the original CAT file and the updated one are included. For details, see the README.txt file.
; [[placeholder|APT Preferences]]
: This file recorded the APT preferences that Mark was using while bulk-processing the FITS files with APT.

Scripts
; [[placeholder|setup_APT.sh]]
: Bash shell setup script for running APT on Mark's Mac.
; [[placeholder|zip the cat files]]
; [[placeholder|reunification.py]]
: Python script which generated the latest set of CSV files (magnitude).
: Input are 2 TBL files from APT; output is a CSV file.
; [[placeholder|flux_reunification.py]]
: Python script which generated the first set of CSV files (µJy) at the Summer Workshop.
; [[placeholder|batchAPT.sh]]
: Bash script for running APT on an entire set of FITS files.
: Script needs to be edited to specify source and destination files.
; [[placeholder|batchUnify.sh]]
: Bash script for running the reunification.py script on an entire folder full of photometry files from APT.
: The result is 1 CSV file for each pair of TBL files.
output files

File:TRSWorkbook.xlsx

2011-09-19T18:38:36Z

Abajian: Workbook for NITARP Team Red Shift data analysis. Prepared in Excel 2011 by Mark Abajian.

Workbook for NITARP Team Red Shift data analysis. Prepared in Excel 2011 by Mark Abajian.

File:NITARP-TRS4-Phot.zip

2011-09-19T18:23:00Z

Abajian: APT Photometry files (µJy) and CSV files (mag) for NITARP-TRS1. 36 files for 12 frames.

APT Photometry files (µJy) and CSV files (mag) for NITARP-TRS1. 36 files for 12 frames.

File:NITARP-TRS3-Phot.zip

2011-09-19T18:22:25Z

Abajian: APT Photometry files (µJy) and CSV files (mag) for NITARP-TRS3. 156 files for 52 frames.

APT Photometry files (µJy) and CSV files (mag) for NITARP-TRS3. 156 files for 52 frames.

File:NITARP-TRS2-Phot.zip

2011-09-19T18:18:55Z

Abajian: APT Photometry files (µJy) and CSV files (mag) for NITARP-TRS2. 165 files for 55 frames.

APT Photometry files (µJy) and CSV files (mag) for NITARP-TRS2. 165 files for 55 frames.

File:NITARP-TRS1-Phot.zip

2011-09-19T18:17:50Z

Abajian: APT Photometry files (µJy) and CSV files (mag) for NITARP-TRS1. 147 files for 49 frames.

APT Photometry files (µJy) and CSV files (mag) for NITARP-TRS1. 147 files for 49 frames.

TRS Data Analysis

2011-09-19T08:20:31Z

Abajian: Added link for data and tools page; minor format updates.

* [[User:Abajian|Abajian]] 01:20, 19 September 2011 (PDT) -- Added [[TRS Data and Tools]] to supply resources for the analysis effort. Let me know if you have any questions or need any assistance.

* [[User:Vg|Vg]] 16:57, 15 September 2011 (PDT) Here is the file with all the names, redshifts and RA and Dec for all our target AGN. Note that the RA and Dec are both in Sexegesimal format (h:m:s) as well as degree format which is what you should be using to plot the data. Make sure you add these AGN into your plots so that you can have a good sense of where the image is centered.
** [[File:Target_list_110915.xls]]

* [[User:Spuck|Spuck]] 15:46, 18 August 2011 (PDT) Check this out (5C6.24) what do you think? '''Is this a possible filament?''' The AGN is roughly centered on the graph?
** [[File:Possible Filament.pdf]]
** [[User:vg|vg]] That may very well be!!! We have to check to see that the colors of the sources in the filament match those we would expect from galaxies that would be at the redshift of the AGN.
** [[User:Mehta|Mehta]] 16:20, 18 August 2011 (PDT) [[File:3C6.24.pdf‎]] This file has the main graph, plus two more, one with magnitude differences >0.1, and one for <0.1.

----

* [[User:Spuck|Spuck]] 17:31, 15 August 2011 (PDT) A couple things to remember about APT setup for this project.
** Don't forget to go to "Preferences" and set "Celestial Coordinates Units" to "Decimal".
** Also click on the "More Settings" button and select "Model B = Sky-median subtraction" for your Sky Algorithm. Source Algorithm should be "Model 0 = No aperture interpolation.
** Also under "More Settings" check the box next to "Perform new image-data conversion" and use the following values.
** New image-data conversion factor - 8.4616
** Image-data units after conversion - µJy
** Image-data title after new conversion - Flux Density
------------------------------------------------------

TRS Data and Tools

2011-09-19T08:05:02Z

Abajian: Initial release of this page

=THIS PAGE UNDER CONSTRUCTION=

==Photometry Data==
* There are 4 ZIP files, each one corresponding to one of the 4 folders of FITS images provided by Varoujan at the Summer Workshop.
* Each zip file holds 3 files for each frame:
*; ''<object>''_irac1.tbl
*: IRAC1 channel photometry results from APT, flux in µJy
*; ''<object>''_irac2.tbl
*: IRAC2 channel photometry results from APT, flux in µJy
*; ''<object>''_irac12.csv
*: Collated IRAC1 and IRAC2 channel results from APT, including only those objects that appear in both channels, filtered for SNR > 3, and converted to magnitude
*: These are the files that will be imported into the Excel workbook

Download the ZIP files here:
; [[placeholder]]
: 147 files for 49 frames
; [[placeholder]]
: 165 files for 55 frames
; [[placeholder]]
: 156 files for 52 frames, plus a README file explaining that two frames each had one bad object removed. (These two positions were causing APT to crash, so they were manually removed from the corresponding CAT files.)
; [[placeholder]]
: 36 files for 12 frames

==Resources==
; [[placeholder|Sample Workbook]]
: This Excel 2011 workbook has the template pages for photometry and the bubble chart.
: Prepared by Mark Abajian
; [[placeholder|Catalog Files]]
: This ZIP file contains 168 listings of object positions, one file for each of the frames we are examining.
: These catalog files were created by trimming the SourceExtractor output files (''<object>''_irac12.cat) provided by Varoujan at the Summer Workshop.
: Two of these catalog files had to be manually updated, to remove one position each, because of an incompatibility with APT. Both the original CAT file and the updated one are included. There are a total of 170 CAT files here.
; [[placeholder|APT Preferences]]
: This file recorded the APT preferences that Mark was using while bulk-processing the FITS files with APT.
===Scripts===
; [[placeholder|setup_APT.sh]]
: Bash shell setup script for running APT on Mark's Mac.
; [[placeholder|zip the cat files]]
; [[placeholder|reunification.py]]
: Python script which generated the latest set of CSV files (magnitude).
: Input are 2 TBL files from APT; output is a CSV file.
; [[placeholder|flux_reunification.py]]
: Python script which generated the first set of CSV files (µJy) at the Summer Workshop.
; [[placeholder|batchAPT.sh]]
: Bash script for running APT on an entire set of FITS files.
: Script needs to be edited to specify source and destination files.
; [[placeholder|batchUnify.sh]]
: Bash script for running the reunification.py script on an entire folder full of photometry files from APT.
: The result is 1 CSV file for each pair of TBL files.
output files

Team Red Shift Current Research Activities

2011-09-19T07:09:28Z

Abajian: Added Data and Tools link

=[[TRS Suggested Reading List]]=

Things teachers and students should read.

=[[TRS Proposal]]=

This page will be used to assemble the pieces for the proposal we are writing.

=Previous Teams' pages=
[[Luminous Data Miners Current Research Activities]] (2010)

=[[TRS Spring work]]=
This page will be used to collect information during our work in Spring.

=[[TRS Summer visit]]=
This page will be used to collect logistics information about our IPAC visit.

=[[TRS Useful Links]]=

A consolidation of all sorts of useful links.

NEW! Varoujan's PPT: [[file:trs_vg_talk.ppt]]

=[[TRS Data and Tools]]=

=[[TRS Data Analysis]]=

Special Notes/Comments about Data Analysis Procedures

User:Abajian

2011-08-11T00:22:53Z

Abajian: Added link for TRS page

===Mark Abajian===

'''''NStED Science Team Software Support'''''

Senior Application Developer 
NASA Exoplanet Science Institute 
Mail Code 100-22 
Pasadena, California 91125-2200

Office: Morrisroe 172 
Voice: (626) 395-1811 
Cell: (818) 726-0372

Skype: markabajian 
iChat/AIM: mabajian@mac.com 
Yahoo!/MSN: msabajian@sbcglobal.net

=====Other Responsibilities=====
*NExScI Archives (KI SOS) Software Support
*NExScI Web-Based Services Software Support
*NITARP [[Team Red Shift Current Research Activities|"Team Red Shift"]] Support
*NITARP [[Luminous Data Miners Current Research Activities|"Luminous Data Miners"]] Support

[mailto:Mark.Abajian@caltech.edu Mark.Abajian@caltech.edu] 
[http://web.ipac.caltech.edu/~mabajian Mark's IPAC Home Page]

Talk:Luminous Data Miners Data Analysis

2010-07-20T20:48:23Z

Abajian:

this is a comment from luisa --[[User:Rebull|Rebull]] 13:39, 20 July 2010 (PDT) 
Thats a good question.--[[User:Marklowitz|Marklowitz]] 13:40, 20 July 2010 (PDT) 
This is my contribution to the discussion. --[[User:Vg|Vg]] 13:40, 20 July 2010 (PDT) 
This is my change. Helen Petach--[[User:Petach|Petach]] 13:43, 20 July 2010 (PDT) 
The German kid --[[User:Saathoff|Saathoff]] 13:41, 20 July 2010 (PDT) 
:) Hey, guys --[[User:Tpetach|Tpetach]] 13:42, 20 July 2010 (PDT) 
This is darci--[[User:Sampsell|Sampsell]] 13:42, 20 July 2010 (PDT) 
Mark Abajian----[[User:Abajian|Abajian]] 13:42, 20 July 2010 (PDT) 
In my opinion a google document would be a wiser and easier way to share our data, but this works too.--[[User:Hale|Hale]] 13:42, 20
July 2010 (PDT) 
Hello --[[User:Murtari|Murtari]] 13:43, 20 July 2010 (PDT) 
i second the google doc --[[User:Mcnaughton|Mcnaughton]] 13:44, 20 July 2010 (PDT) 
this is a test --[[User:Spuck|Spuck]] 13:45, 20 July 2010 (PDT) 
This is cool! --[[User:Thom|Thom]] 13:45, 20 July 2010 (PDT) 
Hey, sweet--[[User:Zmeredith|Zmeredith]] 13:46, 20 July 2010 (PDT)

Talk:Luminous Data Miners Data Analysis

2010-07-20T20:45:09Z

Abajian:

Talk:Luminous Data Miners Data Analysis

2010-07-20T20:44:57Z

Abajian:

Talk:Luminous Data Miners Data Analysis

2010-07-20T20:44:45Z

Abajian:

this is a comment from luisa --[[User:Rebull|Rebull]] 13:39, 20 July 2010 (PDT) 
Thats a good question.--[[User:Marklowitz|Marklowitz]] 13:40, 20 July 2010 (PDT) 
This is my contribution to the discussion. --[[User:Vg|Vg]] 13:40, 20 July 2010 (PDT) 
This is my change. Helen Petach--[[User:Petach|Petach]] 13:43, 20 July 2010 (PDT) 
The German kid --[[User:Saathoff|Saathoff]] 13:41, 20 July 2010 (PDT) 
:) Hey, guys --[[User:Tpetach|Tpetach]] 13:42, 20 July 2010 (PDT) 
This is darci--[[User:Sampsell|Sampsell]] 13:42, 20 July 2010 (PDT) 
Mark Abajian----[[User:Abajian|Abajian]] 13:42, 20 July 2010 (PDT) 
In my opinion a google document would be a wiser and easier way to share our data, but this works too.--[[User:Hale|Hale]] 13:42, 20
July 2010 (PDT) 
Hello --[[User:Murtari|Murtari]] 13:43, 20 July 2010 (PDT)
i second the google doc --[[User:Mcnaughton|Mcnaughton]] 13:44, 20 July 2010 (PDT)

Talk:Luminous Data Miners Data Analysis

2010-07-20T20:44:30Z

Abajian:

this is a comment from luisa --[[User:Rebull|Rebull]] 13:39, 20 July 2010 (PDT) 
Thats a good question.--[[User:Marklowitz|Marklowitz]] 13:40, 20 July 2010 (PDT) 
This is my contribution to the discussion. --[[User:Vg|Vg]] 13:40, 20 July 2010 (PDT) 
This is my change. Helen Petach--[[User:Petach|Petach]] 13:43, 20 July 2010 (PDT) 
The German kid --[[User:Saathoff|Saathoff]] 13:41, 20 July 2010 (PDT) 
:) Hey, guys --[[User:Tpetach|Tpetach]] 13:42, 20 July 2010 (PDT) 
This is darci--[[User:Sampsell|Sampsell]] 13:42, 20 July 2010 (PDT) 
Mark Abajian----[[User:Abajian|Abajian]] 13:42, 20 July 2010 (PDT) 
In my opinion a google document would be a wiser and easier way to share our data, but this works too.--[[User:Hale|Hale]] 13:42, 20
July 2010 (PDT)
Hello --[[User:Murtari|Murtari]] 13:43, 20 July 2010 (PDT)

Talk:Luminous Data Miners Data Analysis

2010-07-20T20:44:18Z

Abajian:

this is a comment from luisa --[[User:Rebull|Rebull]] 13:39, 20 July 2010 (PDT) 
Thats a good question.--[[User:Marklowitz|Marklowitz]] 13:40, 20 July 2010 (PDT) 
This is my contribution to the discussion. --[[User:Vg|Vg]] 13:40, 20 July 2010 (PDT) 
This is my change. Helen Petach--[[User:Petach|Petach]] 13:43, 20 July 2010 (PDT) 
The German kid --[[User:Saathoff|Saathoff]] 13:41, 20 July 2010 (PDT) 
:) Hey, guys --[[User:Tpetach|Tpetach]] 13:42, 20 July 2010 (PDT) 
This is darci--[[User:Sampsell|Sampsell]] 13:42, 20 July 2010 (PDT) 
Mark Abajian----[[User:Abajian|Abajian]] 13:42, 20 July 2010 (PDT)
In my opinion a google document would be a wiser and easier way to share our data, but this works too.--[[User:Hale|Hale]] 13:42, 20
July 2010 (PDT)
Hello --[[User:Murtari|Murtari]] 13:43, 20 July 2010 (PDT)

Talk:Luminous Data Miners Data Analysis

2010-07-20T20:44:10Z

Abajian:

this is a comment from luisa --[[User:Rebull|Rebull]] 13:39, 20 July 2010 (PDT) 
Thats a good question.--[[User:Marklowitz|Marklowitz]] 13:40, 20 July 2010 (PDT) 
This is my contribution to the discussion. --[[User:Vg|Vg]] 13:40, 20 July 2010 (PDT) 
This is my change. Helen Petach--[[User:Petach|Petach]] 13:43, 20 July 2010 (PDT) 
The German kid --[[User:Saathoff|Saathoff]] 13:41, 20 July 2010 (PDT) 
:) Hey, guys --[[User:Tpetach|Tpetach]] 13:42, 20 July 2010 (PDT) 
This is darci--[[User:Sampsell|Sampsell]] 13:42, 20 July 2010 (PDT)
Mark Abajian----[[User:Abajian|Abajian]] 13:42, 20 July 2010 (PDT)
In my opinion a google document would be a wiser and easier way to share our data, but this works too.--[[User:Hale|Hale]] 13:42, 20
July 2010 (PDT)
Hello --[[User:Murtari|Murtari]] 13:43, 20 July 2010 (PDT)

Talk:Luminous Data Miners Data Analysis

2010-07-20T20:43:59Z

Abajian:

this is a comment from luisa --[[User:Rebull|Rebull]] 13:39, 20 July 2010 (PDT) 
Thats a good question.--[[User:Marklowitz|Marklowitz]] 13:40, 20 July 2010 (PDT) 
This is my contribution to the discussion. --[[User:Vg|Vg]] 13:40, 20 July 2010 (PDT) 
This is my change. Helen Petach--[[User:Petach|Petach]] 13:43, 20 July 2010 (PDT) 
The German kid --[[User:Saathoff|Saathoff]] 13:41, 20 July 2010 (PDT) 
:) Hey, guys --[[User:Tpetach|Tpetach]] 13:42, 20 July 2010 (PDT)
This is darci--[[User:Sampsell|Sampsell]] 13:42, 20 July 2010 (PDT)
Mark Abajian----[[User:Abajian|Abajian]] 13:42, 20 July 2010 (PDT)
In my opinion a google document would be a wiser and easier way to share our data, but this works too.--[[User:Hale|Hale]] 13:42, 20
July 2010 (PDT)
I am experiencing conflicts in saving --[[User:Murtari|Murtari]] 13:43, 20 July 2010 (PDT)

Talk:Luminous Data Miners Data Analysis

2010-07-20T20:43:48Z

Abajian:

this is a comment from luisa --[[User:Rebull|Rebull]] 13:39, 20 July 2010 (PDT) 
Thats a good question.--[[User:Marklowitz|Marklowitz]] 13:40, 20 July 2010 (PDT) 
This is my contribution to the discussion. --[[User:Vg|Vg]] 13:40, 20 July 2010 (PDT) 
This is my change. Helen Petach--[[User:Petach|Petach]] 13:43, 20 July 2010 (PDT) 
The German kid --[[User:Saathoff|Saathoff]] 13:41, 20 July 2010 (PDT)
:) Hey, guys --[[User:Tpetach|Tpetach]] 13:42, 20 July 2010 (PDT)
This is darci--[[User:Sampsell|Sampsell]] 13:42, 20 July 2010 (PDT)
Mark Abajian----[[User:Abajian|Abajian]] 13:42, 20 July 2010 (PDT)
In my opinion a google document would be a wiser and easier way to share our data, but this works too.--[[User:Hale|Hale]] 13:42, 20
July 2010 (PDT)
I am experiencing conflicts in saving --[[User:Murtari|Murtari]] 13:43, 20 July 2010 (PDT)

Talk:Luminous Data Miners Data Analysis

2010-07-20T20:43:38Z

Abajian:

Talk:Luminous Data Miners Data Analysis

2010-07-20T20:43:23Z

Abajian:

Talk:Luminous Data Miners Data Analysis

2010-07-20T20:43:09Z

Abajian:

this is a comment from luisa --[[User:Rebull|Rebull]] 13:39, 20 July 2010 (PDT) 
Thats a good question.--[[User:Marklowitz|Marklowitz]] 13:40, 20 July 2010 (PDT)
This is my contribution to the discussion. --[[User:Vg|Vg]] 13:40, 20 July 2010 (PDT)
This is my change. Helen Petach
The German kid --[[User:Saathoff|Saathoff]] 13:41, 20 July 2010 (PDT)
:) Hey, guys --[[User:Tpetach|Tpetach]] 13:42, 20 July 2010 (PDT)
This is darci--[[User:Sampsell|Sampsell]] 13:42, 20 July 2010 (PDT)
Mark Abajian----[[User:Abajian|Abajian]] 13:42, 20 July 2010 (PDT)
In my opinion a google document would be a wiser and easier way to share our data, but this works too.--[[User:Hale|Hale]] 13:42, 20 July 2010 (PDT)

Talk:Luminous Data Miners Data Analysis

2010-07-20T20:42:50Z

Abajian: Abajian added comment

this is a comment from luisa --[[User:Rebull|Rebull]] 13:39, 20 July 2010 (PDT)
Thats a good question.--[[User:Marklowitz|Marklowitz]] 13:40, 20 July 2010 (PDT)
This is my contribution to the discussion. --[[User:Vg|Vg]] 13:40, 20 July 2010 (PDT)
This is my change. Helen Petach
The German kid --[[User:Saathoff|Saathoff]] 13:41, 20 July 2010 (PDT)
:) Hey, guys --[[User:Tpetach|Tpetach]] 13:42, 20 July 2010 (PDT)
This is darci--[[User:Sampsell|Sampsell]] 13:42, 20 July 2010 (PDT)
Mark Abajian----[[User:Abajian|Abajian]] 13:42, 20 July 2010 (PDT)

User:Abajian

2010-01-27T20:52:01Z

Abajian: Initial Release

===Mark Abajian===

'''''NStED Science Team Software Support'''''

Senior Application Developer 
NASA Exoplanet Science Institute 
Mail Code 100-22 
Pasadena, California 91125-2200

Office: Morrisroe 172 
Voice: (626) 395-1811 
Cell: (818) 726-0372

Skype: markabajian 
iChat/AIM: mabajian@mac.com 
Yahoo!/MSN: msabajian@sbcglobal.net

=====Other Responsibilities=====
*NExScI Archives (KI SOS) Software Support
*NExScI Web-Based Services Software Support
*NITARP [[Luminous Data Miners Current Research Activities|"Luminous Data Miners"]] Support

[mailto:Mark.Abajian@caltech.edu Mark.Abajian@caltech.edu] 
[http://web.ipac.caltech.edu/~mabajian Mark's IPAC Home Page]