You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
\item Bringing individual resources to the RSP, e.g., additional compute paid for by individuals.
73
73
\end{itemize}
74
74
75
+
\subsubsection{Prompt Catalog Data Services}
76
+
\label{ssec:prompt_access}
77
+
78
+
The PPDB is under active development and represents a significant technical challenge.
79
+
At least initially, full query capabilities on all tables will not be available; instead, a more limited set of targeted services will be provided.
80
+
These restrictions arise from our process of learning how to work with the underlying database (Google BigQuery) in a cost-effective, scalable way.
81
+
82
+
For the difference image analysis catalogs, Rubin expects to provide an IVOA TAP service supporting full property-based ADQL queries over
83
+
the \emph{current} versions of all \texttt{DiaObject}s,
84
+
and the full contents of the \texttt{mpc\_orbits} and \texttt{SSObject} catalogs.
85
+
86
+
In order to support early prompt solar system and time-domain science, Rubin will additionally support dedicated query services for:
87
+
\begin{itemize}
88
+
\item Retrieval of all \texttt{DiaSource} or \texttt{DiaForcedSource} data associated with a given \texttt{DiaObject},
89
+
i.e., the data for a light curve;
90
+
\item Retrieval of all \texttt{SSSource} records for a given SSO, by its MPC designation or its Rubin ID; and
91
+
\item Retrieval of nearby-SSO data for a given \texttt{DiaSource} ID.
92
+
\end{itemize}
93
+
These additional query services will be linked to the results of \texttt{DiaObject} queries via the IVOA DataLink mechanism for service discovery and easy access to light curves in the RSP Portal and elsewhere.
94
+
A query service for the history of \texttt{DiaObject} record evolution is a stretch goal for the first release of the PPDB.
95
+
The PPDB will initially be configured to support these particular query patterns with efficient data clustering.
96
+
Experience with these query services will then inform further engineering effort on the PPDB
97
+
and future expansion to more general query capabilities.
98
+
99
+
Additional mechanisms will be provided that provide users with information on the presence of known SSOs near detected transients, so that overlap between moving-object orbits and static astrophysical transients can be understood, and expand on the linkages between Rubin SSO data and the MPC's own databases.
100
+
101
+
Note that several brokers are planning to aggregate the alert stream and offer query services;
102
+
Rubin expects this will cover many PPDB use cases in the interim before the PPDB is available.
103
+
The PPDB is prioritized as the second delivery milestone after EDP2 (\S~\ref{sssec:edp2}) and before DP2 (\S~\ref{ssec:dp2}), and is expected to become publicly available in the \ppdbdate\ time range.
104
+
105
+
The Rubin team is also working with partners in the community to provide access to key prompt catalog data products in the evolving community ``HATS'' format.
106
+
75
107
\subsection{Community Brokers}
76
108
\label{ssec:brokers}
77
109
Alerts are fully world-public and are accessible through one or more of the nine Rubin-endorsed Community Brokers\footnote{See \url{https://www.lsst.org/scientists/alert-brokers}}.
Copy file name to clipboardExpand all lines: alertproduction.tex
+2-39Lines changed: 2 additions & 39 deletions
Original file line number
Diff line number
Diff line change
@@ -116,8 +116,7 @@ \subsection{Prompt Images}
116
116
\subsection{Prompt Catalogs and the Prompt Products Database}
117
117
\label{ssec:ppdb}
118
118
119
-
The Prompt Products Database (PPDB) serves as Rubin's real-time catalog of transient, variable, and moving-object detections,
120
-
storing all prompt catalog data products and observation metadata and providing efficient access for scientific analysis.
119
+
The Prompt Products Database (PPDB) serves as Rubin's real-time catalog of transient, variable, and moving-object detections, storing all prompt catalog data products and observation metadata and providing efficient access for scientific analysis.
121
120
122
121
Upon initial release, the PPDB will include the \texttt{DiaObject}, \texttt{DiaSource}, and \texttt{DiaForcedSource}
123
122
catalogs (\citeds{LSE-163}) arising from detections in difference image analysis.
@@ -127,7 +126,6 @@ \subsection{Prompt Catalogs and the Prompt Products Database}
127
126
In addition, the initial public release of the PPDB will contain information on Solar System object observations
128
127
and discoveries arising from the Rubin data.
129
128
The key tables provided will be the following:
130
-
131
129
\begin{itemize}
132
130
\item\texttt{mpc\_orbits}: a clone of the master table maintained by the Minor Planet Center, one row per SSO;
133
131
\item\texttt{SSObject}: one row per SSO for those MPC-confirmed objects to which Rubin has contributed observations; and
@@ -136,49 +134,14 @@ \subsection{Prompt Catalogs and the Prompt Products Database}
136
134
represented in the PPDB in the DiaSource table,
137
135
and observations arising from Data Release-style processing of Rubin data, most notably DP2.
138
136
\end{itemize}
139
-
140
-
Additional mechanisms will be provided that
141
-
provide users with information on the presence of known SSOs near detected transients,
142
-
so that overlap between moving-object orbits and static astrophysical transients can be understood,
143
-
and expand on the linkages between Rubin SSO data and the MPC's own databases.
144
137
The overall data model and the schemas of these tables have evolved somewhat from the version presented in the DPDD
145
138
and those in previous Data Previews;
146
139
the updated data model has not yet been released, but will be available on the Rubin schema browser in advance of
147
140
the initial PPDB release.
148
141
149
-
\subsubsection{Prompt Catalog Data Services}
150
-
151
-
The PPDB is under active development and represents a significant technical challenge.
152
-
At least initially, full query capabilities on all tables will not be available;
153
-
instead, a more limited set of targeted services will be provided.
154
-
These restrictions arise from our process of learning how to work with the underlying database
155
-
(Google BigQuery) in a cost-effective, scalable way.
156
-
157
-
For the difference image analysis catalogs,
158
-
Rubin expects to provide an IVOA TAP service supporting full property-based ADQL queries over
159
-
the \emph{current} versions of all \texttt{DiaObject}s,
160
-
and the full contents of the \texttt{mpc\_orbits} and \texttt{SSObject} catalogs.
161
-
162
-
In order to support early prompt solar system and time-domain science, Rubin will additionally support dedicated query services for:
163
-
\begin{itemize}
164
-
\item Retrieval of all \texttt{DiaSource} or \texttt{DiaForcedSource} data associated with a given \texttt{DiaObject},
165
-
i.e., the data for a light curve;
166
-
\item Retrieval of all \texttt{SSSource} records for a given SSO, by its MPC designation or its Rubin ID; and
167
-
\item Retrieval of nearby-SSO data for a given DiaSource ID.
168
-
\end{itemize}
169
-
These additional query services will be linked to the results of \texttt{DiaObject} queries via the IVOA DataLink mechanism for service discovery and easy access to light curves in the RSP Portal and elsewhere.
170
-
A query service for the history of \texttt{DiaObject} record evolution is a stretch goal for the first release of the PPDB.
171
-
The PPDB will initially be configured to support these particular query patterns with efficient data clustering.
172
-
Experience with these query services will then inform further engineering effort on the PPDB
173
-
and future expansion to more general query capabilities.
174
-
175
-
Note that several brokers are planning to aggregate the alert stream and offer query services;
176
-
Rubin expects this will cover many PPDB use cases in the interim before the PPDB is available.
142
+
Query services for PPDB catalogs are described in \S\,\ref{ses:access}.
177
143
The PPDB is prioritized as the second delivery milestone after EDP2 (\S~\ref{sssec:edp2}) and before DP2 (\S~\ref{ssec:dp2}), and is expected to become publicly available in the \ppdbdate\ time range.
178
144
179
-
The Rubin team is also working with partners in the community to provide access to key
180
-
prompt catalog data products in the evolving community ``HATS'' format.
Copy file name to clipboardExpand all lines: datapreview.tex
+1-1Lines changed: 1 addition & 1 deletion
Original file line number
Diff line number
Diff line change
@@ -184,7 +184,7 @@ \subsubsection{Limitations}
184
184
The temporal baseline is short (approximately five months for the primary dataset) and the sky coverage, while substantial, does not span the full LSST footprint.
185
185
Image quality during the Science Validation surveys was variable, and the PSF exhibits spatial structure that does not yet meet full LSST requirements.
186
186
Some catalog columns described in the \dpdd{},~\citeds{LSE-163} may not be populated depending on the quality and volume of the input data and the maturity of the relevant pipeline algorithms.
187
-
DP2-specific documentation, including the catalog schema and known issues, will accompany the release at \url{dp-2.lsst.io}
187
+
DP2-specific documentation, including the catalog schema and known issues, accompanies the release and can be found at \url{dp-2.lsst.io}
0 commit comments