<?xml version='1.0'?>
<!DOCTYPE art SYSTEM 'http://www.biomedcentral.com/xml/article.dtd'>
<art>
   <ui>gb-2007-8-9-r203</ui>
   <ji>GBJ</ji>
   <fm>
      <dochead>Method</dochead>
      <bibl>
         <title>
            <p>A case study of the reproducibility of transcriptional reporter cell-based RNAi screens in <it>Drosophila</it></p>
         </title>
         <aug>
            <au id="A1" ca="yes">
               <snm>DasGupta</snm>
               <fnm>Ramanuj</fnm>
               <insr iid="I1"/>
               <email>ramanuj.dasgupta@med.nyu.edu</email>
            </au>
            <au id="A2">
               <snm>Nybakken</snm>
               <fnm>Kent</fnm>
               <insr iid="I2"/>
               <email>nybakken@brandeis.edu</email>
            </au>
            <au id="A3">
               <snm>Booker</snm>
               <fnm>Matthew</fnm>
               <insr iid="I3"/>
               <email>mbooker@genetics.med.harvard.edu</email>
            </au>
            <au id="A4">
               <snm>Mathey-Prevot</snm>
               <fnm>Bernard</fnm>
               <insr iid="I3"/>
               <email>bprevot@receptor.med.harvard.edu</email>
            </au>
            <au id="A5">
               <snm>Gonsalves</snm>
               <fnm>Foster</fnm>
               <insr iid="I1"/>
               <email>foster.gonsalves@med.nyu.edu</email>
            </au>
            <au id="A6">
               <snm>Changkakoty</snm>
               <fnm>Binita</fnm>
               <insr iid="I1"/>
               <email>binita.changkakoty@med.nyu.edu</email>
            </au>
            <au id="A7">
               <snm>Perrimon</snm>
               <fnm>Norbert</fnm>
               <insr iid="I3"/>
               <insr iid="I4"/>
               <email>perrimon@receptor.med.harvard.edu</email>
            </au>
         </aug>
         <insg>
            <ins id="I1">
               <p>New York University School of Medicine/Cancer Institute, Department of Pharmacology, First Avenue, New York, NY 10016, USA</p>
            </ins>
            <ins id="I2">
               <p>Boston Biomedical Research Institute, 64 Grove Street, Watertown, MA, 02472, USA</p>
            </ins>
            <ins id="I3">
               <p>Department of Genetics, Harvard Medical School, Avenue Louis Pasteur, Boston, MA 02115, USA</p>
            </ins>
            <ins id="I4">
               <p>Howard Hughes Medical Institute, Harvard Medical School, Avenue Louis Pasteur, Boston, MA 02115, USA</p>
            </ins>
         </insg>
         <source>Genome Biology</source>
         <issn>1465-6906</issn>
         <pubdate>2007</pubdate>
         <volume>8</volume>
         <issue>9</issue>
         <fpage>R203</fpage>
         <url>http://genomebiology.com/2007/8/9/R203</url>
         <xrefbib>
            <pubidlist>
               <pubid idtype="pmpid">17903264</pubid>
               <pubid idtype="doi">10.1186/gb-2007-8-9-r203</pubid>
            </pubidlist>
         </xrefbib>
      </bibl>
      <history>
         <rec>
            <date>
               <day>4</day>
               <month>6</month>
               <year>2007</year>
            </date>
         </rec>
         <revrec>
            <date>
               <day>5</day>
               <month>9</month>
               <year>2007</year>
            </date>
         </revrec>
         <acc>
            <date>
               <day>28</day>
               <month>9</month>
               <year>2007</year>
            </date>
         </acc>
         <pub>
            <date>
               <day>28</day>
               <month>09</month>
               <year>2007</year>
            </date>
         </pub>
      </history>
      <cpyrt>
         <year>2007</year>
         <collab>DasGupta et al; licensee BioMed Central Ltd.</collab>
         <note>This is an open access article distributed under the terms of the Creative Commons Attribution License (<url>http://creativecommons.org/licenses/by/2.0</url>), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.</note>
      </cpyrt>
      <shorttitle>
         <p>Short title: Reproducibility of RNAi screens</p>
      </shorttitle>
      <shortabs>
         <p>A second generation dsRNA library was used to re-assess factors that influence the outcome of transcriptional reporter-based whole-genome RNAi screens for the Wnt/Wingless (wg) and Hedgehog (hh)-signaling pathways.</p>
      </shortabs>
      <abs>
         <sec>
            <st>
               <p>Abstract</p>
            </st>
            <p>Off-target effects have been demonstrated to be a major source of false-positives in RNA interference (RNAi) high-throughput screens. In this study, we re-assess the previously published transcriptional reporter-based whole-genome RNAi screens for the Wingless and Hedgehog signaling pathways using second generation double-stranded RNA libraries. Furthermore, we investigate other factors that may influence the outcome of such screens, including cell-type specificity, robustness of reporters, and assay normalization, which determine the efficacy of RNAi-knockdown of target genes.</p>
         </sec>
      </abs>
   </fm>
   <meta>
      <classifications>
         <classification type="BMC" subtype="man_spc_id" id="30010016">Molecular biology</classification>
         <classification type="BMC" subtype="man_spc_id" id="30010010">Genome studies</classification>
         <classification type="BMC" subtype="man_spc_id" id="30010005">Development</classification>
      </classifications>
   </meta>
   <bdy>
      <sec>
         <st>
            <p>Background</p>
         </st>
         <p>In the past few years many groups have successfully conducted high-throughput RNA interference (RNAi) screens using cell-based assays, both in <it>Drosophila </it>and mammalian cells, to investigate a variety of biological questions <abbrgrp><abbr bid="B1">1</abbr><abbr bid="B2">2</abbr><abbr bid="B3">3</abbr><abbr bid="B4">4</abbr><abbr bid="B5">5</abbr><abbr bid="B6">6</abbr><abbr bid="B7">7</abbr><abbr bid="B8">8</abbr><abbr bid="B9">9</abbr></abbrgrp>. In <it>Drosophila</it>, the methodology relies upon the use of long double-stranded RNAs (dsRNAs) which, following uptake by the cells, are processed by Dicer2 into a pool of 21-23 bp small interfering RNAs (siRNAs) <abbrgrp><abbr bid="B10">10</abbr><abbr bid="B11">11</abbr></abbrgrp>. These siRNAs silence endogenous gene expression by triggering the cleavage of target mRNAs. In contrast to <it>Drosophila</it>, where long dsRNAs of more than 100 bp are used as RNAi reagents, 21-23 bp siRNAs are used directly in mammalian cells to avoid the detrimental interferon response triggered by the cells in response to long dsRNAs <abbrgrp><abbr bid="B12">12</abbr><abbr bid="B13">13</abbr><abbr bid="B14">14</abbr><abbr bid="B15">15</abbr></abbrgrp>.</p>
         <p>The development and application of genome-wide RNAi screens has occurred in parallel with a rapidly evolving understanding of the mechanism of RNAi, including the regulation and processing of dsRNAs, the factors that influence siRNA specificity and efficacy, as well as the biogenesis, expression and function of microRNAs (miRNAs) in cells <abbrgrp><abbr bid="B10">10</abbr><abbr bid="B16">16</abbr><abbr bid="B17">17</abbr></abbrgrp>. These recent developments have led to a much greater understanding of siRNAs and dsRNAs as RNAi reagents, especially with regards to their specificity in degrading the intended target gene <abbrgrp><abbr bid="B18">18</abbr><abbr bid="B19">19</abbr></abbrgrp>.</p>
         <p>The discovery of 'off-target effects' (OTEs) has played a critical role in promoting a much greater appreciation of various rules dictating siRNA specificity. OTEs were initially recognized as an important source of false positives in mammalian studies using single siRNAs for the knockdown of target genes <abbrgrp><abbr bid="B13">13</abbr><abbr bid="B20">20</abbr></abbrgrp>. Subsequently, studies conducted with pools of siRNAs targeting the same transcript revealed that OTEs could be reduced (albeit not always eliminated), as undesirable effects of single siRNAs bearing perfect or partial homologies to other gene coding regions or their 3' untranslated regions were diluted by the pooling method <abbrgrp><abbr bid="B21">21</abbr><abbr bid="B22">22</abbr><abbr bid="B23">23</abbr><abbr bid="B24">24</abbr></abbrgrp>. The protection against OTEs provided by pools of siRNAs was the main reason for arguing that OTEs would not be a significant issue in <it>Drosophila </it>or <it>Caenorhabditis elegans </it>screens, despite the fact that Dicer (RNase III ribonuclease)-mediated cleavage of long dsRNAs could give rise to siRNAs with partial (typically 19-21 bp) sequence complementarity to transcripts other than the intended target. Moreover, the failure to detect the existence of any member of the ubiquitous family of RNA-dependent RNA polymerase (RdRp) in <it>Drosophila </it>potentially eliminated the chances of any amplification step of target RNAs, hence limiting the effect of OTEs <abbrgrp><abbr bid="B25">25</abbr></abbrgrp>. As such, OTEs arising from the knockdown of unintended target genes were not thought to be a significant source of cellular phenotypes, and thus were thought unlikely to contribute to the rate of false positives in any high-throughput screen (HTS) in these organisms.</p>
         <p>This line of reasoning, however, had not been rigorously tested experimentally and was questioned in a review article by Echeverri and Perrimon <abbrgrp><abbr bid="B19">19</abbr></abbrgrp>. Shortly thereafter, two groups independently reported evidence for OTEs in <it>Drosophila </it>RNAi screens <abbrgrp><abbr bid="B18">18</abbr><abbr bid="B19">19</abbr><abbr bid="B26">26</abbr><abbr bid="B27">27</abbr></abbrgrp>. Together, these studies implicated identity stretches as short as 13 nucleotides (nt) for low complexity trinucleotide repeats (for example, CAN repeats) <abbrgrp><abbr bid="B27">27</abbr></abbrgrp> or slightly longer (17-19 nt and greater) for more complex sequence homologies <abbrgrp><abbr bid="B26">26</abbr></abbrgrp> as contributing to false positives in <it>Drosophila </it>RNAi screens. Although sequence homology can lead to OTEs, the mere presence of predicted-sequence homology to multiple transcripts does not necessarily translate into OTEs. For example the Kulkarni <it>et al</it>. study revealed that 50 of 135 predicted 19 nt off-target sequences (OTs) in a dsRNA designed to target the <it>PP2A-B</it>' gene did not cause any changes in expression levels of the corresponding mRNAs. This may reflect the fact that the problematic siRNAs were not produced <it>in vivo </it>because of the processivity exhibited by Dicer when acting on dsRNAs <abbrgrp><abbr bid="B10">10</abbr><abbr bid="B17">17</abbr><abbr bid="B28">28</abbr><abbr bid="B29">29</abbr></abbrgrp>, or if they were, that they were not effective in knocking down their cognate targets. Thus, <it>in silico </it>prediction of OTs will almost always over-estimate the incidence of OTEs that might occur with dsRNAs in an experimental setting.</p>
         <p>Here we investigate the extent to which OTEs contribute to the rate of false positives in the Wnt/Wingless (Wg) and Hedgehog (Hh) transcriptional reporter based RNAi-screens that were conducted in our laboratory <abbrgrp><abbr bid="B3">3</abbr><abbr bid="B6">6</abbr></abbrgrp>. These screens were performed using a first generation library of dsRNAs <abbrgrp><abbr bid="B2">2</abbr></abbrgrp>, referred to as DRSC1.0, which was assembled prior to recognition of the OTE issue. To avoid the issue of sequence-specific OTEs in genome-wide screens, we generated the DRSC 2.0 screening collection, and assembled as well an independent collection, DRSC-validation (DRSC-v), for independent confirmation of hits identified in initial screens. These libraries are composed of dsRNAs largely free of any predicted OTs. We used dsRNAs from the DRSC-v collection to target candidate genes obtained as 'hits' in our previous Wg and Hh screens. Our data show that the activity of 73% and 51% of the DRSC1.0 dsRNAs affecting the Wg- and Hh-responsive transcriptional reporter read-outs, respectively, could be reproduced in assays using the new validation dsRNAs. While cross-reacting sequences in dsRNAs can clearly lead to an increase in false positives, we also describe how other factors, such as cell-type specificity, use of specific normalization vectors, and properties of the transcriptional reporters, can have a major impact on the outcome of reporter-based RNAi screens.</p>
      </sec>
      <sec>
         <st>
            <p>Results and discussion</p>
         </st>
         <sec>
            <st>
               <p>New generation of DRSC dsRNA libraries</p>
            </st>
            <p>The overriding conclusion from previous studies was that the best way to provide better accuracy in RNAi screening with long dsRNAs was to design the dsRNAs as specifically as possible and use more than one dsRNA to rule out false positives <abbrgrp><abbr bid="B18">18</abbr><abbr bid="B19">19</abbr><abbr bid="B26">26</abbr></abbrgrp> (Supplementary Figure 2 in <abbrgrp><abbr bid="B26">26</abbr></abbrgrp>). To achieve this goal, we assembled a new dsRNA collection in which all (7,692) dsRNAs from the initial DRSC1.0 collection predicted to cross-hybridize with unintended targets were replaced with new, independently synthesized dsRNAs free of OTs. These new dsRNAs were combined with the rest of the original dsRNAs that target only the intended genes to make the 'DRSC 2.0' collection. For each new dsRNA, we selected a region that: was shared by all isoforms (if more than one transcript was transcribed from that gene); and was devoid of any predicted 19 nt sequence identity to other genes. Unique primers flanked with the T7 promoter were designed and used to amplify fly genomic DNA. Each PCR product was purified and an aliquot was transcribed <it>in vitro </it>to yield the corresponding dsRNA. In addition, approximately 6,000 dsRNAs in the original DRSC1.0 collection targeted genes solely predicted computationally (the so-called Heidelberg dsRNAs <abbrgrp><abbr bid="B2">2</abbr><abbr bid="B30">30</abbr></abbrgrp>. We removed the vast majority of these dsRNAs from the DRSC2.0 collection as there was little evidence to support the idea that their targets corresponded to <it>bona fide </it>genes, and kept only those (about 10%) for which there was independent confirmation of expression or of the validity of gene prediction in subsequent releases of the <it>Drosophila </it>genome annotation <abbrgrp><abbr bid="B31">31</abbr></abbrgrp>.</p>
            <fig id="F2">
               <title>
                  <p>Figure 2</p>
               </title>
               <caption>
                  <p>Properties of dsRNAs and reporter genes can influence the sensitivity of the RNAi assay</p>
               </caption>
               <text>
                  <p>Properties of dsRNAs and reporter genes can influence the sensitivity of the RNAi assay. <b>(a-c) </b>The dynamic range of validation dsRNAs is smaller than that of the DRSC1.0 dsRNAs, which could potentially increase the rate of false negatives. The effects of dsRNA-mediated knockdown of known Wg-pathway regulators were tested by measuring their effect on the Wg reporter activity. DRSC1.0 and DRSC-v dsRNAs were compared in parallel. Knockdown of <it>wg </it>and <it>arm </it>using DRSC1.0 dsRNAs resulted in 90% and 99% reduction in Wg-reporter activity, respectively ((a), black bars). On the other hand, validation dsRNAs for <it>wg </it>and <it>arm </it>reduced reporter activity by only 58% and 90%, respectively ((a), grey bars), suggesting that the DRSC-v dsRNAs for some genes may not be as efficient in targeting their endogenous transcripts. Some of the validation dsRNAs ((b), grey and light grey bars) targeting known negative regulators did not produce robust effects on reporter activity compared to their DRSC1.0 counterparts ((b), black bars), including <it>dlp</it>, <it>axn</it>, <it>skpA </it>and one dsRNA in the case of <it>slmb</it>. Two independent validation dsRNAs targeting the same gene could influence reporter activity to different extents (compare DRSC_v1 and DRSC-v2 dsRNAs for each target gene in (c)). <b>(d) </b>Finally, the number of Tcf binding sites in the Wg responsive luciferase reporter gene can affect the robustness (fold change) upon induction by Wg. Reporter gene carrying 8 (white bar), 12 (grey bar) or 16 (black bar) sites were co-transfected with wg expressing cDNA. Increasing the number of Tcf binding sites increased the fold induction of the luciferase reporter upon addition of both Wg or &#916;NLrp6 to induce the Wg pathway. All luciferase reporter assays were performed in 4 replicas and error bars represent the standard error between the four data points.</p>
               </text>
               <graphic file="gb-2007-8-9-r203-2"/>
            </fig>
            <p>Furthermore, to confirm the effects of dsRNAs identified in the initial screens, we decided to generate DRSC-v, which is composed of a set of second or third independent dsRNAs targeting a gene identified in a screen, even if the original dsRNA had no predicted OTs. To date, this ever expanding library contains about 7,000 distinct dsRNAs targeting 4,100 genes. The major consideration that went into the design of the validation dsRNAs was that, other than being free of predicted OTs, they should, if possible, not overlap with any of the dsRNAs used in the original DRSC1.0 collection. This was necessary to fulfill the requirement that a set of completely independent dsRNAs be used to confirm the original findings in a primary screen. However, because of the design restrictions, the regions of each gene that were available for targeting were much smaller than what was used for the original DRSC1.0 set. As a result, a majority of the validation dsRNAs are about 200-300 bp in length, as opposed to an average size of 400-500 bp for dsRNAs in the DRSC1.0 screening collection. Although we have failed to observe a strong correlation between size and efficacy in experiments reported here, it remains to be determined whether the smaller size of the validation dsRNAs might lead in some cases to lesser efficiency in knock-down as the probability of generating efficient siRNAs <it>in vivo </it>might be proportional to length.</p>
         </sec>
         <sec>
            <st>
               <p>Re-screening candidate dsRNAs isolated in the screen for regulators of the Wg and Hh pathway with OT-free dsRNAs</p>
            </st>
            <p>To examine the issue of false positives in previously published screens for the Wg and Hh signaling pathways <abbrgrp><abbr bid="B3">3</abbr><abbr bid="B6">6</abbr></abbrgrp>, we have re-assessed the effect of knocking down candidate genes using the new validation dsRNAs (Figure <figr fid="F1">1</figr>). We used the same dual luciferase-reporter assays as previously reported <abbrgrp><abbr bid="B3">3</abbr><abbr bid="B6">6</abbr></abbrgrp>. Since the efficacy of target knockdown could depend on the specific region of a given gene towards which a given dsRNA is designed, we used two independent OT-free dsRNAs for most candidate genes identified in the original screens.</p>
            <fig id="F1">
               <title>
                  <p>Figure 1</p>
               </title>
               <caption>
                  <p>Re-screening the candidate genes identified in previous Wg and Hh screens using the DRSC-v dsRNAs</p>
               </caption>
               <text>
                  <p>Re-screening the candidate genes identified in previous Wg and Hh screens using the DRSC-v dsRNAs. <b>(a-c) </b>Wg assay: 148 of 204 (73%) dsRNAs screened had reproducible effects on the Wg responsive reporter activity (a); 58% of the DRSC1.0 dsRNAs that were predicted to have OTEs repeated in the validation screen (b); while 84% of DRSC1.0 dsRNAs that were predicted to have &#8804;5 OTs could be reproduced with DRSC-v dsRNAs (c). <b>(d-f) </b>Hh assay: 179 of 351 (51%) validation dsRNAs had reproducible effects on the Hh responsive reporter activity (d); 24% of the DRSC1.0 dsRNAs that were predicted to have OTEs repeated in the validation screen (e); while 64% of DRSC1.0 dsRNAs that were predicted to have &#8804;5 OTs could be reproduced with DRSC-v dsRNAs (f).</p>
               </text>
               <graphic file="gb-2007-8-9-r203-1"/>
            </fig>
            <sec>
               <st>
                  <p>Wnt/Wg re-screen</p>
               </st>
               <p>The <it>Drosophila</it>-optimized dTF12 and mammalian-cell optimized STF16 reporters were used for validation screening of the candidate Wg-regulators. In this analysis, we re-screened only 204 of 238 dsRNAs that were previously reported in the Wg screen. The 34 dsRNAs that were omitted from the validation screen were those that targeted the <it>in silico </it>predicted (Heidelberg annotated) genes <abbrgrp><abbr bid="B2">2</abbr><abbr bid="B30">30</abbr></abbrgrp>. For 73% (148 of 204) of the genes isolated in the original Wg screen, at least one new DRSC-v dsRNA showed similar effects on the activity of the Wnt/Wg-responsive luciferase reporter as the original dsRNA (Figure <figr fid="F1">1a</figr>; Additional data files 1&amp;4). In addition, for approximately 40% (80 of the 204) of the original candidate genes tested, two independent OT-free dsRNAs had the same effect on the Wg reporter assay as the original dsRNA (Additional data file 1). Thus, while using multiple independent validation dsRNAs are useful to confirm hits, this approach alone is not definitive in confirming hits because in 68 cases (of the 204 genes screened), one out of three dsRNAs tested failed to give consistent results with the other two. This discrepancy most likely reflects that dsRNAs are not equally effective in knocking down target genes, perhaps as a result of differences in properties between original and validation dsRNAs. In our previous Wnt/Wg screen, we had identified 91 dsRNAs that shared greater than 5 possible 19 nt exact overlaps with other genes that could potentially result in non-specific, OT-related effects on Wg signaling activity (as described in Supplementary Figure S1A and Supplementary Table 2 in <abbrgrp><abbr bid="B3">3</abbr></abbrgrp>). Interestingly, 58% (53 of 91) of those candidate dsRNAs were validated in the re-screen using independent dsRNAs that do not share 19 nt homology with other transcribed genes (Figure <figr fid="F1">1b</figr>). On the other hand, of the 113 dsRNAs originally identified as candidate 'hits' in the Wg screen that had &#8804;5 19 nt OT identities, 85% (95 of 113) repeated using DRSC-v dsRNAs (Additional data file 2). In conclusion, our data suggest that much better reproducibility is observed with dsRNAs that lack any predicted 19 nt sequence overlap with other transcripts.</p>
            </sec>
            <sec>
               <st>
                  <p>Hh re-screen</p>
               </st>
               <p>The GL3-ptc&#916;136 reporter described by Nybakken <it>et al</it>. <abbrgrp><abbr bid="B6">6</abbr></abbrgrp> was used for re-screening the candidate genes isolated in the Hh-signaling screen. For the Hh assay, one or two new dsRNAs were generated targeting 351 of the genes found in the original screen (as with the Wg screen, it should be noted that the Heidelberg annotated presumptive genes were left out of the set to which new validation dsRNAs were generated). Of the 351 candidate Hh signaling genes targeted by the DRSC-v dsRNAs, 51% (179) had at least one new dsRNA score as a hit again in the GL3 assay (Figure <figr fid="F1">1d</figr>, Additional data file 3). Of the 351 genes retested, 285 had two, separate dsRNAs in the DRSC-v collection, and 66 had only one DRSV-v dsRNA. Of the 66 genes, 34 (52%) were re-confirmed with the single available DRSC-v dsRNA. Of the 285 genes re-tested with 2 new dsRNAs, 82 (29%) repeated as hits with both validation dsRNAs, while 22% (63) repeated as a hit with 1 one of the 2 validation dsRNAs (Additional data file 3). In the original Hh screen, 39% (197) of the candidate genes had >5 potential OTs when looking at possible 19 nt overlaps with other genes. Of these 197, 110 were re-tested in the DRSC-v screen (Additional data file 3). Only 24% (26 of 110) were found to have at least one new dsRNA that gave a similar effect as the original dsRNA in the GL3 assay (Figure <figr fid="F1">1e</figr>, Additional data file 3). Of the 241 genes that we retested that had &#8805;5 potential 19 nt OTs in the original screen, 64% (153) were validated using DRSC-v dsRNAs (Figure <figr fid="F1">1f</figr>). Thus, similar to the Wg screen, much better reproducibility was observed in the Hh screen with genes that, in the original screen, had been identified using dsRNAs lacking significant 19 nt sequence identity to other transcripts.</p>
            </sec>
         </sec>
         <sec>
            <st>
               <p>Analysis of <it>in silico </it>prediction of OTs and 'repeat-rate' in Wg and Hh validation screens</p>
            </st>
            <p>Our results suggest that there is not necessarily a strict correlation between the rate of false-positives and dsRNAs with multiple potential OT sequences. For the Wg screen, 58% of the genes isolated in the original screen that had >5 potential OT sequences can be revalidated using multiple, independent OT-free dsRNAs (Figure <figr fid="F1">1b</figr>), while only 24% of the genes found in the Hh screen that had >5 potential OTs could be revalidated using multiple, independent OT-free dsRNAs (Figure <figr fid="F1">1f</figr>). Given a lack of strict correlation between the presence of <it>in silico </it>predicted 19 nt homologies and false positives, results obtained with dsRNAs containing sequence homologies to other genes should not be disregarded as artifacts without further testing. Indeed, in the Hh screen, two very strong hits, <it>combgap </it>(<it>cg</it>), a known regulator of Hh signaling, and <it>Smrter </it>(<it>Smr</it>), a novel regulator of Hh signaling, were initially identified using dsRNAs with >400 potential 19 nt OTs. Retesting with two validation dsRNAs demonstrated that both are indeed strong regulators of Hh signaling.</p>
            <p>Conversely, our data also argue that not all dsRNAs targeting a gene are effective in knocking down that gene, regardless of possible OTEs. This notion is supported by the fact that, in the Wg screen, the use of independent dsRNAs confirmed 84% of DRSC1.0 dsRNAs that were not predicted to harbor any 19 nt homology (Figure <figr fid="F1">1c</figr>). The remaining 16% that could not be confirmed could be due to the fact that certain dsRNAs may not be effective at knocking down their cognate target or that additional contributing features in these dsRNAs (other than the strict 19 nt homology) might cause OTEs. Similarly, in the Hh screen independent dsRNAs confirmed 64% of the DRSC1.0 dsRNAs that were not predicted to harbor any 19 nt homology (Figure <figr fid="F1">1f</figr>). However, it is also important to consider the possibility that for those dsRNAs with no predicted 19 nt OT that failed to repeat with validation dsRNAs, they might in fact have an OT effect at less than 19 nt, perhaps in the 13-18 nt window.</p>
            <p>Overall, the validation rate for the entire Wg screen (73%) is similar to the average repeat rate between the >5 19 nt homology containing (58%) and the OT-free candidate dsRNAs (85%) reported in the previous Wg screen using the DRSC1.0 library. Furthermore, it is similar to the validation rates reported in another published screen <abbrgrp><abbr bid="B4">4</abbr></abbrgrp>. Similarly, for the Hh screen, 51% of the candidate dsRNAs could be re-validated using the OT-free validation dsRNAs from the DRSC-v library, a proportion similar to that passing secondary assays using the DRSC1.0 library <abbrgrp><abbr bid="B6">6</abbr></abbrgrp>.</p>
         </sec>
         <sec>
            <st>
               <p>Properties of dsRNAs and luciferase reporters that may affect assay sensitivity</p>
            </st>
            <p><it>In vitro </it>cell culture studies have suggested that the efficacy of knockdown of any given target mRNA is directly proportional to the length of the dsRNA introduced into a cell <abbrgrp><abbr bid="B17">17</abbr><abbr bid="B32">32</abbr></abbrgrp>. A longer dsRNA would typically produce a greater number of siRNAs upon Dicer-mediated cleavage and, hence, increase the likelihood that one or more of the siRNAs produced would efficiently knock down the targeted gene. However, in our overall analysis we could not find a statistically significant correlation between size of dsRNAs and magnitude of phenotype and we have clear examples where the converse is true. For example, knockdown of <it>supernumerary limbs (slmb)</it>, a known negative regulator of the Wg-pathway, using a shorter validation dsRNA from the DRSC-v collection had a greater effect in increasing reporter activity compared to the original DRSC1.0 dsRNA, suggesting that the difference in length alone could not always explain the reduced efficiency in the generation of a phenotype (Figure <figr fid="F2">2b</figr>, DRSC-v2 dsRNA for <it>slmb</it>).</p>
            <p>However, in the Wg assay, we do see a rough correlation between dsRNA size and dynamic range. In fact, when we compared the effects of dsRNAs from the DRSC1.0 collection targeting some of the known or newly identified candidate modulators of the Wg signaling pathway with those from the DRSC-v collection, we observed a surprising difference in the dynamic range in the effect of dsRNA knockdown on Wg-luciferase reporter activity (Figure <figr fid="F2">2</figr>). In many cases, it was significantly reduced when DRSC-v dsRNAs were used when compared to the corresponding DRSC1.0 dsRNAs (Figure <figr fid="F2">2</figr>). For example, using dsRNAs directed towards positive effectors for the Wg signaling pathway, we found that knocking down <it>armadillo </it>(<it>arm</it>) with a DRSC-v dsRNA reduced reporter activity by 90% as opposed to 99% with the DRSC1.0 dsRNA, in spite of transfection with equal amounts (100 ng) of the two dsRNAs (Figure <figr fid="F2">2a</figr>). Similarly, knocking down pathway activity using a DRSC-v <it>wg </it>dsRNA reduced reporter activity by approximately 55-60%, which was in sharp contrast to the DRSC1.0 <it>wg </it>dsRNA that reduced pathway activity by 90% (Figure <figr fid="F2">2a</figr>). On the other hand, knocking down some of the Wg-specific negative regulators, such as <it>slmb</it>, <it>skpA </it>and <it>dally-like protein </it>(<it>dlp</it>), or a novel candidate regulator <it>CG7177 </it>resulted in a moderate increase in reporter activity with only one of two DRSC-v dsRNAs. In the case of <it>axin </it>(<it>axn</it>), neither of the two DRSC-v dsRNAs re-validated in spite of <it>axn </it>RNAi having a robust effect on reporter activity with the DRSC1.0 dsRNA (Figure <figr fid="F2">2b,c</figr>).</p>
            <p>Although more work needs to be done, one possibility to explain the trend is that what really matters is the chance of generating siRNAs with high specificity and efficacy after processing by Dicer. It would be logical to assume in these cases that having a longer dsRNA will increase the chance of getting a better knockdown efficiency. The specificity and efficiency of targeting could be tested at the molecular level by assessing the microarray profile of cells upon knockdown of target genes using dsRNAs of varying lengths. Taken together, these data imply that the region towards which any given dsRNA is directed is also important and that a larger dsRNA may not necessarily be efficient in knocking down the intended target if its sequence intrinsically leads to the generation of poor siRNAs.</p>
            <p>Finally, we also noticed that the Wg-responsive luciferase reporter (dTF12 or STF16) used in the screen for novel interactors of the Wg pathway can be highly sensitive to the number of Tcf multimerized sites cloned into the reporter vector. We tested the activity of STF8, STF12 and STF16 using the dual-glo luciferase assay upon the induction of the pathway by co-transfection of cDNA encoding the <it>wg </it>gene in <it>clone 8 </it>cells (Figure <figr fid="F2">2d</figr>). We find that increasing the number of multimerized Tcf sites from 8&#215; to 16&#215; significantly increased the activation level of the reporter and, hence, the sensitivity of the assay. Addition of more than 16 Tcf binding sites did not enhance the pathway activity any further (data not shown).</p>
         </sec>
         <sec>
            <st>
               <p>Importance of proper normalization</p>
            </st>
            <p>An important aspect of any quantitative measurement of a biological phenomenon derived from cell-based assays is the need for normalization to account for experimental variations introduced by non-specific factors affecting assay readout. For example, most transient transfection assays need to be normalized for cell viability and transfection efficiency. Luciferase assay normalization is typically achieved by co-transfection of a control reporter expressing Renilla luciferase (RL) along with the experimental firefly luciferase expressing reporter. Two factors are especially important in the design of the control RL. First, the RL should be driven by a ubiquitously expressed promoter that is inert to the activity of the signaling pathway being analyzed. Second, the control Renilla vector should have activity significantly higher than background so that it is immune to background fluctuations inherent to most assays. The choice of the promoters driving RL thus becomes a matter of utmost importance, especially for large genome-scale RNAi screens, as poor normalization can lead to the introduction of significant artifacts in the screen, skewing data analysis and leading to erroneous conclusions.</p>
            <p>Control reporters that have been used in various studies include Actin5C-RL (Act-RL), PolIII-RL, pIZT-RL, Copia-RL, TK-RL, SV40-RL and pCMV-RL. We tested the applicability of these vectors in a <it>Drosophila </it>RNAi-mediated HTS (in 96-well plates) by measuring their activity in clone 8 cell transient transfections (Figure <figr fid="F3">3</figr>). The transfection protocol and assay conditions were the same as those used in our previously reported Wg and Hh HTSs. As shown in Figure <figr fid="F3">3a</figr>, the raw luciferase values for TK-RL, Copia-RL and SV40-RL either showed no activity or were barely above background. CMV-RL displayed moderate levels of activity. IZT-RL, Act-RL, and PolIII-RL on the other hand displayed robust luciferase activity, although PolIII-RL displayed a three- to five-fold higher activity compared to Act-RL and IZT-RL. Our results suggest that the lack of robust basal activity of TK-RL, Copia-RL or SV40-RL render them unsuitable for HTSs since minute changes in their activity could introduce profound changes in the normalized (N) luciferase activity or 'relative luciferase units' (RLU) as measured by the ratio of firefly and RL (RLU = firefly luciferase/RL). Moreover, the absolute RL counts would not be within the linear range of luciferase activity. PolIII-RL, Act-RL, and IZT-RL, on the other hand, serve as robust control reporters: they have high basal activity and display a broad dynamic range that can accommodate variations in reporter activity due to changes in cell viability, cell proliferation and transfection efficiency. These properties make them well suited for rigorous normalization protocols.</p>
            <fig id="F3">
               <title>
                  <p>Figure 3</p>
               </title>
               <caption>
                  <p>Importance of proper normalization for luciferase assays</p>
               </caption>
               <text>
                  <p>Importance of proper normalization for luciferase assays. <b>(a) </b>Assessment of basal activity of the RL vectors that are commonly used in luciferase reporter assays in <it>Drosophila </it>clone 8 cells in 96-well plate format. The SV40-RL, TK-RL, and Copia-RL vectors display no activity or very weak basal activity; approximately two to four times above background or negative control (no RL reporter added). CMV-RL displays weak activity (approximately 12 times above background) whereas pIZT-RL and pAct-RL display moderate basal activity (approximately 20 to 30 times above background). PolIII-RL displays the most robust activity among all the RL vectors tested (>1,000 times above background). <b>(b) </b>pAct-RL can be activated by transfecting cDNA expressing Wg or by dsRNA-mediated knockdown of known negative regulators (GSK-3&#946;, APC) of the Wg pathway in S2R+ cells, thus rendering it unusable as a control for transfection efficiency and cell viability in luciferase assays. <b>(c) </b>RL counts produced by transfection of the indicated Renilla control reporter and treatment with the indicated dsRNA in the Hh signaling assay. <b>(d) </b>Firefly luciferase counts produced by the ptc&#916;136 reporter when cotransfected with the indicated Renilla control reporter and dsRNA. <b>(e) </b>Graph showing the fold difference in ptc&#916;136 reporter activity in clone 8 cells treated with <it>smo </it>dsRNA versus GFP dsRNA in the presence of the indicated Renilla control reporter. Bars are the ratio of GFP dsRNA treated: <it>smo </it>dsRNA treated taken from the data in (c) and (d). All luciferase reporter assays were performed in triplicate and error bars represent the standard error between the three data points.</p>
               </text>
               <graphic file="gb-2007-8-9-r203-3"/>
            </fig>
            <p>However, for control vectors to be effective tools for normalization of signaling assays, they should not respond to the ligands that induce the activity of signaling pathways. Thus, we tested several control Renilla vectors for their effects on Wg and Hh induction. For Wg activation, PolIII-RL <abbrgrp><abbr bid="B3">3</abbr><abbr bid="B6">6</abbr></abbrgrp>, pIZT-RL <abbrgrp><abbr bid="B3">3</abbr></abbrgrp>, Copia-RL <abbrgrp><abbr bid="B7">7</abbr></abbrgrp>, and TK-RL (Promega) did not display any changes in activity upon Wg-stimulation (data not shown). However, the Act-RL vector was strongly activated by Wg induction in S2R+ cells (Figure <figr fid="F3">3b</figr>). To test if the effect on the Act promoter was specific to activation of Wg-signaling, we induced the pathway by dsRNA-mediated knockdown of GSK3&#946; and APC, which are known to be strong negative regulators of the Wg-pathway. RNAi of both GSK3&#946; and APC in S2R+ cells significantly activated Act-RL. Interestingly, scanning the sequence of the Actin5C promoter revealed at least two consensus Tcf binding sites, AaATCAAAG and cGATCAAAG. Whether these sites are true binding sites for Tcf proteins on the Actin promoter needs further testing. However, Act-RL should be avoided for normalization of Wg-induced reporters since its activity is sensitive to the activation of the Wg pathway.</p>
            <p>Sensitivity to pathway activation was also tested for RL normalization constructs used in the Hh assay. Hh assays were conducted using the Act-RL <abbrgrp><abbr bid="B33">33</abbr></abbrgrp>, PolIII-RL <abbrgrp><abbr bid="B3">3</abbr><abbr bid="B6">6</abbr><abbr bid="B33">33</abbr></abbrgrp>, and IZT-RL <abbrgrp><abbr bid="B3">3</abbr></abbrgrp> normalization constructs. Only PolIII-RL gave RL counts greater than 500, while the Pol II-RL, IZT-RL, and Act-RL constructs all gave less than 500 counts in green fluorescent protein (GFP) dsRNA treated control wells (Figure <figr fid="F3">3c</figr>). As background counts are typically between 50 and 100 in our Hh assays, RL levels for these latter three control constructs did not exceed the threshold of ten times background counts that we feel sufficient to put RL counts in the linear range. Firefly luciferase activity produced by the ptc&#916;136 reporter in transfections with the appropriate positive and negative control dsRNAs yielded the expected levels of ptc&#916;136 activity when using the PolII-RL, Act-RL, and PolIII-RL control reporters. However, for cells cotransfected with the IZT-RL control reporter, firefly luciferase activity in general is higher for all dsRNA treatments, but is considerably higher than normal in the Smo and Ci dsRNA treated cells (Figure <figr fid="F3">3d</figr>). This is apparently due to transactivation of the ptc&#916;136 reporter by the IZT-RL construct itself, thus rendering the IZT-RL unsuitable for use in the Hh signaling assay. Indeed, this can be seen more clearly when the fold differences between GFP dsRNA treated (Hh pathway activated) and Smo dsRNA treated (Hh pathway inactivated) wells are compared. Whereas there is normally a five- to seven-fold difference between these two values in assays in which PolIII-RL or Act-RL vectors are used for normalization, this difference falls to &lt;1.7-fold in assays in which IZT-RL is used as the normalization vector (Figure <figr fid="F3">3e</figr>). While the sensitivity of Act-RL and IZT-RL towards other signaling pathways such as Notch (N) and JAK/STAT and receptor tysosine kinase await further testing, it is imperative that all control RL vectors be subjected to similar tests before using them for normalizing any HTS luciferase-based assays.</p>
         </sec>
         <sec>
            <st>
               <p>Cell type specificity and robustness of pathway activity for signaling pathways: implications for whole genome RNAi screens</p>
            </st>
            <p>The specificity of proteins regulating the activity of cell signaling pathways is exquisitely regulated in space and time during animal development. Cell type specificity is achieved by the presence of a unique set of proteins and their isoforms, their sub-cellular localization, temporal modulation of their activity, and the quantitative differences in the expression levels of similar sets of factors. Therefore, the choice of a specific cell line in an RNAi HTS screen can result in the identification of different sets of genes in different cell types.</p>
            <p>This important issue comes to the forefront especially when comparing similar RNAi screens for the same pathway in two different cell types. For example, three of the dsRNAs (CG6606/l(1)G003, CG5402, CG12993) that were identified as 'candidate hits' in the previously published DasGupta <it>et al</it>. <abbrgrp><abbr bid="B3">3</abbr></abbrgrp> screen in clone 8 cells were reported to have no effect on reporter gene activity in S2R+ cells (Supplementary Table S3 in <abbrgrp><abbr bid="B3">3</abbr></abbrgrp>) - an observation independently confirmed by Ma <it>et al</it>. <abbrgrp><abbr bid="B27">27</abbr></abbrgrp>. This is a good example of where cell-type specific differences may factor into screen data obtained from two very different cell lines.</p>
            <p>In order to further address this issue, we investigated the effect of dsRNA-mediated knockdown of known positive and negative regulators of the Wg pathway in a variety of <it>Drosophila </it>cells (Figure <figr fid="F4">4</figr>). First, we tested four <it>Drosophila </it>cell types, namely clone 8, SL2, S2R+ and Kc167, for their responsiveness towards transfection of <it>wg </it>and &#916;NLrp6 (a constitutively activated form of the human ortholog of Lrp6 co-receptor; Figure <figr fid="F4">4</figr>). While the Wg-responsive reporter could be activated by co-transfecting cDNAs expressing either <it>wg </it>or &#916;NLrp6 in clone 8 and SL2 cells (Figure <figr fid="F4">4a,b</figr>), Kc167 and S2R+ responded to Wg only and not to the addition of &#916;NLrp6 (Figure <figr fid="F4">4c,d</figr>). This suggests that for a given signaling pathway, there are important differences in the responsiveness of different cell types to different components of the same signal transduction pathway. Moreover, the fold-change in normalized RLUs between Wg-stimulated and Wg-unstimulated was the greatest in the imaginal-disc derived clone 8 epithelial cells, with a 20-25&#215; activation over baseline, followed by S2R+ (10-15&#215; activation), Kc167 and SL2. Thus, for the Wg pathway, different cell types display both qualitative and quantitative differences in their ability to be activated by the Wg pathway.</p>
            <fig id="F4">
               <title>
                  <p>Figure 4</p>
               </title>
               <caption>
                  <p>Cell type specificity for signaling pathways</p>
               </caption>
               <text>
                  <p>Cell type specificity for signaling pathways. The basal activity and fold induction by Wg or &#916;NLrp6 is different in the variety of <it>Drosophila </it>cell lines tested. <b>(a-d) </b>The <it>wg </it>reporter can be induced by the expression of both Wg and &#916;NLrp6 in clone 8 and SL2 cells (a,b) but only with Wg in Kc167 and S2R+ cells (c,d). <b>(e,f) </b>dsRNA-mediated knockdown of known positive (e) and negative (f) regulators variably affect the activity of the Wg reporter in different cell lines. <b>(g,h) </b>Effect of dsRNA-mediated knockdown of <it>DFz2 </it>receptor in different cell types. RNAi inhibition of <it>DFz2 </it>inhibits Wg pathway activity in S2R+ cells (g) but not in clone 8 cells (h). <b>(i) </b>Western blot to detect expression of a negative regulator, Axn in clone 8, Kc167 and S2R+ cell lines. Levels of Axn in clone 8 cells is significantly lower than in S2R+ or Kc167. Anti-&#945;-tubulin antibody was used as a loading control (i). All luciferase reporter assays were performed in 4 replicas and error bars represent the standard error between the four data points.</p>
               </text>
               <graphic file="gb-2007-8-9-r203-4"/>
            </fig>
            <p>Additionally, dsRNA-mediated knockdown of several known positive and negative regulators of the Wg pathway showed different effects on modulating pathway activity in the different <it>Drosophila </it>cell lines (Figure <figr fid="F4">4e,f</figr>). Whereas downregulation of <it>pygo </it>and <it>legless </it>(<it>lgs</it>) in S2R+ cells had a stronger effect in reducing reporter activity compared to clone 8 or Kc167 cells, RNAi-mediated knockdown of <it>fz </it>inhibited reporter activity more efficiently in clone 8 cells than in S2R+ or Kc167 cells (Figure <figr fid="F4">4e</figr>). With respect to the known negative regulators, <it>axn </it>knockdown in S2R+ cells did not result in as significant an increase in reporter activity as in clone 8 or Kc167 cells. <it>Dlp </it>knockdown, on the other hand, had a greater effect in S2R+ than in clone 8 or Kc167 cells (Figure <figr fid="F4">4f</figr>).</p>
            <p>It was particularly interesting to note the failure of robust pathway activation in S2R+ cells by dsRNA-mediated knockdown of <it>axn </it>in the light of our observation that &#916;NLrp6 fails to activate the Wg-responsive luciferase reporter in S2R+ cells (Figure <figr fid="F4">4a-d</figr>). Recent studies have suggested that constitutively activated &#916;NLrp6 or a chimera between the <it>Frizzled2 </it>(<it>Dfz2</it>) receptor and intracellular cytoplasmic tail of the <it>Drosophila </it>ortholog of Lrp6 (encoded by the <it>arrow </it>(<it>arr</it>) gene) can activate the Wg pathway in a ligand-, GSK-3&#946;-, and <it>disheveled </it>(<it>dsh</it>)-independent manner <abbrgrp><abbr bid="B34">34</abbr></abbrgrp>. It was also demonstrated that expression of activated Lrp6 could recruit Axn to the plasma membrane and cause its degradation. Taken together, it is possible that the expression levels of <it>axn </it>are much higher or that the protein is more stable in S2R+ cells than in clone 8 cells. This could potentially result in an ineffective knockdown of <it>axn </it>levels using RNAi, hence explaining the inability of &#916;NLrp6 to activate the wg-reporter in S2R+ cells. In order to test this hypothesis, we performed western blot analysis on cellular protein extracts derived from clone 8, Kc167 and S2R+ cells and assessed the expression levels of the Axn protein using anti-Axn antibodies. As shown in Figure <figr fid="F4">4i</figr>, the level of Axn protein is significantly higher in S2R+ and Kc167 cells compared to that in clone 8 cells.</p>
            <p>Higher levels of Axn in S2R+ cells could be a result of high levels of Dfz2 expression, which was used as a basis for isolating the S2R+ cell line as a cell-based model for the Wg pathway <abbrgrp><abbr bid="B35">35</abbr></abbrgrp>. Increased Fz2 activity could subsequently activate expression of <it>axn</it>, which in mammalian cells, has been shown to be a target of the &#946;-catenin pathway <abbrgrp><abbr bid="B36">36</abbr><abbr bid="B37">37</abbr></abbrgrp>. In fact, the basal activity of the <it>wg </it>pathway in S2R+ cells is approximately ten-fold greater than in clone 8 cells (data not shown). It is thus tempting to speculate that the presence of the Dfz2 receptor might promote higher basal activity of the pathway in S2R+ and Kc167 cells and more potently activate expression of <it>axn </it>compared to that in SL2 or clone 8 cells. This might explain why &#916;NLrp6 can efficiently activate the wg reporter in clone 8 and SL2 cells but not in S2R+ or Kc167 cells (Figure <figr fid="F4">4a-d</figr>). In agreement with this notion, dsRNA-mediated knockdown of Dfz2 strongly inhibited the wg responsive luciferase reporter activity in S2R+ cells but not in clone 8 cells, which is most likely why we did not isolate Dfz2 in the previously reported Wg screen (Figure <figr fid="F4">4g,h</figr>; Figure S1 in <abbrgrp><abbr bid="B3">3</abbr></abbrgrp>). Moreover, knockdown of <it>axn </it>in clone 8 cells led to a stronger activation of the luciferase reporter compared to S2R+ cells (Figure <figr fid="F4">4f</figr>).</p>
            <p>Taken together, the activity of signaling pathways and their modulation by regulatory proteins within the cell can be highly variable in different cell types, depending on the specific cellular context, the quantitative levels of expression of various proteins and their sub-cellular localization. Hence, caution needs to be exercised when comparing the candidate 'hits' obtained in whole-genome screens for any given pathway performed in different cell types.</p>
         </sec>
         <sec>
            <st>
               <p>Assay timing</p>
            </st>
            <p>Another variable that can affect transfection-based luciferase assays is the interval between reporter transfection and the luciferase assay. This interval can be important in allowing time for protein expression/accumulation, recovery from transfection, and post-translational modifications. It has recently been suggested that the interval between reporter gene transfection and luciferase assay may affect reporter activity in Hh luciferase based assays. Specifically, Ma <it>et al</it>. <abbrgrp><abbr bid="B27">27</abbr></abbrgrp> have found that longer incubation periods after transfection reduces the fold difference in luciferase activity between the Hh stimulated and unstimulated states of their conditioned media-based Hh assays. In our initial characterization of the Hh assay, we had examined this possibility by how a one-day versus a four-day interval between transfection and luciferase assay might affect the Hh assay in clone 8 cells. As expected, we found that conducting the luciferase assays one day after transfection gave firefly luciferase values considerably lower than those obtained when the assays were conducted four days after transfection (Figure <figr fid="F5">5a</figr>). RL values were similarly lower in the one day assay compared to the four day assay (Figure <figr fid="F5">5b</figr>), and, in most cases, were near 10&#215; background, which tends to average between 50 and 100 counts in cells not transfected with any reporters (KN, data not shown). Interestingly, the normalized values were very similar for the one day and four day assays, indicating that the interval between transfection and luciferase assay is not a strong modulator of Hh reporter activity (Figure <figr fid="F5">5c</figr>). However, since we find that it is best to keep control reporter activity well above ten times background levels, we opted for a greater than four day interval between transfection and luciferase assay. The strong effect that Ma <it>et al</it>. saw in their assay is likely due to the fact that they used conditioned media containing the artificially truncated form of Hh, Hh-N, as the source of Hh stimulus. This Hh-N source is likely highly labile in addition to being of undetermined Hh activity, and probably accounts for the reduction in fold difference of their Hh assay with longer incubation periods.</p>
            <fig id="F5">
               <title>
                  <p>Figure 5</p>
               </title>
               <caption>
                  <p>Hh assay timing</p>
               </caption>
               <text>
                  <p>Hh assay timing. Hh signaling assays were conducted on identical assays plates with luciferase assays being scored after one or four days. <b>(a) </b>Comparison of RL counts when luciferase activity was assayed after one or four days in the presence of the indicated co-transfected dsRNA. <b>(b) </b>Comparison of firefly luciferase counts when luciferase activity was assayed after one or four days in the presence of the indicated co-transfected dsRNA. <b>(c) </b>Normalized luciferase values derived from the data in (a) and (b) of one-versus four-day assays. All luciferase reporter assays were performed in triplicate and error bars represent the standard error between the three data points.</p>
               </text>
               <graphic file="gb-2007-8-9-r203-5"/>
            </fig>
         </sec>
      </sec>
      <sec>
         <st>
            <p>Conclusion</p>
         </st>
         <p>RNAi technology has great potential to advance the field of signal transduction and cancer biology since it provides a direct method to systematically identify genes involved in signaling pathways implicated in development and disease. However, as with the development and application of most new and fast evolving technologies, a number of issues associated with rates of false positives and negatives have emerged in RNAi HTSs. In light of our experience and the lessons learned about the technology in recent years, we have examined the reproducibility of the Wg and Hh transcriptional reporter HTSs performed in our laboratory <abbrgrp><abbr bid="B3">3</abbr><abbr bid="B6">6</abbr></abbrgrp>.</p>
         <sec>
            <st>
               <p>Reproducibility of data from RNAi screens</p>
            </st>
            <p>As OTEs associated with long dsRNAs had been recognized to be a source of false positives in RNAi screens <abbrgrp><abbr bid="B26">26</abbr><abbr bid="B27">27</abbr></abbrgrp>, we re-screened the majority of the 'hits' identified in the previously reported Wnt/Wg and Hh screens using independent validation dsRNAs that were free of predicted off-targets (based on a 19 nt sequence identity criterion). Our analyses revealed that a majority of candidate genes (from 51-73%) identified in the Wg and Hh screens could be re-validated using at least one independent dsRNA. Importantly, 58% of the dsRNAs in the Wg screen that were predicted to have OTs, and potentially be a source of false positives, could be confirmed with validation dsRNAs, suggesting that the mere detection of 19 nt homologies from computational analyses leads to an overestimation of the prevalence of OTEs. However, we do confirm that it is predictive, as a significantly higher proportion (85%) of our original DRSC1.0 dsRNAs with &#8804;5 19 nt cross-hybridizing sequences could be confirmed with the new dsRNAs in the Wg signaling assay, and 64% could be confirmed in the Hh assay.</p>
            <p>Surprisingly, validation dsRNAs used in this study failed to identify some known negative regulators of Wnt signaling, such as <it>axn</it>, skpA and <it>slmb</it>, and some known negative regulators of Hh signaling, such as <it>ptc </it>and <it>slmb</it>, using either one or two independent dsRNAs. This underscores an important aspect of the validation process: although necessary, re-screening with new dsRNAs alone may not be sufficient in ruling out false positives in any specific screen. Since it may be non-trivial to design two or three independent OT-free dsRNAs that are comparable in their efficiency/ability to knockdown a target gene, screeners need to consider a balance between expunging the false positives and increasing the false negative rates in HTSs. Undoubtedly, the ultimate test for the validity of the candidate genes identified in any RNAi HTS lies in the validation of their function <it>in vivo </it>using traditional genetic and biochemical approaches.</p>
         </sec>
         <sec>
            <st>
               <p>Reproducibility with screens from other laboratories</p>
            </st>
            <p>In light of the inherent noise associated with RNAi HTSs, it is of interest to compare the differences between similar studies and attempt to understand the sources of discrepancy. In the screen published for the Wg pathway in S2R+ cells by Ma <it>et al</it>. <abbrgrp><abbr bid="B27">27</abbr></abbrgrp>, the authors point to disparities between the results of their RNAi screen and the one performed in clone 8 cells in our laboratory. The major reason for this disparity was ascribed to the prevalence of OTEs caused by tandem trinucleotide 'CAN-repeats' that were present in some of the long dsRNAs of the DRSC1.0 library. Importantly, some of the candidate dsRNAs that were reported by DasGupta <it>et al</it>. <abbrgrp><abbr bid="B3">3</abbr></abbrgrp> were shown to share short sequence homology with the <it>arm </it>gene, a critical regulator of the Wg pathway. While some of the differences can be explained by OTEs, other factors need also to be considered to account for the differences between the screens, including cell-type specific differences and differences in assay design. These include the use of different Wg-responsive reporters and control Renilla vectors, as well as differences in plate formats, protocols and assay conditions. Importantly, while the introduction of high concentrations of 30-40 bp short dsRNAs sharing sequence homology with multiple genes can clearly result in OTEs, it is difficult to predict, first, whether these siRNAs are even created in the cell upon the introduction of long dsRNAs, and second, when such an siRNA is created, whether its individual concentration in the siRNA pool would be sufficient to cause OTEs.</p>
            <p>The initial screen for the Wg pathway also identified several genes that had been previously reported in genetic screens designed to find genes that could interact with the Wg pathway, including <it>lilli</it>, <it>brahma</it>, <it>osa</it>, <it>cdc2</it>, <it>string </it>(cdc-25), <it>N</it>, <it>mastermind </it>(<it>mam</it>), and so on. Although some of these dsRNAs have predicted OT sequences, this prediction alone should not necessarily deter any effort to follow them up, nor should it <it>a priori </it>negate their validity as true interactors. A more fruitful exercise would be to compare multiple forward- and reverse-genetic screens and protein-interaction screens in order to judge the validity of candidate genes in one specific screen.</p>
            <p>It is also encouraging to find independent reports of new regulators being discovered for the Wnt pathway in different model systems that were also identified in our Wg screen with the DRSC1.0 library <abbrgrp><abbr bid="B3">3</abbr></abbrgrp>. For example, a recent report described the function of P68 RNA helicase, an ortholog of the <it>Drosophila </it>Rm62 gene identified in the Wg-sreen. This protein was described to cause the dissociation of Axn from &#946;-catenin and promote the nuclear translocation of the latter, thereby causing epithelial to mesenchymal transformation in human colon cancer cell lines <abbrgrp><abbr bid="B38">38</abbr></abbrgrp>. Additionally, we isolated the <it>Drosophila </it>Tip60/CG6121, which had not been identified in prior genetic screens for the Wg pathway. However, recent studies in human cells and colorectal cancer cell lines have shown that the &#946;-catenin carboxy-terminal activation domain associates with TIP60/TRAPPP and a mixed-lineage-leukemia (MLL1/MLL2) SET1-type chromatin-modifying complex <it>in vitro</it>, and that this complex promotes H3K4 trimethylation at the c-Myc target gene <it>in vivo </it><abbrgrp><abbr bid="B39">39</abbr><abbr bid="B40">40</abbr><abbr bid="B41">41</abbr></abbrgrp>. Similarly, in the Hh screen, the <it>roadkill </it>(<it>rdx</it>) gene (CG9924), encoding a ubiquitin ligase component, was identified as a negative regulator of Hh signaling in our screen. It was subsequently identified as a regulator of Hh signaling using traditional genetics means <abbrgrp><abbr bid="B42">42</abbr><abbr bid="B43">43</abbr></abbrgrp>.</p>
            <p>In conclusion, it is important to recognize that whole-genome RNAi screens using cell-based assays provide a technology platform for efficient enrichment for potential modulators of cell signaling pathways. Undoubtedly the ultimate validation will be in determining the function of the candidate genes <it>in vivo </it>in animal model systems, which is underway for several candidate genes obtained in the Wg and Hh screens (R DasGupta, RT Moon, and K Nybakken, unpublished). Additionally, our current understanding of OTEs associated with long dsRNAs is likely to be incomplete, and there may be other predictors (for example seed regions <abbrgrp><abbr bid="B22">22</abbr></abbrgrp>) that, under the given circumstances, need to be avoided. Clearly our efforts in designing better reagents are still evolving and they will continue to be a major focus of further investigation. The early experience with RNAi reagents has led to a better understanding of their specificities and has already resulted in useful recommendations for best usage of the technology. With this and future knowledge in hand, we expect to see many exciting applications in the next few years of this powerful technology. (Note: for further information about OTEs, please visit the <it>Drosophila </it>RNAi Screening Center <abbrgrp><abbr bid="B43">43</abbr></abbrgrp>.)</p>
         </sec>
      </sec>
      <sec>
         <st>
            <p>Materials and methods</p>
         </st>
         <sec>
            <st>
               <p>Generation of validation dsRNAs</p>
            </st>
            <p>PCR products with T7 polymerase sites on both ends for production of validation dsRNAs were obtained from the DRSC. They were further amplified by PCR using T7 primers and Takara (Tokyo, Japan) Taq polymerase and buffers. dsRNA was then produced using the Megascript kit (Ambion, Austin, Texas, USA). For T7 transcription, 6 &#956;l of the T7 PCR reaction was used in a 2&#215; (40 &#956;l) Megascript transcription reaction. dsRNAs were digested with DNAse for 30 minutes at 37&#176;C, then purified using Multiscreen purification plates (Millipore, Billerica, Massachusetts, USA) according to the manufacturer's instructions. dsRNAs were then quantified by spectrophotometry and diluted to 15 ng/&#956;l in deep-well 96-well storage plates. Validation screening plates were then generated by arraying dsRNAs from 4 &#215; 96-well storage plates into 384 well screening plates. For the screening plates, 75-100 ng of experimental or control dsRNA in 5 &#956;l water was aliquoted per well, the plates sealed, and then frozen at -20&#176;C until use.</p>
         </sec>
         <sec>
            <st>
               <p>Wg screen</p>
            </st>
            <p>We assayed a minimum of three replica plates for each DRSC-v dsRNA, the average of which is reported in this study. A 30% increase or decrease in reporter activity with respect to GFP dsRNA control was considered significant, based on the effect of DRSC-v dsRNAs directed against known regulators of the Wg pathway, such as <it>wg</it>, <it>dsh </it>and <it>fz</it>. The log ratio of normalized luciferase units were computed as log(N-drsc_v/N-gfp) and plotted on the bar graph (in Additional data file 4). Luciferase reporter assays were performed using protocols previously described in <abbrgrp><abbr bid="B3">3</abbr></abbrgrp>. All luciferase assays were performed in 96-well plate format using 25 ng each of Wg reporter and control Renilla vectors and 50 ng of inducer cDNA (pAct-wg). Cells were incubated with 100 ng dsRNAs for 4.5 days and luminescence measured using the EnVision plate reader (Perkin Elmer Life Sciences Inc., Waltham, Massachusetts, USA).</p>
         </sec>
         <sec>
            <st>
               <p>Hh screen</p>
            </st>
            <p>Hh assays were conducted as previously described <abbrgrp><abbr bid="B6">6</abbr></abbrgrp>. The validation assays were conducted three times. Normalized luciferase scores were converted to percentage changes with respect to GFP dsRNAs included in the plates as internal controls. These percentage changes were then averaged to give a final percentage change.</p>
         </sec>
         <sec>
            <st>
               <p>Timing and Renilla control reporter assays</p>
            </st>
            <p>Assays were conducted as per <abbrgrp><abbr bid="B6">6</abbr></abbrgrp> in 384-well plates, but 25 ng instead of 15 ng of the indicated Renilla control reporter were transfected and four replicate wells were assayed for each control reporter. Firefly and RL assays were conducted at the indicated times.</p>
         </sec>
         <sec>
            <st>
               <p>Western blotting</p>
            </st>
            <p>Standard protocols were used for cell lysis, PAGE and western blotting. The anti-Axin antibody was used at 1:1,000 dilution in 5% milk in TBST (0.1% tween) buffer at 4&#176;C overnight (O/N). HRP-conjugated secondary antibodies were used at 1:1,000 for 2 h at room temperature and the Pierce Supersignal WestPico Chemiluminescent kit (Pierce Biotechnology Inc., Rockford, Illinois, USA was used for detection.</p>
         </sec>
      </sec>
      <sec>
         <st>
            <p>Abbreviations</p>
         </st>
         <p>Act-RL, Actin5C-RL; DRSC-v, DRSC-validation; dsRNA, double-stranded RNA; GFP, green fluorescent protein; Hh, Hedgehog; HTS, high-throughput screens; miRNA, microRNA; nt, nucleotides; OT, off-target sequence; OTE, off-target effect; RLU, relative luciferase units; RL, Renilla luciferase;  RNAi, RNA interference; siRNA, small interfering RNA; Wg, Wnt/Wingless.</p>
      </sec>
      <sec>
         <st>
            <p>Authors' contributions</p>
         </st>
         <p>RD was responsible for research design, assays, data collection and analysis for Wg signaling and for manuscript production. KN was responsible for assays, data collection and analysis for Hh signaling as well as manuscript production. MB provided computational analyses for design and generation of validation dsRNAs. BM-P designed and generated validation dsRNAs. FG and BC were responsible for assays and data collection.  NP was responsible for research design, generation of validation dsRNAs and manuscript production. </p>
      </sec>
      <sec>
         <st>
            <p>Additional data files</p>
         </st>
         <p>The following additional data are available with the online version of this paper.</p>
         <p>Additional data file <supplr sid="S1">1</supplr> is a table listing the gene name, Curated Genes in the Drosophila genome based on gene predictions and previously characterized genes (CG#), and DRSC amplicon ID for all the new dsRNAs belonging to the DRSC-v library. The log-ratio of normalized luciferase units of experimental dsRNA (Nexp) with that of GFP dsRNA (Ngfp) is listed. Experiments were performed twice in triplicates (six data points for each gene tested). A consistent increase or decrease of at least 30% of the reporter activity with respect to the average of multiple negative controls (GFP dsRNA) was considered as a positive hit. Validation information for a second dsRNA is also provided for the genes that could be validated by the first amplicon. Additional data file <supplr sid="S2">2</supplr> is a table listing genes name and CG# provided for those dsRNAs that were reported to have multiple potential OTs in the previously published Wnt/wg screen of DasGupta <it>et al</it>. <abbrgrp><abbr bid="B3">3</abbr></abbrgrp>, but still pass the validation test with DRSV-v dsRNAs (first column). Also listed are genes/CG# representing dsRNAs that represent unique amplicons in the DasGupta <it>et al</it>. screen and still pass with validation dsRNAs of the DRSC-v library (column 2). Note that several dsRNAs of the DRSC1.0 library that were thought to have OTEs could be re-validated using unique DRSC-v amplicons. Moreover, not all unique dsRNAs of the DRSC1.0 library had reproducible effects on the modulation of the Wg reporter activity when a corresponding unique validation dsRNAs (DRSC-v) was used. Additional data file <supplr sid="S3">3</supplr> is a table listing the gene name, CG#, and DRSC amplicon number for all of the new dsRNAs tested in the Hh luciferase reporter assay. The number of potential off-targets calculated for the amplicon that was identified in the original Hh screen, based on a 19 bp window, is listed once for each gene. The average fractional change in reporter activity compared to GFP dsRNA controls (listed at the bottom) are presented, with scores between -0.25 and -0.50 highlighted in yellow, scores less than -0.50 highlighted in orange, and scores greater than or equal to + 0.50 highlighted in blue. At the bottom of the list, scores for GFP, Ci, Smo, and th dsRNA controls that were included in the assay plates are also indicated.</p>
         <suppl id="S1">
            <title>
               <p>Additional data file 1</p>
            </title>
            <caption>
               <p>Gene name, CG#, and DRSC amplicon ID for all the new dsRNAs belonging to the DRSC-v library.</p>
            </caption>
            <text>
               <p>The log-ratio of normalized luciferase units of experimental dsRNA (Nexp) with that of GFP dsRNA (Ngfp) is listed. Experiments were performed twice in triplicates (six data points for each gene tested). A consistent increase or decrease of at least 30% of the reporter activity with respect to the average of multiple negative controls (GFP dsRNA) was considered as a positive hit. Validation information for a second dsRNA is also provided for the genes that could be validated by the first amplicon.</p>
            </text>
            <file name="gb-2007-8-9-r203-S1.xls">
               <p>Click here for file</p>
            </file>
         </suppl>
         <suppl id="S2">
            <title>
               <p>Additional data file 2</p>
            </title>
            <caption>
               <p>Genes name and CG# provided for those dsRNAs that were reported to have multiple potential OTs in the previously published Wnt/wg screen of DasGupta <it>et al</it>. <abbrgrp><abbr bid="B3">3</abbr></abbrgrp>, but still pass the validation test with DRSV-v dsRNAs</p>
            </caption>
            <text>
               <p>Genes name and CG# provided for those dsRNAs that were reported to have multiple potential OTs in the previously published Wnt/wg screen of DasGupta <it>et al</it>. <abbrgrp><abbr bid="B3">3</abbr></abbrgrp>, but still pass the validation test with DRSV-v dsRNAs (first column). Also listed are genes/CG# representing dsRNAs that represent unique amplicons in the DasGupta <it>et al</it>. screen and still pass with validation dsRNAs of the DRSC-v library (column 2). Note that several dsRNAs of the DRSC1.0 library that were thought to have OTEs could be re-validated using unique DRSC-v amplicons. Moreover, not all unique dsRNAs of the DRSC1.0 library had reproducible effects on the modulation of the Wg reporter activity when a corresponding unique validation dsRNAs (DRSC-v) was used.</p>
            </text>
            <file name="gb-2007-8-9-r203-S2.xls">
               <p>Click here for file</p>
            </file>
         </suppl>
         <suppl id="S3">
            <title>
               <p>Additional data file 3</p>
            </title>
            <caption>
               <p>Gene name, CG#, and DRSC amplicon number for all of the new dsRNAs tested in the Hh luciferase reporter assay</p>
            </caption>
            <text>
               <p>The number of potential off-targets calculated for the amplicon that was identified in the original Hh screen, based on a 19 bp window, is listed once for each gene. The average fractional change in reporter activity compared to GFP dsRNA controls (listed at the bottom) are presented, with scores between -0.25 and -0.50 highlighted in yellow, scores less than -0.50 highlighted in orange, and scores greater than or equal to + 0.50 highlighted in blue. At the bottom of the list, scores for GFP, Ci, Smo, and th dsRNA controls that were included in the assay plates are also indicated.</p>
            </text>
            <file name="gb-2007-8-9-r203-S3.xls">
               <p>Click here for file</p>
            </file>
         </suppl>
         <suppl id="S4">
            <title>
               <p>Additional data file 4</p>
            </title>
            <caption>
               <p>Re-screening of candidate dsRNAs obtained in the DRSC1.0 screen with validation dsRNAs</p>
            </caption>
            <text>
               <p><it>Drosophila </it>Cl8 cells were transfected with validation dsRNAs and the Wg-responsive luciferase reporter (dTF12). The log ratio of normalized luciferase units were computed as log(N-drsc_v/N-gfp) and plotted on a bar graph. Candidate negative and positive regulators are represented by negative and positive log ratios respectively, as compared to the GFP dsRNA control. Since the ratio of N_gfp/N_gfp is 1, the log ratio for gfp dsRNA control is zero.</p>
            </text>
            <file name="gb-2007-8-9-r203-S4.ppt">
               <p>Click here for file</p>
            </file>
         </suppl>
      </sec>
   </bdy>
   <bm>
      <ack>
         <sec>
            <st>
               <p>Acknowledgements</p>
            </st>
            <p>We thank Dr Philip A Beachy for the gift of pCopia-Renilla and Dr Randall T Moon for pIZT-RL constructs. NP is an Investigator of the Howard Hughes Medical Institute. Work at the DRSC is supported by the NIGMS; grant no. R01 GM067761.</p>
         </sec>
      </ack>
      <refgrp>
         <bibl id="B1">
            <title>
               <p>Genome-wide RNAi analysis of JAK/STAT signaling components in Drosophila.</p>
            </title>
            <aug>
               <au>
                  <snm>Baeg</snm>
                  <fnm>GH</fnm>
               </au>
               <au>
                  <snm>Zhou</snm>
                  <fnm>R</fnm>
               </au>
               <au>
                  <snm>Perrimon</snm>
                  <fnm>N</fnm>
               </au>
            </aug>
            <source>Genes Dev</source>
            <pubdate>2005</pubdate>
            <volume>19</volume>
            <fpage>1861</fpage>
            <lpage>1870</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="pmcid">1186186</pubid>
                  <pubid idtype="pmpid" link="fulltext">16055650</pubid>
                  <pubid idtype="doi">10.1101/gad.1320705</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B2">
            <title>
               <p>Genome-wide RNAi analysis of growth and viability in Drosophila cells.</p>
            </title>
            <aug>
               <au>
                  <snm>Boutros</snm>
                  <fnm>M</fnm>
               </au>
               <au>
                  <snm>Kiger</snm>
                  <fnm>AA</fnm>
               </au>
               <au>
                  <snm>Armknecht</snm>
                  <fnm>S</fnm>
               </au>
               <au>
                  <snm>Kerr</snm>
                  <fnm>K</fnm>
               </au>
               <au>
                  <snm>Hild</snm>
                  <fnm>M</fnm>
               </au>
               <au>
                  <snm>Koch</snm>
                  <fnm>B</fnm>
               </au>
               <au>
                  <snm>Haas</snm>
                  <fnm>SA</fnm>
               </au>
               <au>
                  <snm>Consortium</snm>
                  <fnm>HF</fnm>
               </au>
               <au>
                  <snm>Paro</snm>
                  <fnm>R</fnm>
               </au>
               <au>
                  <snm>Perrimon</snm>
                  <fnm>N</fnm>
               </au>
            </aug>
            <source>Science</source>
            <pubdate>2004</pubdate>
            <volume>303</volume>
            <fpage>832</fpage>
            <lpage>835</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1126/science.1091266</pubid>
                  <pubid idtype="pmpid" link="fulltext">14764878</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B3">
            <title>
               <p>Functional genomic analysis of the Wnt-wingless signaling pathway.</p>
            </title>
            <aug>
               <au>
                  <snm>DasGupta</snm>
                  <fnm>R</fnm>
               </au>
               <au>
                  <snm>Kaykas</snm>
                  <fnm>A</fnm>
               </au>
               <au>
                  <snm>Moon</snm>
                  <fnm>RT</fnm>
               </au>
               <au>
                  <snm>Perrimon</snm>
                  <fnm>N</fnm>
               </au>
            </aug>
            <source>Science</source>
            <pubdate>2005</pubdate>
            <volume>308</volume>
            <fpage>826</fpage>
            <lpage>833</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1126/science.1109374</pubid>
                  <pubid idtype="pmpid" link="fulltext">15817814</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B4">
            <title>
               <p>A functional RNAi screen for regulators of receptor tyrosine kinase and ERK signalling.</p>
            </title>
            <aug>
               <au>
                  <snm>Friedman</snm>
                  <fnm>A</fnm>
               </au>
               <au>
                  <snm>Perrimon</snm>
                  <fnm>N</fnm>
               </au>
            </aug>
            <source>Nature</source>
            <pubdate>2006</pubdate>
            <volume>444</volume>
            <fpage>230</fpage>
            <lpage>234</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1038/nature05280</pubid>
                  <pubid idtype="pmpid" link="fulltext">17086199</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B5">
            <title>
               <p>A functional genomic analysis of cell morphology using RNA interference.</p>
            </title>
            <aug>
               <au>
                  <snm>Kiger</snm>
                  <fnm>AA</fnm>
               </au>
               <au>
                  <snm>Baum</snm>
                  <fnm>B</fnm>
               </au>
               <au>
                  <snm>Jones</snm>
                  <fnm>S</fnm>
               </au>
               <au>
                  <snm>Jones</snm>
                  <fnm>MR</fnm>
               </au>
               <au>
                  <snm>Coulson</snm>
                  <fnm>A</fnm>
               </au>
               <au>
                  <snm>Echeverri</snm>
                  <fnm>C</fnm>
               </au>
               <au>
                  <snm>Perrimon</snm>
                  <fnm>N</fnm>
               </au>
            </aug>
            <source>J Biol</source>
            <pubdate>2003</pubdate>
            <volume>2</volume>
            <fpage>27</fpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="pmcid">333409</pubid>
                  <pubid idtype="pmpid" link="fulltext">14527345</pubid>
                  <pubid idtype="doi">10.1186/1475-4924-2-27</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B6">
            <title>
               <p>A genome-wide RNA interference screen in Drosophila melanogaster cells for new components of the Hh signaling pathway.</p>
            </title>
            <aug>
               <au>
                  <snm>Nybakken</snm>
                  <fnm>K</fnm>
               </au>
               <au>
                  <snm>Vokes</snm>
                  <fnm>SA</fnm>
               </au>
               <au>
                  <snm>Lin</snm>
                  <fnm>TY</fnm>
               </au>
               <au>
                  <snm>McMahon</snm>
                  <fnm>AP</fnm>
               </au>
               <au>
                  <snm>Perrimon</snm>
                  <fnm>N</fnm>
               </au>
            </aug>
            <source>Nat Genet</source>
            <pubdate>2005</pubdate>
            <volume>37</volume>
            <fpage>1323</fpage>
            <lpage>1332</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1038/ng1682</pubid>
                  <pubid idtype="pmpid" link="fulltext">16311596</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B7">
            <title>
               <p>Identification of Hedgehog pathway components by RNAi in Drosophila cultured cells.</p>
            </title>
            <aug>
               <au>
                  <snm>Lum</snm>
                  <fnm>L</fnm>
               </au>
               <au>
                  <snm>Yao</snm>
                  <fnm>S</fnm>
               </au>
               <au>
                  <snm>Mozer</snm>
                  <fnm>B</fnm>
               </au>
               <au>
                  <snm>Rovescalli</snm>
                  <fnm>A</fnm>
               </au>
               <au>
                  <snm>Von Kessler</snm>
                  <fnm>D</fnm>
               </au>
               <au>
                  <snm>Nirenberg</snm>
                  <fnm>M</fnm>
               </au>
               <au>
                  <snm>Beachy</snm>
                  <fnm>PA</fnm>
               </au>
            </aug>
            <source>Science</source>
            <pubdate>2003</pubdate>
            <volume>299</volume>
            <fpage>2039</fpage>
            <lpage>2045</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1126/science.1081403</pubid>
                  <pubid idtype="pmpid" link="fulltext">12663920</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B8">
            <title>
               <p>A mutation in Orai1 causes immune deficiency by abrogating CRAC channel function.</p>
            </title>
            <aug>
               <au>
                  <snm>Feske</snm>
                  <fnm>S</fnm>
               </au>
               <au>
                  <snm>Gwack</snm>
                  <fnm>Y</fnm>
               </au>
               <au>
                  <snm>Prakriya</snm>
                  <fnm>M</fnm>
               </au>
               <au>
                  <snm>Srikanth</snm>
                  <fnm>S</fnm>
               </au>
               <au>
                  <snm>Puppel</snm>
                  <fnm>SH</fnm>
               </au>
               <au>
                  <snm>Tanasa</snm>
                  <fnm>B</fnm>
               </au>
               <au>
                  <snm>Hogan</snm>
                  <fnm>PG</fnm>
               </au>
               <au>
                  <snm>Lewis</snm>
                  <fnm>RS</fnm>
               </au>
               <au>
                  <snm>Daly</snm>
                  <fnm>M</fnm>
               </au>
               <au>
                  <snm>Rao</snm>
                  <fnm>A</fnm>
               </au>
            </aug>
            <source>Nature</source>
            <pubdate>2006</pubdate>
            <volume>441</volume>
            <fpage>179</fpage>
            <lpage>185</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1038/nature04702</pubid>
                  <pubid idtype="pmpid" link="fulltext">16582901</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B9">
            <title>
               <p>A genome-wide Drosophila RNAi screen identifies DYRK-family kinases as regulators of NFAT.</p>
            </title>
            <aug>
               <au>
                  <snm>Gwack</snm>
                  <fnm>Y</fnm>
               </au>
               <au>
                  <snm>Sharma</snm>
                  <fnm>S</fnm>
               </au>
               <au>
                  <snm>Nardone</snm>
                  <fnm>J</fnm>
               </au>
               <au>
                  <snm>Tanasa</snm>
                  <fnm>B</fnm>
               </au>
               <au>
                  <snm>Iuga</snm>
                  <fnm>A</fnm>
               </au>
               <au>
                  <snm>Srikanth</snm>
                  <fnm>S</fnm>
               </au>
               <au>
                  <snm>Okamura</snm>
                  <fnm>H</fnm>
               </au>
               <au>
                  <snm>Bolton</snm>
                  <fnm>D</fnm>
               </au>
               <au>
                  <snm>Feske</snm>
                  <fnm>S</fnm>
               </au>
               <au>
                  <snm>Hogan</snm>
                  <fnm>PG</fnm>
               </au>
               <etal/>
            </aug>
            <source>Nature</source>
            <pubdate>2006</pubdate>
            <volume>441</volume>
            <fpage>646</fpage>
            <lpage>650</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1038/nature04631</pubid>
                  <pubid idtype="pmpid" link="fulltext">16511445</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B10">
            <title>
               <p>Ribo-gnome: the big world of small RNAs.</p>
            </title>
            <aug>
               <au>
                  <snm>Zamore</snm>
                  <fnm>PD</fnm>
               </au>
               <au>
                  <snm>Haley</snm>
                  <fnm>B</fnm>
               </au>
            </aug>
            <source>Science</source>
            <pubdate>2005</pubdate>
            <volume>309</volume>
            <fpage>1519</fpage>
            <lpage>1524</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1126/science.1111444</pubid>
                  <pubid idtype="pmpid" link="fulltext">16141061</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B11">
            <title>
               <p>Use of double-stranded RNA interference in Drosophila cell lines to dissect signal transduction pathways.</p>
            </title>
            <aug>
               <au>
                  <snm>Clemens</snm>
                  <fnm>JC</fnm>
               </au>
               <au>
                  <snm>Worby</snm>
                  <fnm>CA</fnm>
               </au>
               <au>
                  <snm>Simonson-Leff</snm>
                  <fnm>N</fnm>
               </au>
               <au>
                  <snm>Muda</snm>
                  <fnm>M</fnm>
               </au>
               <au>
                  <snm>Maehama</snm>
                  <fnm>T</fnm>
               </au>
               <au>
                  <snm>Hemmings</snm>
                  <fnm>BA</fnm>
               </au>
               <au>
                  <snm>Dixon</snm>
                  <fnm>JE</fnm>
               </au>
            </aug>
            <source>Proc Natl Acad Sci USA</source>
            <pubdate>2000</pubdate>
            <volume>97</volume>
            <fpage>6499</fpage>
            <lpage>6503</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="pmcid">18635</pubid>
                  <pubid idtype="pmpid" link="fulltext">10823906</pubid>
                  <pubid idtype="doi">10.1073/pnas.110149597</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B12">
            <title>
               <p>Induction of an interferon response by RNAi vectors in mammalian cells.</p>
            </title>
            <aug>
               <au>
                  <snm>Bridge</snm>
                  <fnm>AJ</fnm>
               </au>
               <au>
                  <snm>Pebernard</snm>
                  <fnm>S</fnm>
               </au>
               <au>
                  <snm>Ducraux</snm>
                  <fnm>A</fnm>
               </au>
               <au>
                  <snm>Nicoulaz</snm>
                  <fnm>AL</fnm>
               </au>
               <au>
                  <snm>Iggo</snm>
                  <fnm>R</fnm>
               </au>
            </aug>
            <source>Nat Genet</source>
            <pubdate>2003</pubdate>
            <volume>34</volume>
            <fpage>263</fpage>
            <lpage>264</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1038/ng1173</pubid>
                  <pubid idtype="pmpid" link="fulltext">12796781</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B13">
            <title>
               <p>Short interfering RNAs can induce unexpected and divergent changes in the levels of untargeted proteins in mammalian cells.</p>
            </title>
            <aug>
               <au>
                  <snm>Scacheri</snm>
                  <fnm>PC</fnm>
               </au>
               <au>
                  <snm>Rozenblatt-Rosen</snm>
                  <fnm>O</fnm>
               </au>
               <au>
                  <snm>Caplen</snm>
                  <fnm>NJ</fnm>
               </au>
               <au>
                  <snm>Wolfsberg</snm>
                  <fnm>TG</fnm>
               </au>
               <au>
                  <snm>Umayam</snm>
                  <fnm>L</fnm>
               </au>
               <au>
                  <snm>Lee</snm>
                  <fnm>JC</fnm>
               </au>
               <au>
                  <snm>Hughes</snm>
                  <fnm>CM</fnm>
               </au>
               <au>
                  <snm>Shanmugam</snm>
                  <fnm>KS</fnm>
               </au>
               <au>
                  <snm>Bhattacharjee</snm>
                  <fnm>A</fnm>
               </au>
               <au>
                  <snm>Meyerson</snm>
                  <fnm>M</fnm>
               </au>
               <etal/>
            </aug>
            <source>Proc Natl Acad Sci USA</source>
            <pubdate>2004</pubdate>
            <volume>101</volume>
            <fpage>1892</fpage>
            <lpage>1897</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="pmcid">357023</pubid>
                  <pubid idtype="pmpid" link="fulltext">14769924</pubid>
                  <pubid idtype="doi">10.1073/pnas.0308698100</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B14">
            <title>
               <p>Activation of the interferon system by short-interfering RNAs.</p>
            </title>
            <aug>
               <au>
                  <snm>Sledz</snm>
                  <fnm>CA</fnm>
               </au>
               <au>
                  <snm>Holko</snm>
                  <fnm>M</fnm>
               </au>
               <au>
                  <snm>de Veer</snm>
                  <fnm>MJ</fnm>
               </au>
               <au>
                  <snm>Silverman</snm>
                  <fnm>RH</fnm>
               </au>
               <au>
                  <snm>Williams</snm>
                  <fnm>BR</fnm>
               </au>
            </aug>
            <source>Nat Cell Biol</source>
            <pubdate>2003</pubdate>
            <volume>5</volume>
            <fpage>834</fpage>
            <lpage>839</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1038/ncb1038</pubid>
                  <pubid idtype="pmpid" link="fulltext">12942087</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B15">
            <title>
               <p>Specific double-stranded RNA interference in undifferentiated mouse embryonic stem cells.</p>
            </title>
            <aug>
               <au>
                  <snm>Yang</snm>
                  <fnm>S</fnm>
               </au>
               <au>
                  <snm>Tutton</snm>
                  <fnm>S</fnm>
               </au>
               <au>
                  <snm>Pierce</snm>
                  <fnm>E</fnm>
               </au>
               <au>
                  <snm>Yoon</snm>
                  <fnm>K</fnm>
               </au>
            </aug>
            <source>Mol Cell Biol</source>
            <pubdate>2001</pubdate>
            <volume>21</volume>
            <fpage>7807</fpage>
            <lpage>7816</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="pmcid">99950</pubid>
                  <pubid idtype="pmpid" link="fulltext">11604515</pubid>
                  <pubid idtype="doi">10.1128/MCB.21.22.7807-7816.2001</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B16">
            <title>
               <p>MicroRNAs: genomics, biogenesis, mechanism, and function.</p>
            </title>
            <aug>
               <au>
                  <snm>Bartel</snm>
                  <fnm>DP</fnm>
               </au>
            </aug>
            <source>Cell</source>
            <pubdate>2004</pubdate>
            <volume>116</volume>
            <fpage>281</fpage>
            <lpage>297</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1016/S0092-8674(04)00045-5</pubid>
                  <pubid idtype="pmpid" link="fulltext">14744438</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B17">
            <title>
               <p>RNAi: double-stranded RNA directs the ATP-dependent cleavage of mRNA at 21 to 23 nucleotide intervals.</p>
            </title>
            <aug>
               <au>
                  <snm>Zamore</snm>
                  <fnm>PD</fnm>
               </au>
               <au>
                  <snm>Tuschl</snm>
                  <fnm>T</fnm>
               </au>
               <au>
                  <snm>Sharp</snm>
                  <fnm>PA</fnm>
               </au>
               <au>
                  <snm>Bartel</snm>
                  <fnm>DP</fnm>
               </au>
            </aug>
            <source>Cell</source>
            <pubdate>2000</pubdate>
            <volume>101</volume>
            <fpage>25</fpage>
            <lpage>33</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1016/S0092-8674(00)80620-0</pubid>
                  <pubid idtype="pmpid" link="fulltext">10778853</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B18">
            <title>
               <p>Minimizing the risk of reporting false positives in large-scale RNAi screens.</p>
            </title>
            <aug>
               <au>
                  <snm>Echeverri</snm>
                  <fnm>CJ</fnm>
               </au>
               <au>
                  <snm>Beachy</snm>
                  <fnm>PA</fnm>
               </au>
               <au>
                  <snm>Baum</snm>
                  <fnm>B</fnm>
               </au>
               <au>
                  <snm>Boutros</snm>
                  <fnm>M</fnm>
               </au>
               <au>
                  <snm>Buchholz</snm>
                  <fnm>F</fnm>
               </au>
               <au>
                  <snm>Chanda</snm>
                  <fnm>SK</fnm>
               </au>
               <au>
                  <snm>Downward</snm>
                  <fnm>J</fnm>
               </au>
               <au>
                  <snm>Ellenberg</snm>
                  <fnm>J</fnm>
               </au>
               <au>
                  <snm>Fraser</snm>
                  <fnm>AG</fnm>
               </au>
               <au>
                  <snm>Hacohen</snm>
                  <fnm>N</fnm>
               </au>
               <etal/>
            </aug>
            <source>Nat Methods</source>
            <pubdate>2006</pubdate>
            <volume>3</volume>
            <fpage>777</fpage>
            <lpage>779</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1038/nmeth1006-777</pubid>
                  <pubid idtype="pmpid" link="fulltext">16990807</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B19">
            <title>
               <p>High-throughput RNAi screening in cultured cells: a user's guide.</p>
            </title>
            <aug>
               <au>
                  <snm>Echeverri</snm>
                  <fnm>CJ</fnm>
               </au>
               <au>
                  <snm>Perrimon</snm>
                  <fnm>N</fnm>
               </au>
            </aug>
            <source>Nat Rev Genet</source>
            <pubdate>2006</pubdate>
            <volume>7</volume>
            <fpage>373</fpage>
            <lpage>384</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1038/nrg1836</pubid>
                  <pubid idtype="pmpid" link="fulltext">16607398</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B20">
            <title>
               <p>Small RNAs with imperfect match to endogenous mRNA repress translation. Implications for off-target activity of small inhibitory RNA in mammalian cells.</p>
            </title>
            <aug>
               <au>
                  <snm>Saxena</snm>
                  <fnm>S</fnm>
               </au>
               <au>
                  <snm>Jonsson</snm>
                  <fnm>ZO</fnm>
               </au>
               <au>
                  <snm>Dutta</snm>
                  <fnm>A</fnm>
               </au>
            </aug>
            <source>The Journal of biological chemistry</source>
            <pubdate>2003</pubdate>
            <volume>278</volume>
            <fpage>44312</fpage>
            <lpage>44319</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1074/jbc.M307089200</pubid>
                  <pubid idtype="pmpid" link="fulltext">12952966</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B21">
            <title>
               <p>Off-Target Effects: Disturbing the Silence of RNA interference (RNAi)</p>
            </title>
            <url>[http://www.gelifesciences.co.jp/technologies/sirna/pdf/ap_offtarget.pdf] </url>
         </bibl>
         <bibl id="B22">
            <title>
               <p>3' UTR seed matches, but not overall identity, are associated with RNAi off-targets.</p>
            </title>
            <aug>
               <au>
                  <snm>Birmingham</snm>
                  <fnm>A</fnm>
               </au>
               <au>
                  <snm>Anderson</snm>
                  <fnm>EM</fnm>
               </au>
               <au>
                  <snm>Reynolds</snm>
                  <fnm>A</fnm>
               </au>
               <au>
                  <snm>Ilsley-Tyree</snm>
                  <fnm>D</fnm>
               </au>
               <au>
                  <snm>Leake</snm>
                  <fnm>D</fnm>
               </au>
               <au>
                  <snm>Fedorov</snm>
                  <fnm>Y</fnm>
               </au>
               <au>
                  <snm>Baskerville</snm>
                  <fnm>S</fnm>
               </au>
               <au>
                  <snm>Maksimova</snm>
                  <fnm>E</fnm>
               </au>
               <au>
                  <snm>Robinson</snm>
                  <fnm>K</fnm>
               </au>
               <au>
                  <snm>Karpilow</snm>
                  <fnm>J</fnm>
               </au>
               <etal/>
            </aug>
            <source>Nat Methods</source>
            <pubdate>2006</pubdate>
            <volume>3</volume>
            <fpage>199</fpage>
            <lpage>204</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1038/nmeth854</pubid>
                  <pubid idtype="pmpid" link="fulltext">16489337</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B23">
            <title>
               <p>Mechanistic insights aid computational short interfering RNA design.</p>
            </title>
            <aug>
               <au>
                  <snm>Boese</snm>
                  <fnm>Q</fnm>
               </au>
               <au>
                  <snm>Leake</snm>
                  <fnm>D</fnm>
               </au>
               <au>
                  <snm>Reynolds</snm>
                  <fnm>A</fnm>
               </au>
               <au>
                  <snm>Read</snm>
                  <fnm>S</fnm>
               </au>
               <au>
                  <snm>Scaringe</snm>
                  <fnm>SA</fnm>
               </au>
               <au>
                  <snm>Marshall</snm>
                  <fnm>WS</fnm>
               </au>
               <au>
                  <snm>Khvorova</snm>
                  <fnm>A</fnm>
               </au>
            </aug>
            <source>Methods in enzymology</source>
            <pubdate>2005</pubdate>
            <volume>392</volume>
            <fpage>73</fpage>
            <lpage>96</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="pmpid" link="fulltext">15644176</pubid>
                  <pubid idtype="doi">10.1016/S0076-6879(04)92005-8</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B24">
            <title>
               <p>Off-target effects by siRNA can induce toxic phenotype.</p>
            </title>
            <aug>
               <au>
                  <snm>Fedorov</snm>
                  <fnm>Y</fnm>
               </au>
               <au>
                  <snm>Anderson</snm>
                  <fnm>EM</fnm>
               </au>
               <au>
                  <snm>Birmingham</snm>
                  <fnm>A</fnm>
               </au>
               <au>
                  <snm>Reynolds</snm>
                  <fnm>A</fnm>
               </au>
               <au>
                  <snm>Karpilow</snm>
                  <fnm>J</fnm>
               </au>
               <au>
                  <snm>Robinson</snm>
                  <fnm>K</fnm>
               </au>
               <au>
                  <snm>Leake</snm>
                  <fnm>D</fnm>
               </au>
               <au>
                  <snm>Marshall</snm>
                  <fnm>WS</fnm>
               </au>
               <au>
                  <snm>Khvorova</snm>
                  <fnm>A</fnm>
               </au>
            </aug>
            <source>RNA (New York, NY)</source>
            <pubdate>2006</pubdate>
            <volume>12</volume>
            <fpage>1188</fpage>
            <lpage>1196</lpage>
         </bibl>
         <bibl id="B25">
            <title>
               <p>Evidence that siRNAs function as guides, not primers, in the Drosophila and human RNAi pathways.</p>
            </title>
            <aug>
               <au>
                  <snm>Schwarz</snm>
                  <fnm>DS</fnm>
               </au>
               <au>
                  <snm>Hutvagner</snm>
                  <fnm>G</fnm>
               </au>
               <au>
                  <snm>Haley</snm>
                  <fnm>B</fnm>
               </au>
               <au>
                  <snm>Zamore</snm>
                  <fnm>PD</fnm>
               </au>
            </aug>
            <source>Mol Cell</source>
            <pubdate>2002</pubdate>
            <volume>10</volume>
            <fpage>537</fpage>
            <lpage>548</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1016/S1097-2765(02)00651-2</pubid>
                  <pubid idtype="pmpid" link="fulltext">12408822</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B26">
            <title>
               <p>Evidence of off-target effects associated with long dsRNAs in Drosophila melanogaster cell-based assays.</p>
            </title>
            <aug>
               <au>
                  <snm>Kulkarni</snm>
                  <fnm>MM</fnm>
               </au>
               <au>
                  <snm>Booker</snm>
                  <fnm>M</fnm>
               </au>
               <au>
                  <snm>Silver</snm>
                  <fnm>SJ</fnm>
               </au>
               <au>
                  <snm>Friedman</snm>
                  <fnm>A</fnm>
               </au>
               <au>
                  <snm>Hong</snm>
                  <fnm>P</fnm>
               </au>
               <au>
                  <snm>Perrimon</snm>
                  <fnm>N</fnm>
               </au>
               <au>
                  <snm>Mathey-Prevot</snm>
                  <fnm>B</fnm>
               </au>
            </aug>
            <source>Nat Methods</source>
            <pubdate>2006</pubdate>
            <volume>3</volume>
            <fpage>833</fpage>
            <lpage>838</lpage>
            <xrefbib>
               <pubid idtype="pmpid" link="fulltext">16964256</pubid>
            </xrefbib>
         </bibl>
         <bibl id="B27">
            <title>
               <p>Prevalence of off-target effects in Drosophila RNA interference screens.</p>
            </title>
            <aug>
               <au>
                  <snm>Ma</snm>
                  <fnm>Y</fnm>
               </au>
               <au>
                  <snm>Creanga</snm>
                  <fnm>A</fnm>
               </au>
               <au>
                  <snm>Lum</snm>
                  <fnm>L</fnm>
               </au>
               <au>
                  <snm>Beachy</snm>
                  <fnm>PA</fnm>
               </au>
            </aug>
            <source>Nature</source>
            <pubdate>2006</pubdate>
            <volume>443</volume>
            <fpage>359</fpage>
            <lpage>363</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1038/nature05179</pubid>
                  <pubid idtype="pmpid" link="fulltext">16964239</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B28">
            <title>
               <p>RNase III enzymes and the initiation of gene silencing.</p>
            </title>
            <aug>
               <au>
                  <snm>Carmell</snm>
                  <fnm>MA</fnm>
               </au>
               <au>
                  <snm>Hannon</snm>
                  <fnm>GJ</fnm>
               </au>
            </aug>
            <source>Nat Struct Mol Biol</source>
            <pubdate>2004</pubdate>
            <volume>11</volume>
            <fpage>214</fpage>
            <lpage>218</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1038/nsmb729</pubid>
                  <pubid idtype="pmpid" link="fulltext">14983173</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B29">
            <title>
               <p>Human Dicer preferentially cleaves dsRNAs at their termini without a requirement for ATP.</p>
            </title>
            <aug>
               <au>
                  <snm>Zhang</snm>
                  <fnm>H</fnm>
               </au>
               <au>
                  <snm>Kolb</snm>
                  <fnm>FA</fnm>
               </au>
               <au>
                  <snm>Brondani</snm>
                  <fnm>V</fnm>
               </au>
               <au>
                  <snm>Billy</snm>
                  <fnm>E</fnm>
               </au>
               <au>
                  <snm>Filipowicz</snm>
                  <fnm>W</fnm>
               </au>
            </aug>
            <source>Embo J</source>
            <pubdate>2002</pubdate>
            <volume>21</volume>
            <fpage>5875</fpage>
            <lpage>5885</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="pmcid">131079</pubid>
                  <pubid idtype="pmpid">12411505</pubid>
                  <pubid idtype="doi">10.1093/emboj/cdf582</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B30">
            <title>
               <p>An integrated gene annotation and transcriptional profiling approach towards the full gene content of the Drosophila genome.</p>
            </title>
            <aug>
               <au>
                  <snm>Hild</snm>
                  <fnm>M</fnm>
               </au>
               <au>
                  <snm>Beckmann</snm>
                  <fnm>B</fnm>
               </au>
               <au>
                  <snm>Haas</snm>
                  <fnm>SA</fnm>
               </au>
               <au>
                  <snm>Koch</snm>
                  <fnm>B</fnm>
               </au>
               <au>
                  <snm>Solovyev</snm>
                  <fnm>V</fnm>
               </au>
               <au>
                  <snm>Busold</snm>
                  <fnm>C</fnm>
               </au>
               <au>
                  <snm>Fellenberg</snm>
                  <fnm>K</fnm>
               </au>
               <au>
                  <snm>Boutros</snm>
                  <fnm>M</fnm>
               </au>
               <au>
                  <snm>Vingron</snm>
                  <fnm>M</fnm>
               </au>
               <au>
                  <snm>Sauer</snm>
                  <fnm>F</fnm>
               </au>
               <etal/>
            </aug>
            <source>Genome biology</source>
            <pubdate>2003</pubdate>
            <volume>5</volume>
            <fpage>R3</fpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="pmcid">395735</pubid>
                  <pubid idtype="pmpid" link="fulltext">14709175</pubid>
                  <pubid idtype="doi">10.1186/gb-2003-5-1-r3</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B31">
            <title>
               <p>A computational and experimental approach to validating annotations and gene predictions in the Drosophila melanogaster genome.</p>
            </title>
            <aug>
               <au>
                  <snm>Yandell</snm>
                  <fnm>M</fnm>
               </au>
               <au>
                  <snm>Bailey</snm>
                  <fnm>AM</fnm>
               </au>
               <au>
                  <snm>Misra</snm>
                  <fnm>S</fnm>
               </au>
               <au>
                  <snm>Shu</snm>
                  <fnm>S</fnm>
               </au>
               <au>
                  <snm>Wiel</snm>
                  <fnm>C</fnm>
               </au>
               <au>
                  <snm>Evans-Holm</snm>
                  <fnm>M</fnm>
               </au>
               <au>
                  <snm>Celniker</snm>
                  <fnm>SE</fnm>
               </au>
               <au>
                  <snm>Rubin</snm>
                  <fnm>GM</fnm>
               </au>
            </aug>
            <source>Proc Natl Acad Sci USA</source>
            <pubdate>2005</pubdate>
            <volume>102</volume>
            <fpage>1566</fpage>
            <lpage>1571</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="pmcid">545494</pubid>
                  <pubid idtype="pmpid" link="fulltext">15668397</pubid>
                  <pubid idtype="doi">10.1073/pnas.0409421102</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B32">
            <title>
               <p>Targeted mRNA degradation by double-stranded RNA in vitro.</p>
            </title>
            <aug>
               <au>
                  <snm>Tuschl</snm>
                  <fnm>T</fnm>
               </au>
               <au>
                  <snm>Zamore</snm>
                  <fnm>PD</fnm>
               </au>
               <au>
                  <snm>Lehmann</snm>
                  <fnm>R</fnm>
               </au>
               <au>
                  <snm>Bartel</snm>
                  <fnm>DP</fnm>
               </au>
               <au>
                  <snm>Sharp</snm>
                  <fnm>PA</fnm>
               </au>
            </aug>
            <source>Genes Dev</source>
            <pubdate>1999</pubdate>
            <volume>13</volume>
            <fpage>3191</fpage>
            <lpage>3197</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="pmcid">317199</pubid>
                  <pubid idtype="pmpid" link="fulltext">10617568</pubid>
                  <pubid idtype="doi">10.1101/gad.13.24.3191</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B33">
            <title>
               <p>High-throughput RNA interference screens in Drosophila tissue culture cells.</p>
            </title>
            <aug>
               <au>
                  <snm>Armknecht</snm>
                  <fnm>S</fnm>
               </au>
               <au>
                  <snm>Boutros</snm>
                  <fnm>M</fnm>
               </au>
               <au>
                  <snm>Kiger</snm>
                  <fnm>A</fnm>
               </au>
               <au>
                  <snm>Nybakken</snm>
                  <fnm>K</fnm>
               </au>
               <au>
                  <snm>Mathey-Prevot</snm>
                  <fnm>B</fnm>
               </au>
               <au>
                  <snm>Perrimon</snm>
                  <fnm>N</fnm>
               </au>
            </aug>
            <source>Methods in enzymology</source>
            <pubdate>2005</pubdate>
            <volume>392</volume>
            <fpage>55</fpage>
            <lpage>73</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1016/S0076-6879(04)92004-6</pubid>
                  <pubid idtype="pmpid" link="fulltext">15644175</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B34">
            <title>
               <p>Wg/Wnt signal can be transmitted through arrow/LRP5,6 and Axin independently of Zw3/Gsk3beta activity.</p>
            </title>
            <aug>
               <au>
                  <snm>Tolwinski</snm>
                  <fnm>NS</fnm>
               </au>
               <au>
                  <snm>Wehrli</snm>
                  <fnm>M</fnm>
               </au>
               <au>
                  <snm>Rives</snm>
                  <fnm>A</fnm>
               </au>
               <au>
                  <snm>Erdeniz</snm>
                  <fnm>N</fnm>
               </au>
               <au>
                  <snm>DiNardo</snm>
                  <fnm>S</fnm>
               </au>
               <au>
                  <snm>Wieschaus</snm>
                  <fnm>E</fnm>
               </au>
            </aug>
            <source>Developmental cell</source>
            <pubdate>2003</pubdate>
            <volume>4</volume>
            <fpage>407</fpage>
            <lpage>418</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1016/S1534-5807(03)00063-7</pubid>
                  <pubid idtype="pmpid" link="fulltext">12636921</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B35">
            <title>
               <p>Identification and characterization of a novel line of Drosophila Schneider S2 cells that respond to wingless signaling.</p>
            </title>
            <aug>
               <au>
                  <snm>Yanagawa</snm>
                  <fnm>S</fnm>
               </au>
               <au>
                  <snm>Lee</snm>
                  <fnm>JS</fnm>
               </au>
               <au>
                  <snm>Ishimoto</snm>
                  <fnm>A</fnm>
               </au>
            </aug>
            <source>The Journal of biological chemistry</source>
            <pubdate>1998</pubdate>
            <volume>273</volume>
            <fpage>32353</fpage>
            <lpage>32359</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1074/jbc.273.48.32353</pubid>
                  <pubid idtype="pmpid" link="fulltext">9822716</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B36">
            <title>
               <p>Wnt/beta-catenin/Tcf signaling induces the transcription of Axin2, a negative regulator of the signaling pathway.</p>
            </title>
            <aug>
               <au>
                  <snm>Jho</snm>
                  <fnm>EH</fnm>
               </au>
               <au>
                  <snm>Zhang</snm>
                  <fnm>T</fnm>
               </au>
               <au>
                  <snm>Domon</snm>
                  <fnm>C</fnm>
               </au>
               <au>
                  <snm>Joo</snm>
                  <fnm>CK</fnm>
               </au>
               <au>
                  <snm>Freund</snm>
                  <fnm>JN</fnm>
               </au>
               <au>
                  <snm>Costantini</snm>
                  <fnm>F</fnm>
               </au>
            </aug>
            <source>Mol Cell Biol</source>
            <pubdate>2002</pubdate>
            <volume>22</volume>
            <fpage>1172</fpage>
            <lpage>1183</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="pmcid">134648</pubid>
                  <pubid idtype="pmpid" link="fulltext">11809808</pubid>
                  <pubid idtype="doi">10.1128/MCB.22.4.1172-1183.2002</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B37">
            <title>
               <p>Negative feedback loop of Wnt signaling through upregulation of conductin/axin2 in colorectal and liver tumors.</p>
            </title>
            <aug>
               <au>
                  <snm>Lustig</snm>
                  <fnm>B</fnm>
               </au>
               <au>
                  <snm>Jerchow</snm>
                  <fnm>B</fnm>
               </au>
               <au>
                  <snm>Sachs</snm>
                  <fnm>M</fnm>
               </au>
               <au>
                  <snm>Weiler</snm>
                  <fnm>S</fnm>
               </au>
               <au>
                  <snm>Pietsch</snm>
                  <fnm>T</fnm>
               </au>
               <au>
                  <snm>Karsten</snm>
                  <fnm>U</fnm>
               </au>
               <au>
                  <snm>van de Wetering</snm>
                  <fnm>M</fnm>
               </au>
               <au>
                  <snm>Clevers</snm>
                  <fnm>H</fnm>
               </au>
               <au>
                  <snm>Schlag</snm>
                  <fnm>PM</fnm>
               </au>
               <au>
                  <snm>Birchmeier</snm>
                  <fnm>W</fnm>
               </au>
               <etal/>
            </aug>
            <source>Mol Cell Biol</source>
            <pubdate>2002</pubdate>
            <volume>22</volume>
            <fpage>1184</fpage>
            <lpage>1193</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="pmcid">134640</pubid>
                  <pubid idtype="pmpid" link="fulltext">11809809</pubid>
                  <pubid idtype="doi">10.1128/MCB.22.4.1184-1193.2002</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B38">
            <title>
               <p>P68 RNA Helicase Mediates PDGF-Induced Epithelial Mesenchymal Transition by Displacing Axin from beta-Catenin.</p>
            </title>
            <aug>
               <au>
                  <snm>Yang</snm>
                  <fnm>L</fnm>
               </au>
               <au>
                  <snm>Lin</snm>
                  <fnm>C</fnm>
               </au>
               <au>
                  <snm>Liu</snm>
                  <fnm>ZR</fnm>
               </au>
            </aug>
            <source>Cell</source>
            <pubdate>2006</pubdate>
            <volume>127</volume>
            <fpage>139</fpage>
            <lpage>155</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1016/j.cell.2006.08.036</pubid>
                  <pubid idtype="pmpid" link="fulltext">17018282</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B39">
            <title>
               <p>RORalpha coordinates reciprocal signaling in cerebellar development through sonic hedgehog and calcium-dependent pathways.</p>
            </title>
            <aug>
               <au>
                  <snm>Gold</snm>
                  <fnm>DA</fnm>
               </au>
               <au>
                  <snm>Baek</snm>
                  <fnm>SH</fnm>
               </au>
               <au>
                  <snm>Schork</snm>
                  <fnm>NJ</fnm>
               </au>
               <au>
                  <snm>Rose</snm>
                  <fnm>DW</fnm>
               </au>
               <au>
                  <snm>Larsen</snm>
                  <fnm>DD</fnm>
               </au>
               <au>
                  <snm>Sachs</snm>
                  <fnm>BD</fnm>
               </au>
               <au>
                  <snm>Rosenfeld</snm>
                  <fnm>MG</fnm>
               </au>
               <au>
                  <snm>Hamilton</snm>
                  <fnm>BA</fnm>
               </au>
            </aug>
            <source>Neuron</source>
            <pubdate>2003</pubdate>
            <volume>40</volume>
            <fpage>1119</fpage>
            <lpage>1131</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1016/S0896-6273(03)00769-4</pubid>
                  <pubid idtype="pmpid" link="fulltext">14687547</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B40">
            <title>
               <p>Transcriptional regulation of a metastasis suppressor gene by Tip60 and beta-catenin complexes.</p>
            </title>
            <aug>
               <au>
                  <snm>Kim</snm>
                  <fnm>JH</fnm>
               </au>
               <au>
                  <snm>Kim</snm>
                  <fnm>B</fnm>
               </au>
               <au>
                  <snm>Cai</snm>
                  <fnm>L</fnm>
               </au>
               <au>
                  <snm>Choi</snm>
                  <fnm>HJ</fnm>
               </au>
               <au>
                  <snm>Ohgi</snm>
                  <fnm>KA</fnm>
               </au>
               <au>
                  <snm>Tran</snm>
                  <fnm>C</fnm>
               </au>
               <au>
                  <snm>Chen</snm>
                  <fnm>C</fnm>
               </au>
               <au>
                  <snm>Chung</snm>
                  <fnm>CH</fnm>
               </au>
               <au>
                  <snm>Huber</snm>
                  <fnm>O</fnm>
               </au>
               <au>
                  <snm>Rose</snm>
                  <fnm>DW</fnm>
               </au>
               <etal/>
            </aug>
            <source>Nature</source>
            <pubdate>2005</pubdate>
            <volume>434</volume>
            <fpage>921</fpage>
            <lpage>926</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1038/nature03452</pubid>
                  <pubid idtype="pmpid" link="fulltext">15829968</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B41">
            <title>
               <p>The APC tumor suppressor counteracts beta-catenin activation and H3K4 methylation at Wnt target genes.</p>
            </title>
            <aug>
               <au>
                  <snm>Sierra</snm>
                  <fnm>J</fnm>
               </au>
               <au>
                  <snm>Yoshida</snm>
                  <fnm>T</fnm>
               </au>
               <au>
                  <snm>Joazeiro</snm>
                  <fnm>CA</fnm>
               </au>
               <au>
                  <snm>Jones</snm>
                  <fnm>KA</fnm>
               </au>
            </aug>
            <source>Genes Dev</source>
            <pubdate>2006</pubdate>
            <volume>20</volume>
            <fpage>586</fpage>
            <lpage>600</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="pmcid">1410807</pubid>
                  <pubid idtype="pmpid" link="fulltext">16510874</pubid>
                  <pubid idtype="doi">10.1101/gad.1385806</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
         <bibl id="B42">
            <title>
               <p>Roadkill attenuates Hedgehog responses through degradation of Cubitus interruptus.</p>
            </title>
            <aug>
               <au>
                  <snm>Kent</snm>
                  <fnm>D</fnm>
               </au>
               <au>
                  <snm>Bush</snm>
                  <fnm>EW</fnm>
               </au>
               <au>
                  <snm>Hooper</snm>
                  <fnm>JE</fnm>
               </au>
            </aug>
            <source>Development (Cambridge, England)</source>
            <pubdate>2006</pubdate>
            <volume>133</volume>
            <fpage>2001</fpage>
            <lpage>2010</lpage>
            <xrefbib>
               <pubid idtype="pmpid" link="fulltext">16651542</pubid>
            </xrefbib>
         </bibl>
         <bibl id="B43">
            <title>
               <p>A hedgehog-induced BTB protein modulates hedgehog signaling by degrading Ci/Gli transcription factor.</p>
            </title>
            <aug>
               <au>
                  <snm>Zhang</snm>
                  <fnm>Q</fnm>
               </au>
               <au>
                  <snm>Zhang</snm>
                  <fnm>L</fnm>
               </au>
               <au>
                  <snm>Wang</snm>
                  <fnm>B</fnm>
               </au>
               <au>
                  <snm>Ou</snm>
                  <fnm>CY</fnm>
               </au>
               <au>
                  <snm>Chien</snm>
                  <fnm>CT</fnm>
               </au>
               <au>
                  <snm>Jiang</snm>
                  <fnm>J</fnm>
               </au>
            </aug>
            <source>Developmental cell</source>
            <pubdate>2006</pubdate>
            <volume>10</volume>
            <fpage>719</fpage>
            <lpage>729</lpage>
            <xrefbib>
               <pubidlist>
                  <pubid idtype="doi">10.1016/j.devcel.2006.05.004</pubid>
                  <pubid idtype="pmpid" link="fulltext">16740475</pubid>
               </pubidlist>
            </xrefbib>
         </bibl>
      </refgrp>
   </bm>
</art>

