Pipeline output files overview

  • Updated

The following output files are created based on the Pipeline.

DNA, DNA + Protein and DNA + RNA + Protein pipelines

  • all.barcode.distribution.tsv.zip (DNA, DNA + Protein, DNA + RNA + Protein)
    This file reports the number of forward reads assigned to each amplicon for each barcode found in the run. GE output file SAMPLE_NAME_all_barcode_distribution.tsv is similar to the v2 pipeline's all barcode distribution file.

  • allele.drop.out.report.txt (DNA, DNA + Protein, DNA + RNA + Protein)
    This text file lists the variants used to calculate the allele dropout (ADO) rate. It shows the summary for the ADO calculation, such as the sample name, median ADO for the sample, number of variants, and total number of cells.

    Refer to this article to learn more about ADO calculation.

  • cell.barcode.distribution.tsv.zip (DNA, DNA + Protein, DNA + RNA + Protein)
    A file that reports the number of forward reads assigned to each amplicon for each cell found in a run. For more information, see this article.

  • cells.bam (DNA, DNA + Protein, DNA + RNA + Protein)
    A .bam file is a binary version of a sequence alignment map (SAM). For more information on these formats, refer to this PDF. To visualize these files, use tools like IGV. This file lists a read group (RG) tag for each read, which can be used to find the number of reads for the barcode. 

  • cells.bam.csi/cells.bam.bai (v2) (DNA, DNA + Protein, DNA + RNA + Protein)
    This is the .bam index file used by the IGV tool to view the alignments.

  • cells.vcf.gz (DNA, DNA + Protein)
    This compressed annotated .vcf file conforms to the standard GATK format. It contains all the variants for all the barcodes called as cells. 

  • dna.h5 (DNA only) / dna+protein.h5 (DNA + Protein only) / dna+rna+protein (DNA + RNA + Protein only)
    This is a multi-omics file format that contains the data for all the analytes in a single file. For more details, read this article. These files use the HDF5 format. 

  • fastp.html (DNA, DNA + Protein, DNA + RNA + Protein)
    This .html report file is generated by the FASTP tool that is used to check the input sequence quality. It reports various metrics and graphs, such as base quality – Q20 and Q30 base count and base content of the reads. This report can often be used to identify levels of primer dimers in a run. There is one file per analyte.

  • fastp.json (DNA, DNA + Protein, DNA + RNA + Protein)
    This file provides the FASTQ sequence quality information generated by the FASTP tool in the analysis pipeline, such as Q20 and Q30 base count and base content of the reads. There is one file per analyte.

  • qc.json (DNA, DNA + Protein, DNA + RNA + Protein)
    This file provides the results of the QC step in the DNA, DNA+Protein and DNA+RNA+RNA Pipeline run, including errors, warnings, and passing results.

  • mapped.bam (DNA, DNA + Protein, DNA + RNA + Protein)
    This file is generated after mapping to the reference genome and selecting high-quality primary alignments with a mapping quality score of > 30. It is generated after barcode correction and alignment but before cell calling. It maps all the barcodes in the run, and will contain on and off target reads. 
    A .bam file is a binary version of a sequence alignment map (SAM). For more information on these formats, refer to this PDF. To visualize these files, use tools like IGV.

  • metrics.json (DNA, DNA+Protein, DNA + RNA + Protein)
    This file contains the .HTML run report content in the .json format. It is a machine-readable format and provides an easy way to do additional analysis on the run report metrics.

  • report.html (DNA, DNA + Protein, DNA + RNA + Protein)
    This new .html report is generated for each run. It summarizes the run details in the form of various metrics and plots that can be used to understand the performance. For more details, see this section of the Pipeline User Guide.

  • tapestri_run_output.txt (DNA, DNA + Protein, DNA + RNA + Protein)
    This file provides the detailed log information for all the steps of the analysis pipeline. It should be used as a starting point to investigate any run failure.

  • <prefix>.r1_read_barcode_distribution.tsv (DNA + RNA + Protein only)  
    This file reports the number of forward reads assigned to each RNA amplicon for each barcode found in the RNA sample.  

  • <prefix>_barcode_metrics.txt (DNA + RNA + Protein only) 
    This file provides the total number of reads, reads after trimming, reads after barcode extraction/decoding, etc. It provides the aggregate metrics from the barcode extraction step. 

  • <prefix>_barcodes.txt (DNA + RNA + Protein only) 
    This .tsv file summarizes the barcodes, providing the read counts for each.

  • <prefix>.rna.h5 (DNA + RNA + Protein only) 
    This is the multi-omics file format for the RNA assay. It contains the RNA read counts assay in a Hierarchical Data Format (HDF5 or h5). It can be used for tertiary analysis in Mosaic.

  • <prefix>.barcodes_fixed.bam (DNA + RNA + Protein only) 
    This BAM file is generated when cell barcode are added as the RG tag for the reads aligned to the genome.

  • <prefix>.barcodes_fixed.bam.bai (DNA + RNA + Protein only) 
    This is the .bam index file used by the IGV tool to view the alignments.

  • <prefix>.intronic_filtered.bam (DNA + RNA + Protein only) 
    This BAM file is generated after filtering out the intronic reads and contains only the reads that are mapped to exons and will be counted for the rna read_counts_assay in h5.

  • <prefix>.intronic_filtered.bam.bai/<prefix>.intronic_filtered.bam.csi (DNA + RNA + Protein only) 
    This is the .bam index file used by the IGV tool to view the alignments.

  • star_alignment.log (DNA + RNA + Protein only) 
    This log file provides the details of the genome alignment step.

  • progress.log (DNA + RNA + Protein only) 
    A report on the individual steps performed by Tapestri RNA Pipeline.

  • barcode_extraction.log (DNA + RNA + Protein only)
    A log file that provides the details of the barcode extraction step.

Demultiplexed DNA and DNA+Protein 

This produces the same files as the regular DNA and DNA+Protein, in addition it generates the following files for each demultiplexed sample:

  • <sample>.h5
    This is a multi-omics file format that contains the data for a single sample. It contains the same analytes as the parent run. DNA demultiplexed samples will contain only DNA data and DNA+Protein sample will contain both.
  • <sample>.report.html
    HTML report for individual samples where some metrics and plots are recalculated for each sample.
  • <sample>metrics.json
    Json file with the HTML report file metrics.
  • <sample>.bam
    Filtered cells.bam file with the reads for the cells from the sample.
  • <sample>.bam.csi
    Index file for the bam file.

Merge Bulk Runs

The Merge Bulk Runs Pipeline generates 2 outputs:

  • germline_truth.csv 
    This is a CSV containing a list of differentiating germline variants between the samples along with the genotype information. This file is the Sample Variants input to the Genotype Demultiplexing runs.
  • candidate_variants.html 
    This is an HTML report for the pipeline and displays the information on the germline variants from each sample. It can be used to identify if the samples are genotypically different and if they should be multiplexed together in a single Tapestri run.

Merge Samples

The Merge Samples Pipeline generates a single merged .h5 file that contains different assays, depending on the analytes present in the input runs. 

  1. Merge 2 or more DNA-only runs – Merged .h5 file with only the DNA-related assays – dna_variants and dna_read_counts.
  2. Merge 2 or more DNA + Protein runs – Merged .h5 file with DNA and protein assays – dna_variants, dna_read_counts, and protein_read_counts.
  3. Merge DNA and DNA + Protein runs – Merged .h5 file with only the DNA-related assays – dna_variants and dna_read_counts.

 

Share this article:

Was this article helpful?

10 out of 10 found this helpful

Have more questions? Submit a request