MiModD v0.1.6 - Release Notes 
============================= 

changes in 0.1.6.1:
-------------------

This is the first bug-fix release for the 0.1.6 series, but also brings one 
small new feature.

new features/enhancements:
..........................
- the vcf-filter tool has acquired a new --af option enabling variant filtering 
  by allelic fractions

bug-fixes:
..........
see also https://sourceforge.net/p/mimodd/tickets/milestone/0.1.6.1/
  
- the internal version of the SNAP aligner bundled with MiModD can finally deal 
  with fasta reference files written under Windows; the longstanding issue with 
  Windows-style line endings has been fixed
- realigning previously aligned data to a reference genome with different 
  sequence names is now possible
- sam/bam header parsing is now less strict than before: if any standard header 
  line contains an unknown tag the header is no longer considered invalid, but 
  the unknown tag is silently dropped; the GO tag has been added to the known 
  tags of the @HD record type
- vcf meta section handling and parsing has been improved eliminating a bug 
  with RG information containing characters with special meaning inside vcf 
- sequence names in reference genomes or user-provided through the reheader 
  tool are now checked for characters incompatible with any analyses steps and 
  the improved sanitize tool can be used to correct reference genome sequence 
  names automatically
- filtering vcfs now works even if some records do not specify all of the 
  specified filter fields
- sorting SAM files directly from the Galaxy interface has been enabled
- the reheader Galaxy tool can now replace several read group IDs and sequence 
  names at a time; a bug in the tool wrapper prevented this in previous 
  versions
- lots of error messages have been improved



changes in 0.1.6:
-----------------

Lots of novel features have made it into this new release making MiModD more 
efficient and simple to use.

new features/enhancements:
..........................

- split-on-rgs has been added as a new parameter to the convert tool and 
  enables by-read-group splitting into multiple output files during conversion
- conversion from sam/bam files to fastq has been added to the convert tool
- the cloudmap tool has been reworked: the user interface is more powerful now 
  allowing for three-sample mapping analyses and the underlying algorithm for 
  the detection of informative variants has been improved resulting in more 
  robust analysis results
- filtering out anomalous overlapping read pairs from paired-end alignments has 
  been improved: in the snap tool, the old --max-mate-overlap option has been 
  dropped in favour of a new --discard-overlapping-mates option, which allows 
  more fine-grained control over which types of overlapping mates should be 
  removed
- aligning with the snap tool has been implemented more efficiently: 
  runs should be between 10% - 40% faster depending on the system with more 
  homogenous usage of cpu time and less temporary disk space usage
- the command line parser has been cleaned up to include only fully tested 
  tools for data analysis. 
  Tools for managing the installation (the former subcommands config and 
  enable-galaxy and the new upgrade tool) are now accesible exclusively via:
  python3 -m MiModD.<tool name>
  In addition, we are going to use this new command space to try out new tools 
  before adding them to the analysis tool interface. The index tool added in 
  the previous release is an example for such a tool and this version features:
- a novel in-development tool: sanitize
  available as python3 -m MiModD.sanitize, this tool is intended as a format 
  sanitizer for the various input file formats supported by MiModD. Currently, 
  its only functionality is to rewrite fasta files to ensure they are 
  compatible with MiModD
- MiModD now uses samtools 1.2 for variant calling resulting in somewhat more 
  reliable calls
- we have started to rework the exception hierarchy in the package, which 
  should result in nicer and clearer error messages in the long run (you may 
  observe some of the effects already)

bug fixes:
..........
- we have substantially increased test coverage for the package
- this has led to the discovery of a number of minor bugs, which have been 
  fixed



changes in 0.1.5.2:
-------------------

v0.1.5.2 is the second bug-fix release for the 0.1.5 series.

new features/enhancements:
..........................
- bam files can be indexed using:
    python3 -m MiModD.index <input bam>

bug-fixes:
..........
see also https://sourceforge.net/p/mimodd/tickets/milestone/0.1.5.2/
  
- all tools can now deal with whitespace-containing arguments and the temporary 
  files directory may now contain whitespace (and other special characters) in 
  their path
- added compatibility with SnpEff version 4.1
- snap tool single-end reads alignment was broken in v0.1.5.1 and is now 
  working again
- fixed a bug in varextract that caused a rare error with pre-calculated vcf 
  input
- slightly more robust vcf header parsing and writing


  
changes in 0.1.5.1:
-------------------

v0.1.5.1 is our first bug-fix release for the 0.1.5 series.
In addition, it brings a major enhancement in the cloudmap tool.

new features/enhancements:
..........................
the cloudmap tool has been redesigned:
- the former separate modes "VARIANT" and "HAWAIIAN" have been unified into a 
  single "VAF" (variant allele frequency) mode. The underlying algorithms have 
  also been merged to perform variant and Hawaiian mapping analysis 
  simultaneously. The new tool is more powerful than the previous version and 
  easier to use.
- the former "EMS" mode has been renamed to "SVD" (simple variant density) mode, 
  accordingly.

bug fixes:
..........
  see https://sourceforge.net/p/mimodd/tickets/milestone/0.1.5.1/
  

    
changes in 0.1.5:
-----------------

v0.1.5 is the first STABLE release of MiModD!

new features/enhancements:
..........................
completely refactored variant calling:
- the former varcall variant calling tool functionality is now distributed over 
  three tools (varcall, varextract, covstats)
- varcall now produces bcf output (including every reference base), from which 
  varextract generates a vcf of just variant sites. covstats and delcall both 
  use the bcf to extract coverage information and the former cov format has 
  been removed
- this change reduces IO overhead, increases individual tool speed and 
  increases the overall pipeline efficiency because varextract, covstats and 
  delcall can all work in parallel
- the redesign also simplifies mapping-by-sequencing approaches and goes hand 
  in hand with
  
improved CloudMap support through the new cloudmap tool (replacing the old 
cm-seqdict)

extended info tool
- the tool can now report not only samples, but also most other 
  meta-information encoded in supported formats
- these formats now include bcf and fasta

improved Galaxy interoperability
- all MiModD tools now respect GALAXY_SLOTS settings
- MiModD can now be configured via an environmental variable, which is very 
  helpful for Galaxy Tool Shed installations (see the updated installation 
  instructions for details
- enable-galaxy now works with old (universe.wsgi.ini-based) and new 
  (config/galaxy.ini-based) versions of Galaxy and does not copy its xml 
  wrappers into Galaxy anymore, but links them in the .ini file

SnpEff v4 compatibility

bug fixes (incomplete list)
...........................
- snap bug that prevented the tool from working correctly on OS X Yosemite
- a severe bug prevented the reheader tool from keeping its promise to produce 
  valid output under all circumstances
- header tags are now sorted when printing SAM headers



changes in 0.1.4.1
------------------
new features/enhancements:
..........................
a version subcommand has been added

annotated variants support hyperlinks for several new species

improved command line interface for the new reheader tool



changes in 0.1.4:
-----------------

v0.1.4 is the most significant "minor" release of MiModD yet and brings 
several enhancements and numerous bug-fixes.

new features/enhancements:
..........................
simplified installation (see the updated installation instructions for details):
- MiModD is now pip installable
- samtools, bcftools and snap have become integrated and need not be installed 
  separately anymore

up-to-date variant calling and SAM/BAM handling:
- the variant calling engine has been upgraded to samtools/bcftools version 1.0
- transition of SAM/BAM handling from samtools 0.1.19 to 1.0 has been initiated
  (during the transition phase MiModD ships with both samtools versions)
  
substantially improved SAM/BAM header operations:
- SAM/BAM header validation has been enhanced and error messages have become 
  clearer
- the reheader tool has been reworked completely to offer complementary 
  functionality to samtools reheader
- the header, convert and reheader tools all guarantee consistency of their 
  results files including consistency between header and body sections.
  In other words, it should be impossible to generate unprocessable SAM/BAM 
  output from within MiModD
- this fixes issue:
  .................
  #21 using custom headers with convert/reheader can result in inconsistent 
      SAM/BAM files 

bug fixes (incomplete list):
............................
- a bug in the deletion caller has been fixed that caused a sporadically 
  occurring error during insert size sampling
- SAM files generated by the header tool can now be converted to BAM format
- issue #23: failure to autodetect the SnpEff data folder has been solved, so 
  SnpEff integration finally works as advertised
- issue #18: substitute temporary file names in tool output has been addressed 
  making temporary file handling by MiModD truely transparent
   


changes in 0.1.3.1:
-------------------
This version makes MiModD fully compatible with systems with only the standard getopt() functionality (i.e. MacOS X).
Earlier versions failed to run samtools view commands with file redirection.

fixed issue:
............
#20 pysamtool.view generates non-canonical command line



changes in 0.1.3:
-----------------
new features:
.............
snap tool: now writes MD5 tags for all reference contigs to aligned reads file 
and this is used by the varcall tool to verify reference identity for variant calling.
convert tool: can now convert fastq.gz input to SAM/BAM also from within Galaxy
can convert multi-part fastq or fastq.gz input to single SAM/BAM in one step

enhancements:
.............
snap tool: faster decompression of fastq.gz or bam input

fixed issues:
.............
#13: delcall bugs
#10: header tool compatibility with samtools



changes in 0.1.2:
-----------------
added new option to varcall / Variant Calling tool to generate a report on 
coverage statistics



changes in 0.1.1: 
----------------- 
fixed issues: 
#1: temporary file management caused error when input files and temporary file 
    directory are on different physical devices 
#2: TMPFILES_PATHs set via mimodd config -c --tmpfiles are now interpreted 
    relative to the current working directory, i.e., 
    mimodd config -c --tmpfiles tmp is extrapolated to TMPFILES_PATH : cwd/tmp 
