CONFIGURATION INFO

Default.imagine configuration for GoldenGATE Document Markup System, created 2014.10.21.13.39

First standard configuration for GoldenGATE Imagine


REQUIRED JAVA VERSION

Sun (r) Java Runtime Environment (JRE) 1.4.2 or higher (recommended: JRE 1.5.0 or higher)


REQUIRED GOLDENGATE VERSION

2013.02.19.19.30


LICENSE

Copyright (c) 2006-2014, Guido Sautter, IPD Boehm, Universität Karlsruhe (TH)
All rights reserved.
Redistribution and use in source and binary forms, with or without
modification, are permitted provided that the following conditions are met:

    * Redistributions of source code must retain the above copyright
      notice, this list of conditions and the following disclaimer.
    * Redistributions in binary form must reproduce the above copyright
      notice, this list of conditions and the following disclaimer in the
      documentation and/or other materials provided with the distribution.
    * Neither the name of the Universität Karlsruhe (TH) nor the
      names of its contributors may be used to endorse or promote products
      derived from this software without specific prior written permission.

THIS SOFTWARE IS PROVIDED BY THE REGENTS AND CONTRIBUTORS 'AS IS' AND ANY
EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED
WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE
DISCLAIMED. IN NO EVENT SHALL THE REGENTS OR CONTRIBUTORS BE LIABLE FOR ANY
DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES
(INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES;
LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND
ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT
(INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS
SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.


CHANGE LOG

Changes to this configuration in reverse chronological order


NEW IN VERSION 2026.04.20.01.10

- added support and editor for document category assignments
- added support for dedicated standalone image markup tools
- improved handling of several edge cases in taxon name base authorities


NEW IN VERSION 2026.01.06.20.47

- added handler for preferred figure renditions (mainly in MNHN publications for now)
- added proper handling of generic binary supplements in IMF fast-fetch filters


NEW IN VERSION 2025.11.25.01.57

- bugfix in attributes of non-primary higher taxa in TreeFAT tagger
- added inclusion of table derived treatments in DarwinCore Archives


NEW IN VERSION 2025.10.16.01.54

- added support for loading and storing IMFv2 persisted documents to and from server based repository
- added customizable annotation list views
- added customizable generic XML views
- added dedicated table views
- multiple smaller improvements and fixes in various places


NEW IN VERSION 2025.04.22.20.31

- added further edge case catch to URL/DOI trimming routine of reference parser


NEW IN VERSION 2025.04.16.22.58

- bugfix in pagination handling of bibliographic reference parser
- added proper handling for lower case DOI labels to bibliographic reference parser
- added joining/merging option for super-stretched headings to document structure detection and templates
- added cleanup tool for single-letter collection codes
- bugfix in author detail extraction from article heads
- improved alignment of treatment structuring rules between using or not using document style template
- added cache cleaning function to treatment inclusion handler to facilitate adapting to treatment structure changes


NEW IN VERSION 2025.03.20.18.44

- bugfix in table marking and structuring macro


NEW IN VERSION 2025.03.15.09.49

- fixed context menu function using selected text as detail attributes for authors


NEW IN VERSION 2025.03.10.17.26

- re-added 'link bibliographic citation' function to context menu
- added function converting keys into treatments to main menu
- added function tagging materials citation details without marking materials citations proper


NEW IN VERSION 2025.03.08.02.55

- added functionality properly indicating menu placement of function for approving aspects of documents that are governed by user certificates


NEW IN VERSION 2025.03.07.01.59

- re-added 'mark materials citations' function to main and context menu
- added function splitting annotations before, after, or around all occurrences of some selected token in generic XML views


NEW IN VERSION 2025.02.01.02.51

- added logic keeping spaces out of DOIs and URLs in reference string attributes
- added handler plug-in for 'includeIn' attributes on treatments
- added option to flag annotations in feedback dialogs


NEW IN VERSION 2025.01.26.03.19

- re-export after migration to new GoldenGATE application core


NEW IN VERSION 2024.07.01.07.32

- improved catalog lookup behavior for above-genus non-primary taxa


NEW IN VERSION 2024.06.09.04.12

- fixed behavior of metadata extraction in presence of characters that normalize away (e.g. combining accents)
- added template parameters for handling title banner images in article headers
- added quality control check for authority in treatment taxa


NEW IN VERSION 2024.02.02.03.00

- hardened text stream error checking against pathological conditions in captions and footnotes
- improved error logging for QC checks


NEW IN VERSION 2024.01.31.08.50

- fixing text stream error checking problems caused by old file timestamp
- hardened XHTML preview and validation against number conflation due to very dense lines


NEW IN VERSION 2024.01.11.20.52

- clarified options for author name part order in bibliography tagging templates


NEW IN VERSION 2023.10.26.18.10

- centralized taxonomic name catalog API lookup infrastructure (specifically CoL and GBIF)


NEW IN VERSION 2023.10.24.23.29

- bugfix in taxonomic name catalog uplink


NEW IN VERSION 2023.10.23.03.31

- added fine-grained template based control to block splitting
- improved partial export of large bitmap figures and vector graphics
- added visualization for connected tables
- added browser based HTML preview for tables
- added quality control for tables
- enforcing presence of type in treatment sections
- added normalization for nomenclatural status of taxon names
- removed tagging of taxon name authorities across colons
- improved tagging of taxon name across infixes
- added normalization for specimen type status
- improved tagging of specimen counts
- added kewword tagging to document structure detection
- added various new abbreviations to figure citation tagging
- various minor tweaks and improvements in different places


NEW IN VERSION 2023.07.11.02.25

- added text alignment selector in "Revise Block Paragraphs"
- refined text alignment analysis in text block structure detection
- added check for genus "Data" to taxonomic name QC rules
- switched recognition of keading DOI labels case insensitive in bibliography tagger
- fixed character width computation in embedded OCR handling with conflicting font encodings
- added page exclusion list for table detection to respectve part of document style templates
- added "whole paragraph" mode for font style and pattern filters to document style parameters for heading detection
- improved error handling in GoldenGATE IMS connector plug-in


NEW IN VERSION 2023.05.15.02.17

- added more detailed layout options for individual types of cations


NEW IN VERSION 2023.04.21.01.42

- zoom bugfix in feedback widget used for parsing bibliographic references and materials citations
- added French rank labels to taxonomic name tagger


NEW IN VERSION 2023.04.20.04.12

- document style template parameter name fix in batch result approval
- added support for document style template based control parameters for server side batch processing


NEW IN VERSION 2023.04.13.00.00

- added small-caps handling routine to document structure detection
- added keyword tagging to document structuring pipeline
- fixed certification tracking in absence of server log-in


NEW IN VERSION 2023.04.04.03.17

- bugfix in metadata editor
- bugfix in list fields of document style template editor
- added invalid value highlighting in document style template editor


NEW IN VERSION 2023.04.03.02.16

- added user certification tracker and update approval manager
- added special case handling for whole-block captions


NEW IN VERSION 2023.02.15.21.48

- switched to new version of Catalogue of Life Local
- added Catalogue of Life uplink for treatment taxa and cited taxa
- added new accession number tagger


NEW IN VERSION 2022.12.14.20.46

- bugfix in materials citation handling facilities


NEW IN VERSION 2022.12.14.05.08

- added support for OCR adjusting OCR to underlying scans
- added visual conflict detection for OCR derived words
- added support for clustering-based OCR error correction
- bugfix in text based metadata extraction dialog
- improved accession number tagger
- added linking of accession numbers to ENA
- several minor improvements and fixes in various places


NEW IN VERSION 2022.07.21.03.36

- added "apply to all" quick fixes for hyphenation errors
- fixed re-engaging problem in "Re-Check On Edits" switch in QC dialog


NEW IN VERSION 2022.07.18.05.07

- added quality control rules checking treatment and section nesting


NEW IN VERSION 2022.06.27.12.56

- added smart annotation mode using patterns
- added quality control rules for treatment citation groups
- improved handling of authority name suffixes in taxonomic name handling
- added various edge case catches in PDF decoder


NEW IN VERSION 2022.06.16.01.54

- modified paragraph break checking to allow in-line pragraph breaks at subSubSection boundaries
- modified paragraph break checking to enforce pragraph breaks at all subSubSection and treatment boundaries
- added cleanup tool ensuring pragraph breaks at all subSubSection and treatment boundaries


NEW IN VERSION 2022.03.24.11.32

- added quality control check for article level sections nested inside treatments


NEW IN VERSION 2022.03.18.20.00

- bugfix in Catalog of Life Local fulltext index lookups


NEW IN VERSION 2022.03.14.20.22

- improved quick fix for numerical materials citation detail errors


NEW IN VERSION 2022.03.10.01.57

- augmented quality control with pattern based value checks for numerical materials citation attributes


NEW IN VERSION 2022.03.10.00.12

- augmented quality control with checks for numerical materials citation details
- added quick fix for extracting numerical materials citation details after markup


NEW IN VERSION 2022.03.07.20.38

- added support for documents to become open after embargo period
- added style template support for document embargo period


NEW IN VERSION 2022.02.24.03.30

- bugfix in treatment tagger and treatment structurer


NEW IN VERSION 2022.02.11.02.10

- menu configurations fixed and updated
- added treatment structuring context menu function and quick fix


NEW IN VERSION 2022.01.31.09.24

- added document style parameters for custom rules identifying treatment starts
- added document style parameters for custom rules identifying treatment section types


NEW IN VERSION 2022.01.21.05.22

- improved handling of list-valued parameters in document style manager


NEW IN VERSION 2022.01.19.19.36

- added context menu based linking of individual bibliographic citations


NEW IN VERSION 2022.01.18.02.21

- added optional deferred re-checking of errors after document edits
- extended range of considered options in parsing pre-annotated taxon names


NEW IN VERSION 2021.12.21.06.34

- added quick fixes for text stream errors and bibliographic reference errors
- added support for hybrid PDFs (scanned, with text layer digitized or vectorized)
- added support for fonts with >255 characters
- fixed case sensitivity problem in recognition of known species epithets
- various minor fixes and improvements in several places


NEW IN VERSION 2021.08.13.04.12

- fixed combinatoric runaway in bibliographic reference tagger


NEW IN VERSION 2021.08.12.04.40

- fixed combinatoric runaway in bibliographic in-line citation tagger


NEW IN VERSION 2021.08.09.20.59

- improved edge case handling in CoL-Local multi-epithet lookup


NEW IN VERSION 2021.08.08.01.56

- bugfix in CoL-Local multi-epithet lookup


NEW IN VERSION 2021.08.06.00.35

- bugfix in template based bibliographic metadata extraction


NEW IN VERSION 2021.08.05.23.17

- general improvement of cache organization in higher taxonomy and authority lookup providers


NEW IN VERSION 2021.08.05.01.16

- bugfix in lookup result caching behavior of CoL-Local based higher taxonomy provider


NEW IN VERSION 2021.07.30.21.49

- bugfix in GamtaScript engine


NEW IN VERSION 2021.07.27.03.24

- added new version of local in-memory representation of Catalog of Life
- added heading based filter to bibliographic reference tagger to help prevent overshoots


NEW IN VERSION 2021.07.27.02.59

- added new version of local in-memory representation of Catalog of Life
- added heading based filter to bibliographic reference tagger to help prevent overshoots


NEW IN VERSION 2021.04.15.16.47

- added tagger for uncertain and temporary species names
- included number words in specimen count tagging (English for now)
- made custom context menu items more easily available
- color coded custom context menu items
- organized items in tools menu
- added observance of text direction to boundary computation in word imports


NEW IN VERSION 2021.04.05.14.49

- added thesaurus of journal names to bibliographic reference handling infrastructure
- added tagging functionality for bibliographic in-line citations
- extended treatment citation tagging to work with bibliographic in-line citations
- added multi-subject editing of attributes to annotation and region listings
- several minor improvements in various places


NEW IN VERSION 2021.03.19.06.46

- included source PDF exporter to simplify re-decoding PDF
- added document merging functionality, e.g. to replace broken figures or fonts
- added tracking of modifications to whole fonts to UNDO management
- added handling of mask images to PDF decoder
- changed logic of font editor UI to exclude selecting serif and monospaced at same time
- added functionality to link individual bibliographic citations to bibliography


NEW IN VERSION 2021.02.17.04.37

- added enforcement of order attribute to QC rules
- added pattern-based check of order attribute to QC rules
- added pattern-based check of family attribute to QC rules
- added document style template parameters to allow selection of batch to run after server side decoding


NEW IN VERSION 2021.02.03.23.32

- added catch for empty results from DOI lookup in bibliographic data sources
- added normalization of Roman numeral page numbers in born-digital documents


NEW IN VERSION 2021.02.03.20.42

- added acceptance of number ranges and Roman numbers in volume, issue, and numero
- centralized sanitization of attribute values for bibliographic metadata


NEW IN VERSION 2021.01.26.17.50

- supplement to earlier update, repairing metadata management


NEW IN VERSION 2021.01.26.08.15

- made ReFinder lookup result processing less susceptible to data variability
- added more differentiate options for document metadata lookup in ReFinder
- added exact date of publication completion to ReFinder lookup result processing
- fixed discrepancies of document metadata handling between batch and interactive processing
- finished consolidation of illustration handling
- multi-line cell related bugfix in table row to line splitting


NEW IN VERSION 2021.01.19.06.00

- bugfix in handling of continuation captions
- improved actions available for extraction of illustrations


NEW IN VERSION 2021.01.11.19.00

- added "required" feature for document style template anchors


NEW IN VERSION 2021.01.11.14.09

- added error labeling in document error display dialog
- added error label filtering in document error display dialog
- added support for multipat illustrations
- centralized marking and copying images and graphics
- added functionality cutting captions off image edges on marking where possible
- added functionality marking continuation captions
- added observance of continuation captions to QC
- minor bugfix in ReFinder lookup
- bugfixes in rotated sub document editing
- various minor improvements in PDF decoder


NEW IN VERSION 2020.11.06.18.28

- moved document style templates to system core
- moved document style template handling plugins to dedicated project
- integrated document style template handling plugins with new server side infrastructure
- added inheritance to document style template maintenance
- adjusted document style template consuming plugins and gizmos to new infrastructure
- various bugfixes and improvements in PDF decoder


NEW IN VERSION 2020.09.18.04.13

- added comprehensive handling of page rotation
- improved parameter observance in several PDF image decoding routines
- added observance of PDF text rendering mode, with special treatment for embedded OCR
- added functionality adjusting embedded OCR to scans
- added sub dialog editing with excerpt rotating option to help with mixed-orientation pages
- added plain text line to OCR editing facilities
- added unified document error checking infrastructure
- added "alternative rendition" option for images in scanned documents (both via drag&drop and via file selection dialog)
- included XHTML validation in error checks
- switched paragraph boundary checking to page layout based approach to reduce false positives and catch abbreviation dot paragraph ends
- added handling of hierarchical numbering to figure citation handling
- added error check for caption boundaries
- switched DOI lookup to using only last name of first author
- several smaller improvements in various places


NEW IN VERSION 2020.06.29.02.18

- re-added error protocol exporter to facilityte running QC Tool on desktop batch results
- added template parameters to control automated detection of taxonomic keys
- improved support for manually marking and adjusting taxonomic keys
- added template parameter for splitting headings off the top of text blocks
- improved handling of captions lying inside their target figures
- added detection and handling for less common taxon name status labels
- added error check for absence of publisher-issued DOI
- adjusted online lookup behavior of document metadata handler
- added further filters to prevent false positives in table detection
- added geologicalTimeScale detail to materials citations
- bugfix in PDF decryption
- improved handling of weirdly transformed images


NEW IN VERSION 2020.04.29.19.23

- bugfix in index character based author detail assignment


NEW IN VERSION 2020.04.28.20.41

- improved multi-value handling in index associated author details
- added catch for text stream end predecessor of text streams cut out of images in document structure detection


NEW IN VERSION 2020.04.27.02.19

- added centralized manager of external sources of bibliographic metadata


NEW IN VERSION 2020.04.27.01.48

- added new version of document style template for ZooKeys PDFs
- added functionality for tagging in-line headings to document structure detection
- added parameters for tagging in-line headings to Zootaxa templates


NEW IN VERSION 2020.04.07.15.35

- re-export of previous version to re-include document style manager


NEW IN VERSION 2020.04.07.05.01

- improved UI and visualization facilities for style template editing
- augmented heading style to accommodate headings on top of off-center blocks or in off-center columns
- added extraction protocol for heading style template testing
- added style template flag for handling captions whose start sits in separate line akin to heading
- added author detail extraction parameters to document style templates for Zootaxa and EJT


NEW IN VERSION 2020.04.03.04.26

- added handling of author detail data to bibliographic metadata extraction
- added template parameters for extracting author detail data
- bugfix in FAT
- added editable combo boxes in style template editor
- added handling of remarks interspersed with bibliography to reference tagger
- several smaller improvements in various places


NEW IN VERSION 2020.03.10.18.34

- improved test facilities for document metadata extraction templates
- improved handling of ambiguous country names
- footnote extraction bugfix
- added small-caps to heading styles
- added treatment citation tagger tool to UI
- increased display time for tooltips in document style template editor
- made image markup tools available in XML view
- many smaller improvements in various places


NEW IN VERSION 2020.02.04.05.25

- modified tagger script to mark treatment citations around taxon names rather than inside them
- added more style tolerance to targeted taxon name parsing
- prevented taxon name tagging from bridging over dashes before (last) authority to avoid inclusion of citations to secondary treatments in place of authority
- added correction function for word relations in extremely dense lines to separate conflated words
- now observing and bridging over editor list labels in bibliography tagging


NEW IN VERSION 2020.01.28.02.28

- replaced ImageMagick binaries with latest versions
- improved image brightness computation
- extended document heading style templates to facilitate using multiple matchers per heading level
- extended document metadata style templates to facilitate specifying line breaks as value separators
- amended alignments in document heading style templates to facilitate distinguishing centered from justified layout
- extended test routine for document style templates to actually observe specified number of starting pages
- fixed document style template editor to retain all available variables in anchors
- extended document style template editor to allow using drop-down selectors on non-string fields
- made main window "Tools" menu entries available in XML view (where sensible)
- added runaway prevention mechsnism to extraction of basic materials citation details
- rendered authority augmentation less aggressive and streamlines attribute usage
- added acceptance for e-paginations to document metadata validation


NEW IN VERSION 2019.12.19.01.05

- fixed IMF XML wrapper to handle documents whose first page ID is not 0
- fixed document navigation functionality to work with documents whose first page ID is not 0
- minor improvements in OCR editing focus traversal
- minor improvements in font editor symbol table handling
- rendered black-on-white correction for images less trigger-happy


NEW IN VERSION 2019.12.13.23.49

- completely rebuilt OCR editing facilities to improve usability
- added page group specific column area parameters to page layout in templates
- changed context menu to fold around if too large to fit window height
- installed safeguard against combinatorical runaways in materials citation handling
- added filter for MycoBank in accession number linking
- many small improvements and fixes in various places


NEW IN VERSION 2019.09.12.13.25

- several minor bugfixes


NEW IN VERSION 2019.09.05.00.24

- bugfix in server based document IO
- bugfix in XPath handling of treatment structuring rules


NEW IN VERSION 2019.08.30.23.34

- improved annotation handling in text stream cut-outs
- improved automated error re-checking on text stream edits
- added manual override to caption assignment matchup checks
- several minor bugfixes in various places
- added table citations to TaxPub import


NEW IN VERSION 2019.08.08.08.22

- moved QC Tool to dedicated QC project
- moved QC Tool data connection to dedicated plug-ins
- moved error checklists and error checking to QC project
- made error protocol based navigation controllable
- added text flow checks
- added materials citation detail checks
- improved key extraction across page and column breaks
- switched server based document lists to new central utility class


NEW IN VERSION 2019.07.18.15.46

- bugfix in tagger for collecting countries and regions


NEW IN VERSION 2019.07.17.22.50

- follow-up on improved text stream handling in context menu


NEW IN VERSION 2019.07.17.22.11

- added selector for licenses put on Zenodo depositions
- improved country and region filtering in materials citation markup
- added functionality cutting images free from text blocks to document structure detection
- added "immature" as a specimen type
- blocked consideration of numbered references from bibliography detection in various style templates
- fixed import of scanned page images coming in multiple superimposed parts


NEW IN VERSION 2019.06.26.06.26

- added catch for annotation problems in citation tagging
- added more flexibility to XML output and XSLT processing
- fixed some terminological legacy problems in XML handling


NEW IN VERSION 2019.06.18.23.41

- improved edge case handling in collection code tagging
- bugfix in word selection base annotation of captions
- adjusted EJT template to cover recent layout changes in article headers
- several minor improvements in various places


NEW IN VERSION 2019.05.31.19.40

- added patterns matching lines that mark paragraph boundaries
- added chunking of server uploads to decrease resource consumption of HTTP request buffering
- added scrolling to document style template editor, for both parameter groups and parameter input fields
- several minor improvements in various places


NEW IN VERSION 2019.05.17.17.57

- bugfixes in behavior of custom data object lists ("List Annotations" and "List Regions" in "Edit" menu)
- increased recall of GBIF lookups for higher taxonomy and authority data
- improved taxonomic name tagging in reference lists
- improved bibliographic citation tagging to handle page numbers in citation lists
- refined QC error checklists to differentiate role of taxonomic names in error severity
- added a few functions helpful in QC taxonomic name handling


NEW IN VERSION 2019.05.15.19.43

- bugfix in table detection and markup with scanned PDFs
- various smaller improvements in PDF decoder in general
- preventing but all hang-ups and runaways in materials citation parsing now
- improved handling of quotes in materials citations
- improved materials citation detail handling
- added erroneous data tolerance to coordinate tagging
- added broken sort order tolerance to collection code list detection
- increased broken sort order tolerance in bibliography detection
- many smaller improvements in various places


NEW IN VERSION 2019.04.17.19.49

- also checking for basionym authority now in taxonomic name checks


NEW IN VERSION 2019.04.17.16.58

- added account for HTTPS access to Frankfurt server


NEW IN VERSION 2019.04.17.16.10

- fixed bug regarding partially unencoded PDF page content
- added support for PDFs with unconventional spacing between object definitions
- improved cache data handling on updates (defaults to moving instead of copying now)
- changed bibliographic citation tagging to strictly work from references
- preventing spcimen codes from overshooting into other numerical details of materials citations now
- added plural handling in figure and table citation markup
- hardened figure and table citation markup agains emulated small-caps
- improved atomixity of XML window editing


NEW IN VERSION 2019.04.03.14.20

- made instantaneous QC error re-checks more economical
- fixed FAT rank computation glitch


NEW IN VERSION 2019.03.21.17.31

- added catch for empty scopes in materials citation handling
- added catch for empty figures in page structure detection


NEW IN VERSION 2019.03.18.23.06

- solved dependency problem in Quality Control infrastructure


NEW IN VERSION 2019.03.16.09.04

- added automated Quality Control and respective infrastructure


NEW IN VERSION 2019.03.15.10.03

- turned error checks into resources
- added more filtering options to error protocol display
- added document approval function
- added fast fetch mode to server based document loading


NEW IN VERSION 2019.02.20.19.48

- added "Re-Check" button to document error viewer
- several error protocol update improvements
- added context based collection code detection
- improved collecting country filtering
- extended grouping facilities for materials citations
- fixed high-effort edge cases in materials citation parsing (with extremely long detail enumerations)
- added catch for empty attributes in template based document metadata extraction
- improved author name part order flip handling for bibliographic references


NEW IN VERSION 2019.02.08.03.27

- fixed scrambled font problems in PDF decoder, finally
- several minor bugfixes in document style manager


NEW IN VERSION 2019.02.04.07.39

- added connection to new server


NEW IN VERSION 2019.02.04.07.07

- added HTTPS capability for interaction with new server
- added document error checking and displaying facilities
- minor bugfix in taxon name handling
- minor bugfix in materials citation detail scoping


NEW IN VERSION 2019.01.29.13.20

- pattern generation bugfix in FAT


NEW IN VERSION 2019.01.29.02.37

- bugfix in annotation nesting checker


NEW IN VERSION 2019.01.27.21.30

- added filter chaining for PDF image decoding
- added nomenclatorial code sensitivity to taxonomic name handling
- improved collection code tagging to work with collection list if present
- improved country tagging to reduce false positives
- improved materials citation handling to prevent combinatorical runaways
- added safe mode to materials citation handling to prevent wrong data extraction from specimen label quotes
- improved proper name handling in materials citation to better distinguish locations from persons
- added document style sensitivity to materials citation handling
- improved UI of document style manager to provide explanations
- added test and visualization features to document style manager
- many minor improvements


NEW IN VERSION 2018.10.10.00.23

- improved UI integration of bibliography handling facilities
- increased use of labeled editor lists to improve accuracy in volume references
- added publication year filter to broken URL recovery
- several minor improvements in edge case handling


NEW IN VERSION 2018.10.05.17.38

- added clipping to PDF decoder graphics and bitmap handling
- improved PDF decoder bitmap handling to be more memory efficient
- added default charsets to PDF font decoder
- added recognition of page layout artwork to prevent interference with page structure detection
- added recursive structure detection for text boxes
- improved handling of empty table cells in XML representation
- improved bibliographic reference author list handling to prevent combinatoric runaways
- added handling of several minor edge cases


NEW IN VERSION 2018.09.19.22.30

- taxonomic key handler update, adjusting to API change


NEW IN VERSION 2018.09.19.21.39

- bugfix in volume reference handling


NEW IN VERSION 2018.09.16.21.54

- improved bibliographic reference parsing
- many minor bugfixes in PDF decoding


NEW IN VERSION 2018.06.27.21.20

- bugfix in bibliographic citation tagger


NEW IN VERSION 2018.06.25.08.02

- improved bibliographic reference tagger, and added edge case catches
- added "Skip & Next" option to materials citation parser dialogs
- added "Skip & Next" option to bibliographic reference parser dialogs


NEW IN VERSION 2018.05.24.00.23

- dependency bugfix in handler for taxonomic keys


NEW IN VERSION 2018.05.11.18.26

- fixed annotation nesting bug on IMF to XML export
- improved block structure detection to use both layout and morphological clues
- improved cross-page paragraph detection to consider layout of both blocks involved
- improved center alignment detection to measure based upon block


NEW IN VERSION 2018.02.13.21.58

- added graphics based multi-column and multi-row cell detection for full table grids
- added option to turn off Unicode mapping in PDF font decoding
- improved retro-application of ID link between bibliographic references and respective citations


NEW IN VERSION 2018.02.06.02.34

- improvements in table auto-detection, espacially handling of serrated column margins
- bugfix in caption filtering of table auto-detection facilities
- improved handling of graphics and page margins in rectifying PDF pages not originally positioned left-to-right
- improved edge case handling in sort order checks of bibliographics reference tagging
- bugfix in detection of treatments starting right after "Results" heading
- extensions to authority handling in taxonomic name recognition


NEW IN VERSION 2018.01.29.23.08

- replaced bibliographic reference tagger with more flexible and adaptive new implementation
- added ID reference capability to bibliographic references and corresponding in-text citations
- added ID reference capability to captions and corresponding in-text figure citations
- fixed several table auto-detection row and column merging issues


NEW IN VERSION 2017.12.30.02.03

- fixed center-aligned heading detection problem
- added multiple subSection types (key_words, results, discussion) as well as respective detectors


NEW IN VERSION 2017.12.29.21.34

- further improvements to table structure detection
- switched to graphics backed table detection in document structure detector (for full grids and horizontal line grids thus far, other - less common - types to follow)


NEW IN VERSION 2017.12.13.00.03

- fixed PDF line lenght overflows
- fixed Zootaxa pagination issue
- narrowed minimum word gap to accept as space to fix text extraction word conflation issue
- improved automated table structure detection in manual editing (use in automated detection yet to follow)


NEW IN VERSION 2017.11.09.22.35

- all-around update of Type1 and Type1C font decoding
- several smaller bugfixes
- added duplicate removal for regions


NEW IN VERSION 2017.10.18.08.32

- bugfix for multi-value attributes in document metadata extraction


NEW IN VERSION 2017.10.11.00.48

- added handling for multi-column and multi-row table cells
- added XHTML export of tables to reflect multi-column and multi-row cells


NEW IN VERSION 2017.09.15.17.05

- four-letter month fix in publication date extraction


NEW IN VERSION 2017.09.11.07.30

- added recognition and rendering of monospaced fonts
- added resolution of font name collisions
- added 'nova' for net taxon name labels
- added further punctuation marks to be recognized as marking minutes or seconds or arch
- improved handling of separation color spaces
- bugfix in character normalization part of XML wrapper
- added duplicate resolution for regions


NEW IN VERSION 2017.08.21.23.53

- added standalone authority augmenter
- updates to function libraries


NEW IN VERSION 2017.08.21.03.52

- added exact date of publication to document metadata handling and style templates


NEW IN VERSION 2017.08.16.01.06

- catching further potential combinatorical explosions in materials citation handling during detail overlay creation
- HTTPS related pattern fix in attaching separate-paragraph DOIs to bibliographic references


NEW IN VERSION 2017.08.14.22.06

- effectively preventing combinatorical explosion in materials citation handler during detail overlay creation
- extended maximum number of colors in bitmap images to 8
- fixed Lab colorspace conversion errors
- extended options for batch runner


NEW IN VERSION 2017.08.05.17.50

- collection code detection bugfix in materials citation handler


NEW IN VERSION 2017.08.05.16.28

- authority augmenter data import bugfix


NEW IN VERSION 2017.08.02.01.41

- improved authority augmenter to distinguish basionym from combination authority


NEW IN VERSION 2017.07.17.04.29

- improved materialc citation tagger/parser


NEW IN VERSION 2017.07.14.22.51

- various updates, minor improvements, and edge case handlers


NEW IN VERSION 2017.04.14.19.37

- various improvements in font decoding, especially small-caps handling
- improvements in figure citation detection
- added some tolerance in tagging and parsing of geo-coordinates with partial punctuation


NEW IN VERSION 2017.03.22.02.46

- improvement in displaying markup against non-white text backdrop


NEW IN VERSION 2017.03.16.23.56

- bugfix in marking images and graphics


NEW IN VERSION 2017.03.06.23.16

- imprevements, extensions, and bug fixes in PostScript part of Type1 font handling
- improved watermark detection and removal
- added handling of double-rank status labels to FAT (e.g. "gen. et spec. nov.")
- bug fix in >255 character code handling in embedded fonts
- embedded font editor now displaying hexadecimal character codes


NEW IN VERSION 2017.02.21.01.11

- improved line splitting in word block OCR
- improved manual markup of images in scanned documents
- now preserving captions and labels in manual markup of images
- improved hadling of rotated pages and page content in born-digital documents
- improved color space handling, espacially with DTC encoded images


NEW IN VERSION 2017.01.19.15.06

- fixed DOI pattern in Zootaxa style template to match new 2017 format


NEW IN VERSION 2016.12.20.17.23

- added "conservation" section type to treatment structurer
- added "vernacular_names" section type to treatment structurer
- page image downscaling bugfix for scanned PDFs
- made advanced PDF decoder options accessible in UI


NEW IN VERSION 2016.12.10.23.08

- prevented PDF font decoder from destroying faithful Unicode mappings of out-of-Unicode ligatures
- added various functions for marking figure and table citations


NEW IN VERSION 2016.12.09.07.31

- RefParse now chunking author+year index letters off title even with lack of seperating punctuation
- improvements to RefParse to work better with journal-heavy bibliographies
- added clipping functionality to vector graphics rendering
- vector graphics rendering bugfix for filled vector paths


NEW IN VERSION 2016.12.06.07.02

- NCBI kingdom typo fixed
- added flipping graphics along with bottom-up and top-down text blocks (table grids !!!)


NEW IN VERSION 2016.12.06.03.48

- upper case index letter bugfix in figure citation detection
- finally got numbered treatment headings to play their part in treatment tagging
- alleviated memory problems incurred by ultra high resolution figures when default parsing fails
- multi-part figure page image rendering bugfix
- font char usage assessment concurrency bugfix


NEW IN VERSION 2016.11.21.16.13

- added support for further image and graphics color spaces
- added support for PostScript based color space conversion
- added support for composite alpha and overpainting
- improved graphics object faintness analysis
- improved bitmap based figure decoding
- switched export of pure vector based graphics to SVG


NEW IN VERSION 2016.11.09.11.45

- added annotation makro for figure and table citations
- page boundary bugfix in PDF decoder for born-digital documents


NEW IN VERSION 2016.11.05.11.59

- improved handing of figure images embedded in PDFs
- added handling of figures that are made up from multiple physical images
- added handling of native vector based graphics in PDFs
- now treating in-figure words as 'label' type text streams instead of removing them
- many smaller improvements in PDF decoding and elsewhere


NEW IN VERSION 2016.11.05.11.53

- improved handing of figure images embedded in PDFs
- added handling of native vector based graphics in PDFs
- now treating in-figure words as 'label' text streams instead of removing them
- many smaller improvements in PDF decoding and elsewhere


NEW IN VERSION 2016.07.22.06.29

- bugfix in higher taxonomy addition to above genus taxa


NEW IN VERSION 2016.07.19.21.20

- bugfix in separator detection part of new materials citation tagger/parser


NEW IN VERSION 2016.07.16.19.00

- added automated tagger/parser for materials citations for document as a whole
- added context menu based automated tagger/parser for materials citations in individual treatments
- some other minor improvements and refinements


NEW IN VERSION 2016.06.24.22.18

- overhauled taxonomic name parser to better work with higher taxonomy
- added attribute suggestions
- added attribute value suggestions
- improved case distinction in font decoding
- hardened font decoding against defective glyph programs
- several minor improvements in various places


NEW IN VERSION 2016.05.18.15.18

- added functionality copying attributes between annotations
- bugfix in annotation attribute editing UNDO
- added functionality for splitting words
- added textual context analysis to font decoding
- added scaling analysis to font decoding to better distinguish upper an lower case in problem chars
- improved CID handling in TrueType font decoding


NEW IN VERSION 2016.04.22.15.42

- added "com. nov." (plus possible variants) as status label to FAT
- improved key tagging to refuse single-paragraph keys
- improved annotation nesting correction to better handle taxonomicName/treatmentCitation conflicts
- improved PDF content stream handling to better handle line break bytes at end of stream
- extended geo-coordinate tagger to recognize further indicators of minutes and seconds of arch


NEW IN VERSION 2016.04.11.03.45

- added last name prefixes ('von', 'van', 'de', etc.) to FAT authority tagging


NEW IN VERSION 2016.04.06.14.57

- reverted footnote extension to prevent mistaking keys for footnotes


NEW IN VERSION 2016.04.05.23.01

- bugfix in in-figure word cleanup
- improved style template backed footnote detection in documents with small average font size
- improved detection of taxonomic keys
- bugfix in table detection, preventing wrongful detection of smallish "ghost" tables where there are none
- taxonomic name markup in the presence of extensive bibliographic citations
- added filter for document structure attributes to bibliographic citation markup
- improved treatment structuring rules in the presence of exotic in-line headings


NEW IN VERSION 2016.04.05.01.35

- reduced computational cost of tagging complex authorities in FAT


NEW IN VERSION 2016.04.02.22.57

- bugfix in table continuation detection
- bugfix in data extraction from connected tables


NEW IN VERSION 2016.04.01.15.45

- added filter for heading-only treatments


NEW IN VERSION 2016.04.01.05.24

- added tagger for accession numbers that also includes HTTP URIs
- improved handling of OCR embedded in PDFs
- added catalog lookup extension mechanism to FAT


NEW IN VERSION 2016.03.26.18.30

- improved treatment citation tagger to handle overly long citations
- added lookup based collection code tagger that includes collection URIs where possible
- fixed pathologic bug in RefParse


NEW IN VERSION 2016.03.24.01.18

- added treatment citation tagger
- extended bibliographic citation tagger to also accept two-letter last names
- fixed overlapping match problem in FAT


NEW IN VERSION 2016.03.21.02.16

- countered non-bold dashes getting in the way of detecting otherwise bold headings
- further improved treatment structuring rules


NEW IN VERSION 2016.03.21.00.13

- fixed Liberation Font rendering problem
- added level 2 headings to Zootaxa document style templates
- improved subgenus and abbreviation handling in FAT
- improved taxon name infix handling in FAT
- extended treatment structuring rules regading reference groups


NEW IN VERSION 2016.03.16.20.22

- switched PDF decoder to using Liberation Fonts
- switched OCR font style analysis to using Liberation Fonts
- extended annotation nesting checker function


NEW IN VERSION 2016.03.15.02.19

- added in-line heading options to block structure revision
- added loading option for scanned PDFs to import embedded OCR
- improved in-figure word handling in born-digital PDFs
- added disk caching for contents of large IMFs
- fixed document naming bug in plug-in based IO


NEW IN VERSION 2016.03.12.00.16

- added tagger for taxonomic keys
- added conversion of 'key' sections into treatments
- adjusted treatment structuring to include keys
- fixed "premiero" sign problem in geo-coordinate tagger
- added filter for phony geo-coordinates


NEW IN VERSION 2016.03.11.01.43

- readied bibliographic citation tagger for batch operation
- added materials citation detail tagging to style based treatment tagger
- added annotation nesting checker function


NEW IN VERSION 2016.03.10.02.51

- fixed DOI extraction and document type match Zootaxa style template
- fixed document unlocking problem in IMS connection plugin
- improved treatment structuring rules


NEW IN VERSION 2016.03.07.17.22

- added GoldenGATE Server based remote document storage


NEW IN VERSION 2016.03.07.07.34

- extended authority handling in FAT
- using full authorities as evidence now in FAT if layout clues missing
- improved decoding and extraction of line drawings from PDFs
- added missing new heading property to Zootaxa document style templates


NEW IN VERSION 2016.02.13.02.16

- removing words now when marking artifacts
- renamed logical merging of words to 'Join Words'
- added global logical joining of words
- added functionality physically merging words, both for selection and globally
- added functionality marking and removing words in main window
- added 'determinerName' attribute to materials citations
- added text stream navigation functionality
- added text stream ordering functionality for paragraphs and blocks
- added 'Previous' and 'Next' function to attribute editing


NEW IN VERSION 2016.02.02.20.19

- added document dashboard generator
- finished preparing object lists for deployment in web-based UI


NEW IN VERSION 2016.01.26.08.34

- added document style template for ZooKeys PDFs
- improved heading detection and classification
- added tagger for bibliographic citations
- added infrastructure for plug-in based document loading and saving
- hardened taxonomic name recognition against odd epithets


NEW IN VERSION 2016.01.15.15.31

- extended table modification functionality
- added 'table note' blocks and annotations
- added full block structure recovery after table removal
- added catalog provider specific stop word lists to taxonomic name recognition
- added local version of Catalog of Life to reduce web lookups in taxonomic name recognition
- added majority vote based case filter for candidate genera to taxonomic name recognition
- added aggregation of figure images that come in tiles
- replaced decoding and rendering of line drawings to circumvent pixel depth related IcePDF bug
- server connection URL bugfix
- prepared more plug-ins for deployment in web-based UI


NEW IN VERSION 2015.11.24.04.39

- improved PDF font decoding through better glyph size estimation
- improved word untangling in PDF decoding
- added document metadata extraction via in-document selection
- increased reliance on status labels in taxonomic name recognition
- reduced number of false positive catalog lookups in taxonomic name recognition
- added folder based storage of IMF documents for better efficiency
- improved duplicate prevention in annotation-based pattern matching, boosting efficiency
- several figure image decoding improvements and fixes
- prepared most plug-ins for deployment in web-based UI


NEW IN VERSION 2015.10.05.04.25

- added char usage statistics to improve glyph decoding
- improved dealing with words and figures that reach of out of page bounds
- added capability to export treatment data to DwC-A
- added capability to export figures and tables to ZIP, together with captions


NEW IN VERSION 2015.09.18.19.42

- added document style templates for Zootaxa monographs
- adjusted document style templates for Zootaxa articles to account for layout variances
- salvaging taxon name authorities that are also genera
- improved handling of pages flipped from bottom-up or top-down text to left-right
- improved handling of figures embedded in PDFs upside down
- several minor bugfixes


NEW IN VERSION 2015.09.15.00.03

- improved handling of taxonomic names between the ranks of family and genus
- added explicit annotation duplicate cleanup
- added table cell annotation cleanup and safeguard
- added minimum column margin to table detection
- adjusted Zootaxa 2013 onward style template to split captions off tables more reliably


NEW IN VERSION 2015.09.06.18.05

- added document style template for Zootaxa 2013 onward (differs in metadata from 2007 onward)
- added further anchor to Zootaxa 2007 onward document style template to recognize difference
- relaxed criteria for caption detection to cope with font size inaccuracies
- paragraph break detection improvement and bugfix in document structure detector


NEW IN VERSION 2015.09.05.19.03

- added use of document style templates
- added designer for document style templates
- added heading based fully automated treatment tagger
- filtering off-page words


NEW IN VERSION 2015.08.10.14.40

- added decryption of encrypted PDFs
- massive reduction of memory requirements for PDF decoding
- massive reduction of memory requirements for document display
- added document navigation facilities (find next/previous, list occurrences)
- added memory cleanup infrastructure for plug-ins on closing documents


NEW IN VERSION 2015.07.11.01.08

- added text extraction from PDF forms
- added repair function for mass word fragmentation (can happen in obfuscated born-digital PDFs)
- bugfix in OCR result editing
- word sequence modification improvements
- added ontology based trait term tagging
- metric conversion bugfix in quantity tagging
- extended taxon name authority handling to botanical idiosyncracies
- added button based paragraph exclusion in materials citation tagging
- added 'collectedFrom' detail to materials citation attributes


NEW IN VERSION 2015.05.17.14.53

- small-caps problems in PDF font decoding alleviated
- implicit space text obfuscation problems fixed
- landscape page problems fixed
- added editable XML view of document and annotations
- added option to decode PDFs in slave JVM to alleviate memory problems (deactivated in config by default, though)


NEW IN VERSION 2015.05.09.01.21

- PDF facilities can decode TrueType fonts now
- further improvements to PDF font decodeing facilities
- extended font correction functionality for born-digital PDFs
- sorting issues in Java 1.7 and above sorted out
- cations, footnotes, and tables hidden now on treatment and materials citation markup
- many minor fixes and improvements


NEW IN VERSION 2015.03.25.15.07

- improved page image extraction for scanned PDFs (working much the same as for figures now)
- revised distinction of scanned from born-digital PDFs
- fixed decoding of sans-serif fonts
- added MacOS version of OCR engine
- fixed splitting of blocks into paragraphs
- failing gracefully now if Java refuses to render some character
- added manual assignment of captions to images and tables


NEW IN VERSION 2015.03.19.09.31

- added automated title and pagination recognition from document to metadata editor
- added document head annotation of document metadata attributes
- document metadata editor also shows in Tools menu
- extraction buttons for already extracted document metadata attributes reveal themselves with green borders
- restricted emphasis annotations to within paragraph boundaries
- added manual correction of assignment of caption targets (tables and figures) to captions
- updates to caption targets automatically write through to captions, as well as to figureCitations and tableCitations
- improved PDF glyph decoding, including correction of double mappings
- fixed occasional loading and tool application hangups
- many minor UI improvements, including fast scrolling
- added negative caching to CoL and GBIF lookups
- added handling of diacritics to bibliographic reference parser


NEW IN VERSION 2015.03.04.14.27

- added document ID extraction to document metadata extraction
- activated RefBank lookup for document meta data
- fixed table bounds generation on table block merging


NEW IN VERSION 2015.02.26.13.40

- filtering vernacular/common names from CoL lookup results


NEW IN VERSION 2015.02.26.12.31

- center alignment detection works on columns now
- added heading hierarchy assessment to document structure detection


NEW IN VERSION 2015.02.13.11.46

- parallelized catalog lookups in taxonomic name detection
- improved authority handling in taxonomic name detection
- added learning from nomenclature acts to taxonomic name detection
- added block merging functionality


NEW IN VERSION 2015.02.09.10.27

- parallelized document structure detection


NEW IN VERSION 2015.02.04.13.10

- taxonomic name detection bugfix


NEW IN VERSION 2015.02.03.04.30

- bugfix in PDF font decoding
- extended document tructure detection to connecting tables
- extended document tructure detection to marking emphases and headings
- added marking and handling of images, as well as assignment of images to captions
- completely revised taxonomic name detection


NEW IN VERSION 2015.01.19.07.00

- accelerated glyph transcription in embedded fonts of born-digital PDFs
- added glyph transcription editing for embedded fonts in born-digital PDFs
- extended document structure detection to recognizing and marking tables


NEW IN VERSION 2014.12.09.22.00

- finally got intended version of exporter to GoldenGATE Server


NEW IN VERSION 2014.12.09.18.36

- removed generic upload to GoldenGATE Server (the exporter takes its place now)
- improved object listing
- fixed document normalization issue in treatment markup and structuring


NEW IN VERSION 2014.12.09.12.08

- update to data exporter to GoldenGATE Server


NEW IN VERSION 2014.11.28.10.19

- added list view for taxonomic names


NEW IN VERSION 2014.11.28.09.41

- added document structure detector
- added list views for Image Markup Objects


NEW IN VERSION 2014.11.14.00.52

- all-round update
- added editor for document meta data
- added data exporter to GoldenGATE Server
